AI Processor
3 min
the ai processor sends data through an analytics flow to an ai model and returns the model's response use it to generate natural language output, summarize or classify incoming data, or extract structured json from raw data, without writing custom code why use the ai processor use the ai processor when a flow needs to interpret or transform data using natural language rather than fixed logic, for example, summarizing sensor readings, classifying an event from its description, or pulling structured fields out of unstructured text the processor's parameters let you tune the model's behavior for your use case set a system prompt to enforce a consistent tone, persona, or domain expertise across every response adjust temperature to trade consistency for creativity, or the reverse enable force response format to json? when the result needs to feed directly into downstream processing parameters parameter details name the unique identifier for this instance of the ai processor ai model the ai model used to generate responses http timeout the maximum time (in seconds) to wait for a response from the model before the request times out and is ignored system prompt a predefined instruction that shapes the model's tone, persona, or domain expertise for every response temperature controls the randomness of responses lower values (for example, 0 2 ) produce more focused, deterministic output higher values (for example, 1 8 ) produce more varied, creative output default 1 0 max completion tokens limits the number of tokens the model can generate in a single response if not set, the model's default applies time interval duration or frequency at which certain operations or requests should occur force response format to json? when enabled, the model returns only valid json when disabled, the model follows its default output style see the important note below pass through value determines whether the processor's output is the model's response or the original unchanged input value important if you enable force response format to json? , you must also instruct the model to produce json yourself, through a system or user message enabling the parameter alone doesn't guarantee json output related topics analytics flows and processors docid\ xuohhgbpbuh0npti1xtwx ai models docid\ wpy1bci1y2gxjtzfavdm9