AI Responses
7 min
the ai responses processor sends messages to an ai model and returns the model's response it keeps a rolling conversation history across calls for multi turn dialogue beyond a single response, you can give it tools, files, skills, and a persistent memory, which turns it into an agent that reads live and historical data, calls external services, and remembers what it learns use it when a flow needs an ai model that holds context, acts on the system, or serves as an http endpoint how it works the processor sends each incoming message to the configured ai model, along with the recent conversation history, and returns the model's response max message history sets how many messages the processor keeps when the history reaches that limit, each new message drops the oldest this gives the model recent context without letting the history grow indefinitely the processor also copies an incoming request id field to its output, so a webhook in async mode, this processor, and a webhook response form a loop that works out of the box this turns the processor into an http endpoint backed by an ai model model configuration set ai model to the unique name of the model to use, and ai model instructions to the system prompt that shapes its behavior http timeout caps how long the processor waits for a response, max output tokens caps how much the model generates, and file download timeout caps how long the processor waits for files referenced in a response optional features these capabilities run inside the model when it supports them advanced thinking / reasoning enables extended thinking mode enable web search lets the model search the web during generation enable code execution lets the model run code during generation custom tools accepts a json array of tool descriptors that the processor appends to the request the descriptor shape is vendor specific and passed through as is, so you can add mcp server entries or anthropic skill, memory, and bash tool blocks context from ai suite files you attach reusable content from the ai suite page and select it by checkmark the processor reads these files fresh on every event, so edits take effect without a restart, and the processor skips a deleted file skills bundles skill files ( md , txt ) into the prompt, concatenated in selection order with per file headers instruction files prepends always on guidance to the prompt context files attaches images (jpeg, png, gif, or webp) and pdfs as multimodal content blocks, sent inline as base64 the request size limit is 50 mb on openai and 32 mb on anthropic local tools caution the litmus cli tool can call any sdk function the credential allows, including writes use scoped credentials so the model cannot make changes you did not intend local tools run inside the processor when the model calls them, in a loop bounded by max tool iterations and the http timeout raise http timeout , for example to 120 , when you enable any of them, and pair them with a skill file that teaches the model the conventions the processor reports executed calls in the tool activity output field enable litmus cli tool exposes a litmus cli tool that runs the litmus edge (le) sdk cli against this instance litmus cli path points at the binary, and litmus cli environment provides the edge url , edge api client id , and edge api client secret credentials as key=value lines enable datahub read tool exposes a read only datahub read tool that subscribes to a datahub topic and returns live values enable tsdb query tool exposes a read only tsdb query tool that queries historical data from the local time series database tools selects ai suite tool definition files ( json ) a definition targets either a webhook processor in this instance through its hook path , which the processor dispatches in process with no http, or an external endpoint through its url mcp servers selects ai suite mcp server registrations the processor connects over streamable http, discovers each server's tools per event, and exposes them to the model the processor skips an unreachable server with a warning rather than failing the event memory and knowledge graph note memory files are visible and editable on the ai suite page and over ftp, so treat their content as untrusted input, since it is injected into the prompt enable memory gives the model a persistent folder it manages itself with the memory list , memory read , memory write , memory append , memory delete , memory move , and memory search tools the folder is this instance's own subfolder of the ai suite memory section, named by its identifier, so renaming the processor keeps its memory and no two instances share one a memory index is injected into the prompt on every event enable knowledge graph adds a knowledge sync tool that maintains a knowledge graph of the entities the model observes, such as devices, tags, and digital twins, with typed relations and provenance it requires memory leave it off unless the agent surveys the system, because the tool's schema is sent to the model on every request shared memory write and shared memory read share one namespace between agents the single writer maintains the namespace, and every reader lists it as read only output fields the processor adds the following fields to its output value the assistant response text reasoning summary a summary of the reasoning steps, present when advanced reasoning is enabled optional file contents , file name , file id , and container id present when the model produces file output tool activity the list of tool calls executed during the event, present when a local tool ran parameters parameter details name the unique identifier for this instance of the ai responses processor ai model the unique name of the ai model to use ai model instructions the instructions, or system prompt, for the ai model http timeout the maximum time in seconds to wait for a response default is 10 raise it, for example to 120 , when you enable local tools max output tokens the maximum number of tokens the model can generate per response leave empty for the model default max message history the maximum number of messages to keep in the conversation history default is 20 , which is 10 exchanges older messages are dropped when the limit is reached file download timeout the timeout in seconds for downloading files referenced in responses default is 30 advanced thinking / reasoning enables extended thinking mode where the model supports it enable web search allows the model to search the web during generation enable code execution allows the model to run code during generation custom tools a json array of custom tool descriptors appended to the request tools list, for mcp servers and anthropic skill, memory, and bash tools the descriptor shape is vendor specific leave empty for none skills ai suite skill files ( md , txt ) bundled into the prompt on every event, selected by checkmark in the ui leave empty to disable instruction files ai suite instruction files prepended to the prompt on every event as always on guidance, selected by checkmark in the ui leave empty to disable context files ai suite image and pdf files attached as multimodal content blocks, sent inline as base64 leave empty to disable enable litmus cli tool exposes a litmus cli tool that runs the litmus edge sdk cli locally with the arguments the model provides litmus cli path the path to the litmus sdk cli binary default is /ftp data/bin/litmus sdk cli litmus cli environment the environment for the cli, one key=value per line ( edge url , edge api client id , edge api client secret ) lines starting with # are ignored enable datahub read tool exposes a read only datahub read tool that subscribes to a datahub topic and returns live values enable tsdb query tool exposes a read only tsdb query tool that queries historical data from the time series database max tool iterations the maximum number of tool call round trips per event default is 5 tools ai suite tool definition files ( json ) exposed to the model, re read on every event each targets a webhook hook path in this instance or an external url leave empty to disable mcp servers ai suite mcp server registrations whose tools are exposed to the model, selected by checkmark in the ui leave empty to disable enable memory gives the model a persistent memory folder it manages itself with the memory tools, plus a memory index injected into the prompt on every event enable knowledge graph adds a knowledge sync tool that maintains a knowledge graph of observed entities in the memory folder requires memory shared memory write the shared memory namespace this instance writes, which makes it the namespace's only writer leave empty for a private agent shared memory read the shared memory namespaces this instance reads but cannot change, as a json array of names leave empty for none timer interval timer in milliseconds in which to resend the last payload enter 0 to disable this timer pass through value joins the input with the output of the processor