Output Processors
7 min
the analytics module makes use of built in output processors to write the results of statistical functions and kpis to a topic or database the following describes the output processors that are currently available note to add one of these processors to a flow, see add processors and processor connections docid\ v37iaolfgyw 7glazjt1n database output publishes all inputs to a specified database metric configure the following parameters to control where results are published in the database parameters details database if left empty, the default database will be used measurement name of the measurement to publish typed publish typed name note the measurement parameter is a required field datahub publish publishes events from input to a specified datahub topic note you can now publish dynamic topics using the datahub publish function to manage and distribute your data configure the following parameters to control which datahub topic results are published to parameters details single topic select if there is only one topic to export topic topic name for datahub publish file write converts input data to a specified format and writes it to a file the processor can append to the end of the file, replace the existing content, or delete the file if the generate filename from expression option is enabled, the filename is evaluated as an expression for example, to get the filename from the path and name properties of incoming connection aaa , your expression could be aaa path + aaa name + " txt" static text in expressions must be in quotes the timer interval in seconds parameter acts as a "re write file on timer" option, useful if you want to keep generating new file names after every few intervals if output file type is set to value only , the processor saves incoming data from the value payload field as is if output file type is set to csv , the following options affect the output csv comma is the csv file delimiter (only the first character entered is used) csv header controls whether column names are included csv columns from payload controls whether column names are generated from the payload csv custom columns is a comma separated list of column names (overrides csv columns from payload ) if output file type is set to parquet , the output file is rewritten on each incoming payload if write file method is set to append, the last parquet buffer capacity records are written to the file configure the following parameters to control how output is written to a file parameters details file name specifies the name of the file to which data will be written file write method determines how the data will be written to the file (e g , appending, overwriting, delete) output file type defines the format of the output file (e g , json, csv, parquet) add new line indicates whether to append a new line after each entry in the output file create directories option to automatically create any necessary directories if they do not exist generate filename from expression enables dynamic filename generation based on specified expressions time interval in seconds sets a timer for rewriting the file at specified intervals csv comma specifies the delimiter to be used in csv files; only the first character will be applied csv header controls the inclusion or exclusion of column names in the output csv file csv columns from payload determines if column names should be generated based on the incoming payload csv custom columns allows the specification of custom column names, overriding those from the payload parquet capacity defines the buffer size for records in parquet files, influencing how data is written stdout prints incoming data to the console note the output is meant for support logs, not for display on the ui