Processing
This section covers Benthos processors for data transformation and message handling. Processors allow you to modify, filter, and enrich messages as they flow through your data pipelines.
Available Processors
Tag Processor - Optimized for processing tags and time series data, converting them to the UMH data model within the
_historian
data contract. Provides automatic message formatting, metadata generation, and structured processing stages.Downsampler - Reduces time-series data volume by filtering out insignificant changes using configurable algorithms. Integrates with UMH data pipelines to compress historian data while preserving significant trends.
Node-RED JavaScript Processor - Provides full control over payload and metadata through custom JavaScript code. Use this processor when you need complex transformations, conditional logic, or custom processing beyond standard tag handling.
More Processors - Additional built-in processors available in Benthos/Redpanda Connect for various data processing needs.
Which Processor to Choose?
Use Tag Processor when working with structured time series data that needs to conform to the UMH data model
Use Downsampler after tag_processor to reduce data volume while preserving important changes in time-series data
Use Node-RED JavaScript Processor when you need maximum flexibility and custom processing logic
Explore the additional processors for specific use cases like JSON manipulation, HTTP requests, caching, and more
Last updated