Cognite MQTT Extractor

This tool connects to MQTT brokers used in Cognite based data environments, subscribes to selected topics, and collects messages within a defined window or in real time. It decodes payloads using a configurable set of formats such as JSON, CBOR, Protobuf, or plain text, and emits structured records with a timestamp, topic, and decoded payload fields. The initial setup emphasizes repeatable ingestion semantics and schema alignment with Cognite Data Platform, enabling teams to validate field availability before full ingestion. It supports both live streaming and historical replay to compare payload evolution across time.

Core workflow includes mapping rules that translate decoded payload fields into a canonical schema, including type casting, field renaming, and handling missing values. Users can specify required mappings, optional aliases, and data quality checks. Advanced users can apply extraction rules to derive computed fields, perform unit conversions, or normalize time stamps to UTC. The tool can export results to Cognite ingestion endpoints or to flat files for offline analysis.

Benefits include reduced manual parsing, consistent schema across devices, and faster data validation in Cognite workspaces. Typical use cases are industrial telemetry, building automation, and edge gateways publishing telemetry. The tool differentiates itself by native support for multiple payload formats, topic based filtering, and an explicit mapping layer aimed at Cognite schema compatibility, enabling smoother data pipelines and lower integration risk.