AirWorks Data Intelligence Platform: Architecture, Cloud‑Native Ingestion, and Financial Asset Management Use Case

Data middle platforms are the core of Entropy Simplify's data intelligence business, aiming to break data silos and accelerate business iteration by turning operations into data assets.

The platform follows a three‑layer architecture: a data layer that aggregates heterogeneous sources (macro, alternative, news), a middle‑platform layer comprising data, algorithm, and knowledge hubs, and an application layer delivering search, monitoring, and knowledge‑management services.

Data ingestion is built on a cloud‑native stack using Kafka as the message backbone and Kubernetes for container orchestration. The system is split into four modules—user console, collection engine, storage service, and monitoring/authentication—enabling micro‑service isolation, dynamic scaling, and robust monitoring across infrastructure, component, and data layers.

AirWorks, the low‑code visual ETL platform, provides data source integration, development & operations, asset management, and data services. It abstracts underlying engines (Spark, Python, R, TensorFlow) so users can configure workflows without worrying about resources, and it supports both batch and real‑time processing.

Key technical features include multi‑engine cooperation, multi‑tenant management, Alluxio‑based in‑memory acceleration, OLAP‑style exact and approximate calculations, and sophisticated data‑skew mitigation through sampling and automatic partitioning.

A practical case demonstrates how a leading listed company and brokerage built a financial asset‑management data middle platform on AirWorks, creating a layered data warehouse, unified API services, and a knowledge graph that streamlines research workflows, automates report generation, and enables sentiment analysis of e‑commerce data.

The overall solution delivers an end‑to‑end data‑chain service, offering a one‑stop, cloud‑native, low‑code experience for financial institutions seeking to modernize their data infrastructure.