Data Engineering

23 tools

The pipelines and platforms that move, transform, and govern data at scale: processing engines like Apache Spark, Kafka, and dbt, ingestion tools like Airbyte and Fivetran, lakehouse formats like Iceberg and Delta Lake, data catalogs, and synthetic data generators like Gretel AI. They feed the training corpora, fine-tuning sets, and RAG knowledge bases everything else depends on. AI-specific labeling lives in AI Data & Human Feedback.

Solid: curated by our editors.
Dashed: added by makers, not reviewed yet.
Seal: Verified maker.

No community tools here yet. Show all

Built something for Data Engineering? Submit it and it appears here with a dashed edge. When an editor adds it to the map, it gets the solid one.

Submit a tool

Questions

How many Data Engineering tools are there?

The map has 23 tools in Data Engineering, sorted into 5 sub-lines: Data Processing, Ingestion & Integration, Data Lakehouse, Data Catalog and Synthetic Data.

How does AI Landscape rank Data Engineering?

By use, not votes: each member who marks a tool "I use this" counts once. Until enough members have marked them, the list here goes by sub-line and name. Editors place curated tools on the map; makers can submit their own, which appear with a dashed edge until reviewed.