Best Data Pipelines tools by public signals

These picks are computed from scored public evidence. Use the openness column in the ranking to separate OSI-approved, source-available, open-core, proprietary, and unverified-license tools.

Use Case Rankings

Ordered by ToolVitals score, health, shipping, confidence, and then adoption as a tie-breaker.

#ToolHealthShippingOpennessStarsScoreStatus
01Dagster
An orchestration platform for the development, production, and observation of data assets.
100100OSI-approved OSS15.9k100Active
02dbt
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
100100OSI-approved OSS13.5k100Active
03CocoIndex
Incremental engine for long horizon agents 🌟 Star if you like it!
95100OSI-approved OSS11.1k98Active
04MLRun
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
93100OSI-approved OSS1.7k97Active
05Benthos
Data streaming processor with yaml-driven pipeline configuration
9594License unknown8.7k96Active
06Unstract
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
9689OSI-approved OSS7k95Active
07Apache Airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
9395OSI-approved OSS46.3k95Active
08CloudQuery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
8795OSI-approved OSS6.5k93Active
09Apache DevLake
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
9278OSI-approved OSS3.1k90Active
10PRQL
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
8078OSI-approved OSS10.9k85Active
11Pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
7877License unknown62.6k83Active
12Airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
7869License unknown21.7k79Active
13Multiwoven
Open-source reverse ETL and customer data sync platform.
7949OSI-approved OSS1.7k73Warning
14Arroyo
Distributed stream processing engine in Rust
6941OSI-approved OSS5k66Warning
15Mage
🧙 Build, run, and manage data pipelines for integrating and transforming data.
7121OSI-approved OSS8.8k63Warning
16dbmazz
CDC, radically simplified. One Rust binary for source-to-target data movement.
5930License unknown1459Warning
17SyncMaven
Open-source reverse-ETL and data activation platform.
310License unknown2236Critical
18cptn.io
Open-source platform for building and deploying integrations and data pipelines.
330OSI-approved OSS49335Critical
19Ploomber
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
180OSI-approved OSS3.6k31Critical
20Grouparoo
Data synchronization framework
280OSI-approved OSS77829Critical

Evidence Watch

Tracked tools with useful public signals but no verdict score yet.

aisheets

Build, enrich, and transform datasets using AI models with no code

97 confidence

Altimate Code

Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses.

100 confidence

AtroCore

Open-source data management and system integration platform.

90 confidence

Automate DV

dbt package for creating and loading Data Vault 2.0 compliant data warehouses.

81 confidence

Bruin

Data pipeline platform with SQL, Python, and quality checks.

95 confidence

Castled

Data synchronization framework focused on external apps

36 confidence

Debezium

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

99 confidence

DocETL

Agentic LLM-powered data processing and ETL.

94 confidence

Documind

Open-source platform for extracting structured data from documents using AI.

88 confidence

Feldera

Incremental computation engine.

100 confidence

HPCC Systems

Open-source distributed data processing and analytics platform for large-scale data workflows.

94 confidence

HRFlow

🚀 Open source python repository of HR data Connectors.

100 confidence

Jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

100 confidence

Meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

100 confidence

Neosync

Open Source Data Security Platform for Developers to Monitor and Detect PII, Anonymize Production Data and Sync it across environments.

88 confidence

Open Wearables

Self-hosted platform to unify wearable health data through one AI-ready API.

98 confidence

Orchest

No-code data pipelines builder and orchestration platform.

74 confidence

Pixeltable

Data Infrastructure providing a declarative, incremental approach for multimodal AI workloads.

100 confidence

qData

Open-source all-in-one data middle platform.

80 confidence

RudderStack

Privacy and Security focused Segment-alternative, in Golang and React

100 confidence

Sail

Drop-in Apache Spark replacement written in Rust for batch and streaming workloads.

99 confidence

Seldon

Deployment & monitoring for machine learning at scale

74 confidence

texera

Collaborative Machine-Learning-Centric Data Analytics Using Workflows

97 confidence