Data & Analytics
Data Pipelines
Data integration, ETL, ELT, ingestion, and transformation tools.
Best Data Pipelines tools by public signals
These picks are computed from scored public evidence. Use the openness column in the ranking to separate OSI-approved, source-available, open-core, proprietary, and unverified-license tools.
Use Case Rankings
Ordered by ToolVitals score, health, shipping, confidence, and then adoption as a tie-breaker.
| # | Tool | Health | Shipping | Openness | Stars | Score | Status |
|---|---|---|---|---|---|---|---|
| 01 | Dagster An orchestration platform for the development, production, and observation of data assets. | 100 | 100 | OSI-approved OSS | 15.9k | 100 | Active |
| 02 | dbt dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications. | 100 | 100 | OSI-approved OSS | 13.5k | 100 | Active |
| 03 | CocoIndex Incremental engine for long horizon agents 🌟 Star if you like it! | 95 | 100 | OSI-approved OSS | 11.1k | 98 | Active |
| 04 | MLRun MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications. | 93 | 100 | OSI-approved OSS | 1.7k | 97 | Active |
| 05 | Benthos Data streaming processor with yaml-driven pipeline configuration | 95 | 94 | License unknown | 8.7k | 96 | Active |
| 06 | Unstract LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows | 96 | 89 | OSI-approved OSS | 7k | 95 | Active |
| 07 | Apache Airflow Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | 93 | 95 | OSI-approved OSS | 46.3k | 95 | Active |
| 08 | CloudQuery Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources. | 87 | 95 | OSI-approved OSS | 6.5k | 93 | Active |
| 09 | Apache DevLake Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth. | 92 | 78 | OSI-approved OSS | 3.1k | 90 | Active |
| 10 | PRQL PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement | 80 | 78 | OSI-approved OSS | 10.9k | 85 | Active |
| 11 | Pathway Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. | 78 | 77 | License unknown | 62.6k | 83 | Active |
| 12 | Airbyte The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. | 78 | 69 | License unknown | 21.7k | 79 | Active |
| 13 | Multiwoven Open-source reverse ETL and customer data sync platform. | 79 | 49 | OSI-approved OSS | 1.7k | 73 | Warning |
| 14 | Arroyo Distributed stream processing engine in Rust | 69 | 41 | OSI-approved OSS | 5k | 66 | Warning |
| 15 | Mage 🧙 Build, run, and manage data pipelines for integrating and transforming data. | 71 | 21 | OSI-approved OSS | 8.8k | 63 | Warning |
| 16 | dbmazz CDC, radically simplified. One Rust binary for source-to-target data movement. | 59 | 30 | License unknown | 14 | 59 | Warning |
| 17 | SyncMaven Open-source reverse-ETL and data activation platform. | 31 | 0 | License unknown | 22 | 36 | Critical |
| 18 | cptn.io Open-source platform for building and deploying integrations and data pipelines. | 33 | 0 | OSI-approved OSS | 493 | 35 | Critical |
| 19 | Ploomber The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️ | 18 | 0 | OSI-approved OSS | 3.6k | 31 | Critical |
| 20 | Grouparoo Data synchronization framework | 28 | 0 | OSI-approved OSS | 778 | 29 | Critical |
Evidence Watch
Tracked tools with useful public signals but no verdict score yet.
aisheets
Build, enrich, and transform datasets using AI models with no code
97 confidenceAltimate Code
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses.
100 confidenceAtroCore
Open-source data management and system integration platform.
90 confidenceAutomate DV
dbt package for creating and loading Data Vault 2.0 compliant data warehouses.
81 confidenceBruin
Data pipeline platform with SQL, Python, and quality checks.
95 confidenceCastled
Data synchronization framework focused on external apps
36 confidenceDebezium
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
99 confidenceDocETL
Agentic LLM-powered data processing and ETL.
94 confidenceDocumind
Open-source platform for extracting structured data from documents using AI.
88 confidenceFeldera
Incremental computation engine.
100 confidenceHPCC Systems
Open-source distributed data processing and analytics platform for large-scale data workflows.
94 confidenceHRFlow
🚀 Open source python repository of HR data Connectors.
100 confidenceJitsu
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
100 confidenceMeltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
100 confidenceNeosync
Open Source Data Security Platform for Developers to Monitor and Detect PII, Anonymize Production Data and Sync it across environments.
88 confidenceOpen Wearables
Self-hosted platform to unify wearable health data through one AI-ready API.
98 confidenceOrchest
No-code data pipelines builder and orchestration platform.
74 confidencePixeltable
Data Infrastructure providing a declarative, incremental approach for multimodal AI workloads.
100 confidenceqData
Open-source all-in-one data middle platform.
80 confidenceRudderStack
Privacy and Security focused Segment-alternative, in Golang and React
100 confidenceSail
Drop-in Apache Spark replacement written in Rust for batch and streaming workloads.
99 confidenceSeldon
Deployment & monitoring for machine learning at scale
74 confidencetexera
Collaborative Machine-Learning-Centric Data Analytics Using Workflows
97 confidence