data-pipelines
10 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
★ 62.1k
dagster
An orchestration platform for the development, production, and observation of data assets.
★ 16.3k
unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming…
★ 15.6k
kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you…
★ 10.9k
DataFlow
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
★ 8.3k
preswald
Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows,…
★ 4.3k
docetl
A system for agentic LLM-powered data processing and ETL
★ 4.1k
extractous
Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
★ 1.8k
mleap
MLeap: Deploy ML Pipelines to Production
★ 1.5k
agents
AI agent tooling for data engineering workflows.
★ 430
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.