data-pipelines

12 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming…

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you…

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows,…

A system for agentic LLM-powered data processing and ETL

Maestro: Netflix’s Workflow Orchestrator

Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

MLeap: Deploy ML Pipelines to Production

AI agent tooling for data engineering workflows.

🔗 Related families

etl 21 data-engineering 36 elt 7 data 59 dag 10 mlops 103 orchestration 69 workflow-orchestration 11

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.