data-pipeline
11 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses,…
★ 21.7k
data-juicer
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
★ 6.8k
rocketride-server
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale…
★ 5.4k
dagu
Local-first workflow engine for ops automation and AI-assisted operations. Open source and self-hostable:…
★ 3.7k
whylogs
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility…
★ 2.8k
sie
Open-source inference server and production cluster for all the models your agent needs.
★ 2.4k
duckle
Open-source ETL/ELT on DuckDB. Write, wire, or draw one pipeline: 350+ components, 160+ connectors, dbt, CDC,…
★ 885
augraphy
Augmentation pipeline for rendering synthetic paper printing, faxing, scanning and copy machine processes
★ 560
genblaze
Genblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio,…
★ 488
DataMate
DataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.
★ 364
extractor
Use LLMs to robustly extract web data
★ 319
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.