data-engineering

36 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

Made-With-ML

Learn how to develop, deploy and iterate on production-grade ML applications.

★ 48.9k

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

★ 46.3k

applied-ml

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

★ 30k

kestra

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

★ 27.5k

airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses,…

★ 21.7k

argo-workflows

Workflow Engine for Kubernetes

★ 16.9k

cocoindex

Incremental engine for long horizon agents 🌟 Star if you like it!

★ 11.1k

mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

★ 8.8k

feast

The Open Source Feature Store for AI/ML

★ 7.2k

unstract

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

★ 7k

Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured…

★ 5.7k

DeepAnalyze

★ 4.4k

sql-translator

SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence.…

★ 4.3k

Data-Science-Roadmap

Data Science Roadmap from A to Z

★ 4.3k

maestro

Maestro: Netflix’s Workflow Orchestrator

★ 3.8k

qsv

Blazing-fast Data-Wrangling toolkit

★ 3.7k

AI-Engineer-Headquarters

A collection of scientific methods, processes, algorithms, and systems to build stories & models.

★ 3.7k

mlops-course

Learn how to design, develop, deploy and iterate on production-grade ML applications.

★ 3.4k

sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and…

★ 3.2k

second-brain-ai-assistant-course

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems…

★ 2.9k

hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows,…

★ 2.6k

metarank

A low code Machine Learning personalized ranking service for articles, listings, search results,…

★ 2.4k

SAG

A new SOTA for RAG — an original retrieval architecture and an open-source knowledge base for humans and…

★ 2.3k

bytewax

Python Stream Processing

★ 2k

feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise

★ 1.9k

mlrun

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across…

★ 1.7k

yt-channels-DS-AI-ML-CS

A comprehensive list of 180+ YouTube Channels for Data Science, Data Engineering, Machine Learning, Deep…

★ 1.6k

ktx

ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Codex, or other AI…

★ 1.5k

semantica

Graph-Native Infrastructure for Context and Accountable AI Systems

★ 1.4k

duckle

Open-source ETL/ELT on DuckDB. Write, wire, or draw one pipeline: 350+ components, 160+ connectors, dbt, CDC,…

★ 885

active_workflow

Polyglot workflows without leaving the comfort of your technology stack.

★ 866

NeumAI

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large…

★ 865

Failed-ML

Compilation of high-profile real-world examples of failed machine learning projects

★ 753

agents

AI agent tooling for data engineering workflows.

★ 413

Comprehensive-Data-Science-AI-Project-Portfolio

A curated collection of AI, data engineering, and DevOps projects featuring real-world applications, advanced…

★ 336

extractor

Use LLMs to robustly extract web data

★ 319

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.