data-processing

14 projets partagent ce topic GitHub

Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.

🧬 Membres

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Incremental engine for long horizon agents 🌟 Star if you like it!

Easy Data Preparation with latest LLMs-based Operators and Pipelines.

rocketride-server

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale…

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data…

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

Large-scale pretraining for dialogue

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part…

Python Stream Processing

Scalable data pre processing and curation toolkit for LLMs

Data and tools for generating and inspecting OLMo pre-training data.

Machine-Learning-Notebooks

Machine Learning notebooks for refreshing concepts.

Production-ready data processing made easy and shareable

🔗 Familles voisines

data 53 data-pipelines 10 dataflow 4 etl 13 real-time 37 data-engineering 28 data-pipeline 10 foundation-models 58

Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.