pretraining

19 progetti condividono questo topic GitHub

Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.

🧬 Membri

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

★ 100.1k

Llama-Chinese

★ 14.7k

LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

★ 4.5k

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a…

★ 2.6k

mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

★ 2.5k

HRM-Text

HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and…

★ 1.8k

awesome-self-supervised-gnn

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

★ 1.7k

Entity

EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

★ 1k

Awesome-Robotics-3D

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs,…

★ 819

MARS

The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models

★ 723

MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support…

★ 685

Craw4LLM

Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

★ 660

PITI

PITI: Pretraining is All You Need for Image-to-Image Translation

★ 502

TPA

[NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (https://arxiv.org/abs/2501.06425)

★ 461

bigdetection

BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-training

★ 399

VL-T5

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

★ 372

data_management_LLM

Collection of training data management explorations for large language models

★ 343

ChatPLUG

A Chinese Open-Domain Dialogue System

★ 324

LLMInternSkill

LLMInternSkill: LLM internship resume and job-search Codex Skill for resume polish, JD tailoring, evidence…

★ 256

Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.