long-context

11 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

Helios: Real Real-Time Long Video Generation Model

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

LLM KV cache compression made easy

Large Context Attention

MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

recurrent-memory-transformer-pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long…

Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens":…

🔗 Related families

fine-tuning-llm 5 attention-mechanisms 20 chinese 70 flash-attention 5 large-language-model 46 rlhf 42 lora 65 diffusion 80

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.