multi-modality

8 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural…

InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio…

Parsing-free RAG supported by VLMs

Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)

Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models…

[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

[CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human…

🔗 Related families

instruction-tuning 28 gpt-4 119 vision-language-model 41 chain-of-thought 29 in-context-learning 17 instruction-following 12 large-vision-language-models 11 multimodal-large-language-models 36

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.