large-multimodal-models

11 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

awesome-vlm-architectures

Curated visual catalog of 155+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training…

[NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation…

TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding…

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images,…

[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust…

Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across…

Open Platform for Embodied Agents

Awesome-Multimodal-Papers

A curated list of awesome Multimodal studies.

🔗 Related families

multimodal-large-language-models 36 foundation-models 58 llava 11 multimodal-deep-learning 7 multimodal-learning 6 visual-question-answering 4 question-answering 18 vision 22

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.