large-multimodal-models

11 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

awesome-vlm-architectures

Curated visual catalog of 155+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training…

[NeurIPS 2024] An official implementation of "ShareGPT4Video: Improving Video Understanding and Generation…

TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models

awesome-multimodal-in-medical-imaging

A collection of resources on applications of multi-modal learning in medical imaging.

LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding…

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images,…

[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust…

Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across…

Open Platform for Embodied Agents

Awesome-Multimodal-Papers

A curated list of awesome Multimodal studies.

🔗 Familias relacionadas

multimodal-large-language-models 36 foundation-models 58 llava 11 multimodal-deep-learning 7 multimodal-learning 6 visual-question-answering 4 question-answering 18 vision 22

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.