vision-language-model

47 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. …

★ 10.2k

Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by…

★ 6.7k

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

★ 5.7k

align-anything

Align Anything: Training All-modality Model with Feedback

★ 4.7k

lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

★ 4.5k

MiniMax-01

The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on…

★ 3.5k

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

★ 3.3k

VLM_survey

Collection of AWESOME vision-language models for vision tasks

★ 3.1k

OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs,…

★ 3k

InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio…

★ 2.9k

Cradle

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any…

★ 2.6k

Awesome-LLM4AD

A curated list of awesome LLM/VLM/VLA/World Model for Autonomous Driving(LLM4AD) resources (continually…

★ 1.9k

video-search-and-summarization

NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for…

★ 1.8k

vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX,…

★ 1.6k

thepipe

Get clean data from tricky documents, powered by vision-language models ⚡

★ 1.5k

mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR…

★ 1.5k

awesome-japanese-llm

日本語LLMまとめ - Overview of Japanese LLMs

★ 1.4k

agent-vision-toolkit

★ 1.3k

Chat-UniVi

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image…

★ 945

VoxPoser

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

★ 837

MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

★ 798 · GitHub ↗

doc7

Turn documents into AI-ready Markdown with visual understanding

★ 717

OmniVinci

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

★ 685

t2v_metrics

Evaluating text-to-image/video/3D models with VQAScore

★ 600

Groma

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

★ 587

LLaVA-Mini

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images,…

★ 573

Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models…

★ 566

Senna

Bridging Large Vision-Language Models and End-to-End Autonomous Driving

★ 551

awesome-knowledge-driven-AD

A curated list of awesome knowledge-driven autonomous driving (continually updated)

★ 500

RoboFlamingo

Code for RoboFlamingo

★ 437

InternVLA-M1

InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy

★ 418

Stream-Omni

Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across…

★ 391

Awesome-Multimodal-LLM-Autonomous-Driving

[WACV 2024 Survey Paper] Multimodal Large Language Models for Autonomous Driving

★ 311

Thinking-with-Visual-Primitives

Archived snapshot of Thinking-with-Visual-Primitives

★ 279

GRACE

[ICML 2026] GRACE: deployable INT4 VLM via quantization-aware distillation.

★ 212

OneJev

🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about…

★ 198 · GitHub ↗

AesCode

Aesthetic code generation with decoupled cross-modal rewards: turning prompts into editable, verifiable…

★ 187 · GitHub ↗

ICLR2026-Guide-CN

不想啃 5000+ 全文？我已经替你和 LLM 啃完了 — ICLR 2026 全景中文导读

★ 182

MOSS-Video-Preview

An 11B model for real-time video understanding with gated cross-attention and streaming inference

★ 172 · GitHub ↗

NEWTON

NEWTON: Agentic Planning for Physically Grounded Video Generation

★ 139

VLMForge

Evaluate visual models on your own images, JSON Schema, and production constraints with LangGraph, Pareto…

★ 102

Awesome-AVI

Awesome Audio-Visual Intelligence, Survey of Audio-Visual Intelligence

★ 93

OmniAgent

OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that…

★ 81

ThinkJEPA

[NeurIPS 2026] ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model

★ 60

PlayJev

🚀🚀 A 0.8B JEV-like multimodal model playing GUI games directly from raw pixels.

★ 60 · GitHub ↗

neo-unify

Toy-scale unified multimodal model experiments — encoder-free understanding & generation with…

★ 51

visbridge-mcp

A token-efficient, provider-agnostic vision layer for reasoning models via MCP.

★ 44 · GitHub ↗

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.