multimodality

12 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was…

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any…

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and…

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and…

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding…

(ECCVW 2025)GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

Awesome-LLMs-meet-Multimodal-Generation

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

clip-guided-diffusion

A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.

Towards Generalist Biomedical AI

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction…

🔗 Familias relacionadas

multimodal-large-language-models 44 multimodal-learning 17 vision-language-model 60 aigc 83 mllm 34 multimodal-deep-learning 17 generative-adversarial-networks 11 ai-agents-framework 37

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.