multimodality

12 proyectos comparten este topic de GitHub

Las líneas conectan a los miembros que están mediblemente relacionados entre sí. El tamaño de los puntos refleja las estrellas.

🧬 Miembros

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was…

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any…

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and…

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and…

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding…

(ECCVW 2025)GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

Awesome-LLMs-meet-Multimodal-Generation

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

clip-guided-diffusion

A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.

Towards Generalist Biomedical AI

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction…

🔗 Familias relacionadas

multimodal-large-language-models 44 multimodal-learning 17 vision-language-model 60 aigc 83 mllm 34 multimodal-deep-learning 17 generative-adversarial-networks 11 ai-agents-framework 37

Medido a partir de los temas de GitHub compartidos por ambos proyectos, ponderado por cuán raros son cada uno de los temas.