lmm

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

LLaVA-Interactive-Demo

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025

PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024 Best Paper]

🤖 Discord AI assistant with OpenAI, Gemini, Claude & DeepSeek integration, multilingual support, multimodal chat, image generation, web search, and deep thinking

A RLHF Infrastructure for Vision-Language Models

😎 curated list of awesome LMM hallucinations papers, methods & resources.

MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning

Official Repo of Graphist

🌋👵🏻 Yo'LLaVA: Your Personalized Language and Vision Assistant (NeurIPS 2024)

[ICLR 2025] What do we expect from LMMs as AIGI evaluators and how do they perform?

[CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

[ICLR'26] Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodology

GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI.

[ICCV'25] Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awareness

Make Large Multimodal Models excel in object detection, ICCV 2025