lmm · GitHub Topics

#大语言模型#The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, ...

ai-agent ai-agents-framework computer-control cradle gcc generative-ai grounding large-language-models 大语言模型 lmm multimodality vision-language-model vlm 人工智能

Python 2.02 k

4 个月前

mbzuai-oryx / groundingLMM

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

foundation-models lmm vision-and-language vision-language-model llm-agent

Python 845

4 个月前

NVlabs / EAGLE

#大语言模型#Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs

Demo gpt4 huggingface llama llama3 llava lmm mllm 大语言模型 large-language-models

Python 617

1 个月前

LLaVA-VL / LLaVA-Interactive-Demo

LLaVA-Interactive-Demo

lmm multimodal

Python 365

8 个月前

tianyi-lab / HallusionBench

#大语言模型#[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

benchmark gpt-4 gpt-4v llava benchmarks hallucination 大语言模型 lmm large-language-models large-vision-language-models

Python 270

4 个月前

mbzuai-oryx / Video-LLaVA

#大语言模型#PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

大语言模型 lmm Video grounding transcription

Python 255

1 年前

CircleRadon / TokenPacker

The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".

connector lmm mllm

Python 237

3 个月前

TIGER-AI-Lab / Mantis

Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]

language vision lmm mllm Video vlm multimodal

Python 207

8 天前

TideDra / VL-RLHF

#大语言模型#A RLHF Infrastructure for Vision-Language Models

dpo 大语言模型 lmm mllm rlhf vlm

Python 163

4 个月前

xieyuquanxx / awesome-Large-MultiModal-Hallucination

😎 curated list of awesome LMM hallucinations papers, methods & resources.

hallucination multi-modal lmm multimodal

148

1 年前

Q-Future / A-Bench

[ICLR 2025] What do we expect from LMMs as AIGI evaluators and how do they perform?

evaluation lmm

142

1 个月前

graphic-design-ai / graphist

#大语言模型#Official Repo of Graphist

graphic-design 大语言模型 lmm mllm

112

1 年前

MLLM-Tool / MLLM-Tool

#大语言模型#MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning

gpt4 大语言模型 lmm

Python 109

10 个月前

WisconsinAIVision / YoLLaVA

#大语言模型#🌋👵🏻 Yo'LLaVA: Your Personalized Language and Vision Assistant

llava 大语言模型 llms lmm lmms personalization neurips

Python 81

4 个月前

mapluisch / LLaVA-CLI-with-multiple-images

LLaVA inference with multiple images at once for cross-image analysis.

图像处理 inference llama2 llava Python lmm lmms pillow PyTorch visual-question-answering vqa

Python 48

1 年前

mbzuai-oryx / VideoGLaMM

[CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

foundation-models llm-agent lmm vision-and-language vision-language-model

Python 45

9 天前

yisuanwang / Idea23D

[COLING 2025] Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs

3D aigc agent lmm

Jupyter Notebook 45

2 个月前

Javis603 / Discord-AIBot

#大语言模型#🤖 Discord AI assistant with OpenAI, Gemini, Claude & DeepSeek integration, multilingual support, multimodal chat, image generation, web search, and deep thinking | 一个强大的 Discord AI 助手，整合多种顶级 AI 模型，支持...