qwen2-vl · GitHub Topics

#大语言模型#Use PEFT or Full-parameter to finetune 450+ LLMs (Qwen2.5, InternLM3, GLM4, Llama3.3, Mistral, Yi1.5, Baichuan2, DeepSeek-R1, ...) and 150+ MLLMs (Qwen2.5-VL, Qwen2-Audio, Llama3.2-Vision, Llava, Inte...

agent 大语言模型 lora llama sft deploy multimodal peft internvl liger qwen2-vl llama3-3 qwen2-5 distill rft deepseek-r1 embedding grpo open-r1

Python 6.21 k

10 小时前

roboflow / maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

captioning fine-tuning florence-2 multimodal objectdetection paligemma phi-3-vision transformers vision-and-language vqa qwen2-vl

Python 2.43 k

1 天前

PaddlePaddle / PaddleMIX

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high per...

aigc stable-diffusion clip image-to-text text-to-image controlnet multimodal text-to-video dit llava sora qwen2-vl minicpm-v

Python 526

3 天前

2U1 / Qwen2-VL-Finetune

An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.

聊天机器人 multimodal qwen2-vl vision-language vision-language-model qwen2-5

Python 405

8 天前

NetEase-Media / grps_trtllm

#大语言模型#Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, d...

大语言模型 openai tensorrt-llm chatglm llama3 qwen2 function-call ai-agent llama-index multi-modal deepseek-r1 phi qwen2-vl

C++ 114

3 天前

arcstep / illufly

#大语言模型#✨🦋 illufly 是自我进化的 Agent 框架: 基于自我进化，快速创造价值

agent 人工智能 glm-4 gpt 大语言模型 multiagent openai qwen qwen2 qwen2-vl rag growth

Python 57

6 天前

drive-bench / toolkit

#大语言模型#Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectives

autonomous-driving ChatGPT internvl qwen2-vl

Python 53

19 天前

soulteary / dify-with-qwen-vl

视频理解：千问视频多模态模型 & Dify

dify qwen2 qwen2-vl

Python 41

6 个月前

fireicewolf / wd-llm-caption-cli

A Python base cli tool for caption images with WD series, Joy-caption-pre-alpha,meta Llama 3.2 Vision Instruct and Qwen2 VL Instruct models.

qwen2-vl florence-2

Python 33

1 个月前

ZachcZhang / Qwen2-VL-inference

An open-source server implementation for inference Qwen2-VL series model using fastapi.

FastAPI huggingface inference mllm qwen2-vl

Python 8

4 个月前

shaadclt / Qwen2-VL-OCR-VQA

This project demonstrates how to use the Qwen2-VL model from Hugging Face for Optical Character Recognition (OCR) and Visual Question Answering (VQA). The model combines vision and language capabiliti...

optical-character-recognition qwen2-vl visual-question-answering

Jupyter Notebook 8

5 个月前

Kazuhito00 / Qwen2-VL-Colaboratory-Sample

Colaboratory上でQwenLM/Qwen2-VLをお試しするサンプル

colaboratory Python qwen2-vl vlm

Jupyter Notebook 7

6 个月前

BUAADreamer / Qwen2-VL-History

Qwen2-VL在文旅领域的LLaMA-Factory微调案例 The case for fine-tuning Qwen2-VL in the field of historical literature and museums

history mllm multimodal-large-language-models qwen2-vl

6 个月前

Valdanitooooo / chat_with_qwen2_vl_test

qwen2-vl

Python 6

2 个月前

see2023 / autoXHS

#网络爬虫#基于多模态大模型的智能搜索助手，通过AI技术实现小红书平台的智能化信息检索和知识整合

大语言模型 qwen2-vl Selenium xiaohongshu spider

Python 6

4 个月前

janelu9 / EasyLLM

#大语言模型#Running Large Language Model easily.

deepspeed 大语言模型 qwen2-vl fine-tuning llama3 pretrain vlm

Jupyter Notebook 6

6 天前

aws-samples / multi-modal-examples-for-amazon-sagemaker

#大语言模型#A workshop for collections of multi-modal LLM examples, samples, reference architecture and demos on Amazon SageMaker.

大语言模型 multi-modality qwen2-vl sagemaker vllm

Jupyter Notebook 4

3 个月前

Pavansomisetty21 / Qwen2-Vision-Finetuning-Unsloth---Maths-OCR-Formulae-Extraction-

#大语言模型#we finetune unsloth llama model to extract mathematical fomulas in the images with optical character recognition(OCR)

qwen2 llama 大语言模型 maths OCR ocr-recognition optical-character-recognition qwen2-vl unsloth vision-language-model vlm

Jupyter Notebook 2

2 个月前

Yatish54321 / Flipkart_Grid_6.0_Robotics_level2_model

"Smart Vision Technology for Quality Control" uses computer vision to automate product inspections, extracting details like product name, quantity, expiry date, and freshness from images. Built for Fl...

genai huggingface-transformers qwen2-vl

Jupyter Notebook 1

3 个月前

HemantM29 / Multimodal-Document-Analysis-and-Query-Retrieval

This project performs multimodal document analysis and query retrieval by downloading PDFs, converting pages to images, indexing them for semantic search, and analyzing retrieved images using visual-l...

blip2 pdf-processing qwen2-vl retrieval-augmented-generation semantic-search transformers visual-language-models

Jupyter Notebook 1

2 个月前