vision-and-language · GitHub Topics

#计算机科学#LAVIS - A One-stop Library for Language-Vision Intelligence

深度学习 deep-learning-library image-captioning salesforce vision-and-language vision-framework vision-language-pretraining vision-language-transformer visual-question-anwsering multimodal-datasets

Jupyter Notebook10.08 k

1 个月前

awesome-generative-ai-guide

@aishwaryanr

#面试#A one stop repository for generative AI research updates, interview resources, notebooks and much more!

Awesome Lists generative-ai 面试 large-language-models llms notebook-jupyter vision-and-language

9.61 k

12 天前

prismer

NVIDIA Research Projects@NVlabs

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

image-captioning language-model multi-modal-learning multi-task-learning vision-language-model vision-and-language vqa

Python1.3 k

1 年前

xmodaler

@YehLi

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense r...

翻译 - X-modaler 是用于跨模态分析的多功能高性能代码库。

image-captioning video-captioning vision-and-language pretraining cross-modal-retrieval visual-question-answering tden

Python1.03 k

2 年前

ONE-PEACE

@OFA-Sys

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

foundation-models multimodal representation-learning vision-language audio-language vision-and-language vision-transformer contrastive-loss

Python867

1 年前

DoRA

NVIDIA Research Projects@NVlabs

#计算机科学#[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

commonsense-reasoning 深度学习深度神经网络 instruction-tuning large-language-models large-vision-language-models lora parameter-efficient-fine-tuning parameter-efficient-tuning vision-and-language

Python654

3 个月前