vision-and-language · GitHub Topics

#计算机科学# LAVIS - A One-stop Library for Language-Vision Intelligence

deep-learning deep-learning-library image-captioning salesforce vision-and-language vision-framework vision-language-pretraining vision-language-transformer visual-question-anwsering multimodal-datasets

Jupyter Notebook9.96 k

4 天前

awesome-generative-ai-guide

@aishwaryanr

#面试# A one stop repository for generative AI research updates, interview resources, notebooks and much more!

awesome awesome-list generative-ai interview-questions large-language-models llms notebook-jupyter vision-and-language

9.28 k

17 天前

prismer

NVIDIA Research Projects@NVlabs

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

image-captioning language-model multi-modal-learning multi-task-learning vision-language-model vision-and-language vqa

Python1.3 k

10 个月前

xmodaler

@YehLi

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense r...

翻译 - X-modaler 是用于跨模态分析的多功能高性能代码库。

image-captioning video-captioning vision-and-language pretraining cross-modal-retrieval visual-question-answering tden

Python1.03 k

2 年前

ONE-PEACE

@OFA-Sys

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

foundation-models multimodal representation-learning vision-language audio-language vision-and-language vision-transformer contrastive-loss

Python867

1 年前

DoRA

NVIDIA Research Projects@NVlabs

#计算机科学# [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

commonsense-reasoning deep-learning deep-neural-networks instruction-tuning large-language-models large-vision-language-models lora parameter-efficient-fine-tuning parameter-efficient-tuning vision-and-language

Python634

2 个月前