multimodal-learning · GitHub Topics

open_flamingo

@mlfoundations

#计算机科学#An open-source framework for training large multimodal models.

机器视觉深度学习 in-context-learning language-model multimodal-learning PyTorch flamingo

Python3.78 k

4 个月前

Awesome-Multimodal-Research

@Eurus-Holmes

A curated list of Multimodal Related Research.

翻译 - 精选的多模式相关研究清单。

Awesome Lists multimodal-research multimodal-learning multimodal

Python1.33 k

1 年前

UniRepLKNet

@AILab-CVC

#计算机科学#[CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

architecture artificial-intelligence convolutional-neural-networks 深度学习 multimodal-learning

Python885

1 年前

OMML

@njustkmg

Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.

multimodal multimodal-learning Python paddlepaddle PyTorch crossmodal-retrieval imagecaptioning classification

Python565

2 年前🇨🇳

OmniNet

@subho406

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

翻译 - Pytorch的官方实施“ OmniNet：用于多模式多任务学习的统一体系结构”作者：Subhojeet Pramanik，Priyanka Agrawal，Aman Hussain

image-captioning multitask-learning multimodal-learning

Python515

4 年前