multimodal-learning · GitHub Topics

open_flamingo

@mlfoundations

#计算机科学# An open-source framework for training large multimodal models.

computer-vision deep-learning in-context-learning language-model multimodal-learning pytorch flamingo

Python3.75 k

3 个月前

Awesome-Multimodal-Research

@Eurus-Holmes

A curated list of Multimodal Related Research.

翻译 - 精选的多模式相关研究清单。

awesome multimodal-research multimodal-learning multimodal

Python1.31 k

1 年前

UniRepLKNet

@AILab-CVC

#计算机科学# [CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

architecture artificial-intelligence convolutional-neural-networks deep-learning multimodal-learning

Python885

1 年前

OMML

@njustkmg

Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.

multimodal multimodal-learning python paddlepaddle pytorch crossmodal-retrieval imagecaptioning classification

Python564

2 年前🇨🇳

OmniNet

@subho406

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

翻译 - Pytorch的官方实施“ OmniNet：用于多模式多任务学习的统一体系结构”作者：Subhojeet Pramanik，Priyanka Agrawal，Aman Hussain

image-captioning multitask-learning multimodal-learning

Python512

4 年前