A pytorch-based deep learning framework for multi-modal 2D/3D medical image segmentation
Papers, code and datasets about deep learning and multi-modal learning for video analysis
Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.
A curated list of Multi-Modal Reinforcement Learning resources (continually updated)
Learning multi-domain multi-modality I2I translation
[CVPR 2023] Official repository of paper titled "MaPLe: Multi-modal Prompt Learning".
A collection of resources on applications of multi-modal learning in medical imaging.
Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey
FAIR Self-Supervised Learning Integrated Multi-modal Environment (SSLIME)
Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain
翻译 - Pytorch的官方实施“ OmniNet：用于多模式多任务学习的统一体系结构”作者：Subhojeet Pramanik，Priyanka Agrawal，Aman Hussain
AMC: Attention guided Multi-modal Correlation Learning for Image Search
Multi-Modal Learning from Unpaired Images: Application to Multi-Organ Segmentation in CT and MRI.
Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANs (CVPR 2019)
MultiMAE: Multi-modal Multi-task Masked Autoencoders, ECCV 2022
A Modular and Multi-Modal Mapping Framework
翻译 - 一个开放的视觉惯性映射框架。
An open source multi-modal trip planner
M5Product: Self-harmonized Contrastive Learning for E-commercial Multi-modal Pretraining CVPR 2022
M2DGR： a Multi-modal and Multi-scenario Dataset for Ground Robots(RA-L2021 & ICRA2022)
Multi-Modal Mutual Information (MuMMI) Training for Robust Self-Supervised Deep Reinforcement Learning
Tensorflow implementation of our paper: Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning
The TypeScript library for building multi-modal AI applications.