This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and Frontiers". As a part of this release we share the information...
Multimodal Sarcasm Detection Dataset
Crowd Sourced Emotional Multimodal Actors Dataset (CREMA-D)
Compose multimodal datasets 🎹
DataComp: In search of the next generation of multimodal datasets
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation
Large-Scale Multimodal Dataset of Astronomical Data
A curated list of AWESOME papers, datasets and tutorials within Multimodal Knowledge Graph.
#计算机科学#Human Emotion Understanding using multimodal dataset.
Preprocessed Datasets for our Multimodal NER paper
A collection of resources on multimodal knowledge graph, including datasets, papers and contests.
#自然语言处理#Multimodal Question Answering in the Medical Domain: A summary of Existing Datasets and Systems
List of datasets, papers, and codes related to multimodal/multisource/multisensor remote sensing classification
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
#自然语言处理#🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
#大语言模型#AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
Medical Multimodal LLMs
#大语言模型#Janus-Series: Unified Multimodal Understanding and Generation Models
✨✨Latest Advances on Multimodal Large Language Models
#计算机科学#Multimodal Unsupervised Image-to-Image Translation
multimodal document analysis
[ACL'19] [PyTorch] Multimodal Transformer