cross-modal-learning · GitHub Topics

#计算机科学#[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

cross-modal-learning cross-modality 深度学习 language-model large-language-models 机器学习 multimodal-deep-learning multimodal-time-series prompt-tuning time-series time-series-analysis time-series-forecasting

Python 1.8 k

4 个月前

MohamedAfham / CrossPoint

#计算机科学#Official implementation of "CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding" (CVPR, 2022)

self-supervised-learning Point cloud cross-modal-learning transfer-learning unsupervised-learning few-shot-learning 深度学习

Python 249

2 年前

whwu95 / Cap4Video

【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?

cross-modal-learning video-understanding

Python 231

3 个月前

whwu95 / Text4Vis

【AAAI'2023 & IJCV】Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective

cross-modal-learning transfer-learning video-recognition video-understanding action-recognition

Python 192

9 个月前

whwu95 / BIKE

【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models

action-recognition cross-modal-learning video-recognition video-understanding

Python 147

6 个月前

choyingw / Cross-Modal-Perceptionist

#计算机科学#CVPR 2022: Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?

3D PyTorch 3dmm biometrics 深度学习机器学习 cross-modal-learning 机器视觉 speech-synthesis speech cvpr cvpr2022

Python 129

3 个月前

Toytiny / CMFlow

#计算机科学#[CVPR 2023 Highlight 💡] Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervision

autonomous-driving cross-modal-learning 深度学习 optical-flow

Python 122

2 年前

RunpeiDong / ACT

[ICLR 2023] Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?

Point cloud cross-modal-learning representation-learning self-supervised-learning

Python 103

8 个月前

mako443 / Text2Pos-CVPR2022

#自然语言处理#Code, dataset and models for our CVPR 2022 publication "Text2Pos"

PyTorch 深度学习 Localization (l10n)自然语言处理 language-processing cross-modal cross-modal-retrieval cross-modal-learning 机器视觉 cvpr cvpr2022

Python 43

3 年前

knightyxp / DGL

[AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.

cross-modal-learning cross-modal-retrieval parameter-efficient-tuning prompt-tuning

Python 37

5 个月前

frank-chris / ImageTextRetrieval

In this work, we implement different cross-modal learning schemes such as Siamese Network, Correlational Network and Deep Cross-Modal Projection Learning model and study their performance. We also pro...

image-text-retrieval cross-modal-retrieval cross-modal-learning PyTorch Tensorflow Flask

Jupyter Notebook 11

4 年前

Markin-Wang / CAMANet

[IJBHI 2023] This is the official implementation of CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation accepted to IEEE Journal of Biomedical and Health Informatic...

cross-modal-learning

Python 8

1 年前

verlab / StraightToThePoint_CVPR_2020

Original PyTorch implementation of the code for the paper "Straight to the Point: Fast-forwarding Videos via Reinforcement Learning Using Textual Data" at the IEEE/CVF Conference on Computer Vision an...

机器视觉 vision-and-language reinforcement-learning agent video-processing video-analysis multimodal-deep-learning multimodal-learning cross-modal-learning cvpr

Python 8

3 年前

IGITUGraz / MemoryDependentComputation

Code for Limbacher, T., Özdenizci, O., & Legenstein, R. (2022). Memory-enriched computation and learning in spiking neural networks through Hebbian plasticity. arXiv preprint arXiv:2205.11276.

cross-modal-learning neural-networks Python pythorch question-answering recurrent-neural-networks reinforcement-learning

Python 6

2 年前

codiceSpaghetti / T4SA-2.0

#自然语言处理#This project creates the T4SA 2.0 dataset, i.e. a big set of data to train visual models for Sentiment Analysis in the Twitter domain using a cross-modal student-teacher approach.

机器视觉 cross-modal-learning 自然语言处理

Jupyter Notebook 4

2 年前

PrithivirajDamodaran / WhatTheFood

An intentionally simple Image to Food cross-modal search. Created by Prithiviraj Damodaran.

cross-modal-retrieval cross-modal cross-modal-learning multimodal

3 年前

GaochangWu / FMF-Benchmark

This is a cross-modal benchmark for industrial anomaly detection.

anomaly-detection anomaly-segmentation cross-modal-learning industrial multimodal transformer vit

Python 4

1 个月前

Qwinpin / DanceBERT-Masked-Motion-Modeling

PyTorch bert motion-generation cross-modal-learning

Jupyter Notebook 3

4 年前

kjanjua26 / Do_Cross_Modal_Systems_Leverage_Semantic_Relationships

This is the code for our ICCV'19 paper on cross-modal learning and retrieval.

5 年前

TataMoktari / CrossModal_GAN

We design a cross-modal GAN which learns image-to-image modality transformation across cross-domain. This network is able to synthesize Infrared images from VISIBLE images for VEDAI dataset

cross-modal-learning infrared

Python 0

2 年前