parameter-efficient-fine-tuning

#计算机科学#[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

commonsense-reasoning 深度学习深度神经网络 instruction-tuning large-language-models large-vision-language-models lora parameter-efficient-fine-tuning parameter-efficient-tuning vision-and-language

Python 729

5 个月前

synbol / Awesome-Parameter-Efficient-Transfer-Learning

#Awesome#Collection of awesome parameter-efficient fine-tuning resources.

Awesome Lists 机器视觉 parameter-efficient-fine-tuning transfer-learning survey 深度学习 pre-trained-models transformer

522

7 个月前

Paranioar / Awesome_Matching_Pretraining_Transfering

#Awesome#The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insigh...

cross-modal-retrieval 教程 Awesome Lists image-text-matching image-text-retrieval large-language-models large-vision-language-models multimodal-pretraining parameter-efficient-fine-tuning vision-and-language multimodal-large-language-models large-language-model text-to-image-generation text-to-image-synthesis text-to-video-generation

421

3 个月前

liuqidong07 / MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

chatglm large-language-models mixture-of-experts multitask-learning parameter-efficient-fine-tuning peft

Python 151

8 个月前

Chongjie-Si / Subspace-Tuning

#自然语言处理#A generalized framework for subspace tuning methods in parameter efficient fine-tuning.

adapter glue llama lora natural-language-generation 自然语言处理 natural-language-understanding parameter-efficient-fine-tuning pretrained-models commonsense-reasoning

Python 128

1 个月前

ZhengxiangShi / DePT

#自然语言处理#[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

fine-tuning language-model large-language-models 自然语言处理 parameter-efficient-tuning peft prompt-tuning parameter-efficient-fine-tuning transfer-learning

Python 95

1 年前

architkaila / Fine-Tuning-LLMs-for-Medical-Entity-Extraction

Exploring the potential of fine-tuning Large Language Models (LLMs) like Llama2 and StableLM for medical entity extraction. This project focuses on adapting these models using PEFT, Adapter V2, and Lo...

entity-extraction fine-tuning-llm large-language-models medical-application parameter-efficient-fine-tuning

Python 71

1 年前

Paranioar / UniPT

[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"

cross-modal parameter-efficient-learning parameter-efficient-tuning transfer-learning parameter-efficient-fine-tuning

Python 66

5 个月前

ziplab / SPT

[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.

parameter-efficient-fine-tuning peft adapter lora prompt-tuning transfer-learning

Python 65

1 年前

miccunifi / KDPL

[ECCV 2024] - Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation

clip few-shot-learning knowledge-distillation parameter-efficient-fine-tuning prompt-learning vision-language-model

Python 54

4 个月前

astra-vision / FAMix

[CVPR 2024] Official repository of "A Simple Recipe for Language-guided Domain Generalized Segmentation"

机器视觉 domain-generalization parameter-efficient-fine-tuning semantic-segmentation vision-language

Python 47

4 个月前

iboing / CorDA

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)

large-language-models parameter-efficient-fine-tuning

Python 42

2 个月前

umbertocappellazzo / PETL_AST

This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of...

adapter audio-processing lora parameter-efficient-fine-tuning prompt-tuning transfer-learning mixture-of-experts

Python 36

7 个月前

OSU-MLB / PETL_Vision

#计算机科学#Lessons Learned from a Unifying Empirical Study of Parameter-Efficient Transfer Learning (PETL) in Visual Recognition

机器视觉深度学习 parameter-efficient-fine-tuning parameter-efficient-tuning pre-trained-model transfer-learning transformer vision-transformer visual-recognition

Jupyter Notebook 28

2 个月前

auniquesun / PPT

[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"

parameter-efficient-fine-tuning parameter-efficient-tuning prompt-learning

Jupyter Notebook 22

18 天前

ltlhuuu / PSEC

[ICLR 2025] The offical implementation of "PSEC: Skill Expansion and Composition in Parameter Space", a new framework designed to facilitate efficient and flexible skill expansion and composition, ite...

continual-learning decision-making fine-tuning large-language-models lora pretrained-models reinforcement-learning Robotics transfer-learning parameter-efficient-fine-tuning imitation-learning multi-objective-optimization offline-reinforcement-learning

Python 21

1 个月前

astra-vision / ProLIP

Fine-tuning CLIP's Last Visual Projector: A Few-Shot Cornucopia

parameter-efficient-fine-tuning

5 个月前

fredzzhang / atlas

Official PyTorch implementation for NeurIPS'24 paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"

few-shot-learning parameter-efficient-fine-tuning peft pytorch-implementation

Python 18

17 天前

PurdueDigitalTwin / MACP

[WACV 2024] MACP: Efficient Model Adaptation for Cooperative Perception.

autonomous-vehicles 机器视觉 object-tracking parameter-efficient-fine-tuning perception

Python 14

10 个月前

alinourian / Fine-tuning-Mistral-7b-QA

#大语言模型#Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)

fine-tuning gpt-4 hugging-face large-language-models 大语言模型 lora mistral-7b parameter-efficient-fine-tuning peft wandb

Jupyter Notebook 12

1 年前