p-tuning · GitHub Topics

#大语言模型#基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

chatglm ChatGPT freeze lora p-tuning chatglm2 chatglm3

Python 2.72 k

1 年前

#大语言模型#We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to...

chatglm llama 大语言模型 lora ChatGPT cot instruction-tuning alpaca moss p-tuning PyTorch tabular-data

Jupyter Notebook 2.7 k

1 年前

THUDM / P-tuning-v2

#自然语言处理#An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

自然语言处理 prompt-tuning pretrained-language-model p-tuning parameter-efficient-learning

Python 2.01 k

1 年前

THUDM / P-tuning

#自然语言处理#A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.

自然语言处理 pre-trained-language-models prompt-tuning p-tuning parameter-efficient-learning few-shot-learning

Python 927

2 年前

yuanjie-ai / ChatLLM

#大语言模型#轻松玩转LLM兼容openai&langchain，支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等

ChatGPT 大语言模型 gpt4 langchain lora p-tuning chatllm chatpdf chatdoc

Jupyter Notebook 445

6 个月前

openhackathons-org / End-to-End-LLM

#自然语言处理#This repository is an AI Bootcamp material that consist of a workflow for LLM

深度学习自然语言处理 p-tuning prompt-tuning 大语言模型 question-answering tensorrt-llm genai

Jupyter Notebook 74

7 个月前

FreedomIntelligence / DPTDR

Code for COLING22 paper, DPTDR: Deep Prompt Tuning for Dense Passage Retrieval

prompt-tuning information-retrieval p-tuning prompt-learning question-answering

Python 25

2 年前

bugface / P-tuning-v2-MRC-NER

P-tuning-v2 integrated mrc for ner

ner p-tuning PyTorch

Python 3

2 年前

HROlive / Poland-End-To-End-LLM-Bootcamp

#大语言模型#This bootcamp is designed to give NLP researchers an end-to-end overview on the fundamentals of NVIDIA NeMo framework, complete solution for building large language models. It will also have hands-on ...

gpt llama2 大语言模型 llm-inference llm-training Nvidia p-tuning prompt-tuning tensorrt triton

Jupyter Notebook 2

1 年前

avnlp / llm-finetuning

fine-tuning sft lora peft qlora p-tuning

Python 2

1 个月前

yuchengml / Adaptation-Tuning-PEFT

Comparison of different adaptation methods on PEFT for fine-tuning downstream tasks or benchmarks.

huggingface-transformers p-tuning peft transformers wandb lora

Python 1

1 年前

NJUxlj / p-tuning-v2-reproduce

#大语言模型#Reproduce a prompt-learning method: P-Tuning V2, from the paper 《P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks》, model usage: Deberta + ChatGLM2, addi...

chatglm2-6b 大语言模型 p-tuning prompt-learning

Python 0

9 天前