pre-training · GitHub Topics

chain-of-thought ChatGPT in-context-learning instruction-tuning large-language-models 大语言模型 llms 自然语言处理 pre-trained-language-models pre-training rlhf

Python 11.16 k

2 天前

modelscope / data-juicer

#自然语言处理#Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Python 3.89 k

1 天前

dbiir / UER-py

#自然语言处理#Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

翻译 - PyTorch 中的开源预训练模型框架和预训练模型 Zoo

bert pre-training fine-tuning gpt 中文自然语言处理 PyTorch elmo classification ner t5 unilm roberta albert gpt-2 model-zoo bart xlm-roberta

Python 3.04 k

10 个月前

ChandlerBang / awesome-self-supervised-gnn

#计算机科学#Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

graph-neural-networks pretraining self-supervised-learning 深度学习机器学习 pre-training

Python 1.65 k

1 年前

EgoAlpha / prompt-in-context-learning

#大语言模型#Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.

chain-of-thought 聊天机器人 ChatGPT ChatGPT API cot in-context-learning language-modeling language-understanding large-language-model 大语言模型 pre-training prompt prompt-engineering prompt-learning prompt-toolkit prompt-tuning

Jupyter Notebook 1.56 k

3 个月前

LirongWu / awesome-graph-self-supervised-learning

#计算机科学#Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"

self-supervised-learning 机器学习 unsupervised-learning graph-neural-networks pre-training data-augmentation representation-learning transfer-learning 深度学习

1.39 k

7 个月前

zjunlp / KnowLM

#计算机科学#An Open-sourced Knowledgable Large Language Model Framework.

llama large-language-models pre-trained-language-models language-model instruction-following 深度学习中文 english instructions models reasoning gpt-3 deepspeed instruction-tuning lora pre-training pre-trained-model

Python 1.29 k

2 个月前

yzhuoning / Awesome-CLIP

Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).

clip contrastive-learning pre-training

1.18 k

8 个月前

Tencent / TencentPretrain

#自然语言处理#Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

albert bart bert 中文 classification elmo fine-tuning gpt gpt-2 model-zoo 自然语言处理 ner pre-training PyTorch roberta t5 unilm xlm-roberta

Python 1.06 k

7 个月前

microsoft / Oscar

Oscar and VinVL

vision-and-language pre-training image-captioning vqa oscar

Python 1.05 k

2 年前

SalesforceAIResearch / uni2ts

#计算机科学#Unified Training of Universal Time Series Forecasting Transformers

深度学习 forecasting 机器学习 pre-trained-models pre-training representation-learning time-series time-series-forecasting transformers

Jupyter Notebook 1.04 k

17 天前

qingsongedu / Awesome-TimeSeries-SpatioTemporal-LM-LLM

A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series, Spatiotemporal, and Event Data.

anomalydetection autoscaling 深度学习 forecasting foundation-models large-language-models 机器学习 pre-training timeseries

1 k

3 个月前

brightmart / bert_language_understanding

#自然语言处理#Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

bert-model language-model attention-is-all-you-need transformer-encoder pre-training language-understanding text-classification document-classification self-attention transfer-learning 自然语言处理 question-answering textcnn fasttext

Python 962

6 年前

ChenRocks / UNITER

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

transformers pre-training vision-and-language PyTorch

Python 791

4 年前

jackroos / VL-BERT

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

pre-training representation-learning self-supervised-learning vision-and-language bert PyTorch

Jupyter Notebook 740

2 年前

nancheng58 / Awesome-LLM4RS-Papers

#Awesome# Large Language Model-enhanced Recommender System Papers

large-language-models 大语言模型 papers pre-training prompt-tuning recommender-system survey Awesome Lists gpt

640

1 个月前

princeton-nlp / LLM-Shearing

#自然语言处理#[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

efficiency 大语言模型自然语言处理 pre-training pruning llama llama2

Python 590

1 年前

Shen-Lab / GraphCL

[NeurIPS 2020] "Graph Contrastive Learning with Augmentations" by Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, Yang Shen

graph-neural-network contrastive-learning self-supervised-learning pre-training

Python 579

8 个月前

cxcscmu / Craw4LLM

#网络爬虫#Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

爬虫 crawling large-language-models 大语言模型 pre-training pretraining web-crawler web-crawling

Python 533

16 天前

acbull / GPT-GNN

Code for KDD'20 "Generative Pre-Training of Graph Neural Networks"

graph-neural-networks graph-representation-learning pre-training self-supervised-learning

Python 492

8 个月前