pretraining · GitHub Topics

LlamaFamily / Llama-Chinese

#大语言模型#Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

llama 大语言模型 llama3 finetune-llm pretraining

Python 14.47 k

6 个月前

microsoft / LMOps

#自然语言处理#General technology for enabling AI capabilities w/ LLMs and MLLMs

自然语言处理 agi gpt 大语言模型 lm pretraining prompt lmops promptist x-prompt language-model

Python 3.88 k

2 个月前

OFA-Sys / OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

multimodal pretraining image-captioning text-to-image-synthesis visual-question-answering referring-expression-comprehension vision-language pretrained-models prompt prompt-tuning 中文

Python 2.47 k

1 年前

X-PLUG / mPLUG-Owl

#大语言模型#mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

聊天机器人 ChatGPT large-language-models llama multimodal damo mplug instruction-tuning pretraining mplug-owl huggingface PyTorch transformer alpaca visual-recognition gpt gpt4 gpt4-api dialogue Video

Python 2.42 k

2 个月前

ChandlerBang / awesome-self-supervised-gnn

#计算机科学#Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

graph-neural-networks pretraining self-supervised-learning 深度学习机器学习 pre-training

Python 1.65 k

1 年前

keyu-tian / SparK

#计算机科学#[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling...

bert convnet convolutional-neural-networks masked-image-modeling pre-trained-model self-supervised-learning sparse-convolution TLS (Transport Layer Security)cnn iclr 深度学习 object-detection PyTorch instance-segmentation mask-rcnn pretrain pretraining

Python 1.33 k

1 年前

yuewang-cuhk / awesome-vision-language-pretraining-papers

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

vision-and-language pretraining multimodal-deep-learning bert

1.15 k

3 年前

qqlu / Entity

#计算机科学# EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation

翻译 - 开放世界实体分割

image-segmentation segmentation PyTorch instance-segmentation panoptic-segmentation semantic-segmentation object-detection fcos condinst detectron2 pretrained-weights pretrained-models 机器视觉深度学习 cnn pretraining

Jupyter Notebook 1.01 k

1 年前

YehLi / xmodaler

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense r...

翻译 - X-modaler 是用于跨模态分析的多功能高性能代码库。

image-captioning video-captioning vision-and-language pretraining cross-modal-retrieval visual-question-answering tden

Python 970

2 年前

deepmodeling / Uni-Mol

#计算机科学#Official Repository for the Uni-Mol Series Methods

pre-trained-model pretraining 深度学习

Python 800

8 天前

PKU-YuanGroup / LanguageBind

【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

multi-modal pretraining zero-shot

Python 791

1 年前

Alibaba-MIIL / ImageNet21K

Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper

pretraining multi-label-classification vision-transformer mixer

Python 749

2 年前

zubair-irshad / Awesome-Robotics-3D

#大语言模型#A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites

3D benchmarks 机器视觉 gaussian-splatting 大语言模型 manipulation nerf policy-learning pretraining Robotics scene-graph Simulation vision-language-model vlm diffusion-models foundation-models navigation

650

4 个月前

seal-rg / recurrent-pretraining

Pretraining code for a large-scale depth-recurrent language model

llms pretraining reasoning

Python 634

1 个月前

AGI-Arena / MARS

The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models

fine-tuning large-language-models optimization-algorithms optimizer pretraining

Python 543

1 个月前

cxcscmu / Craw4LLM

#网络爬虫#Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"

爬虫 crawling large-language-models 大语言模型 pre-training pretraining web-crawler web-crawling

Python 533

16 天前

PITI-Synthesis / PITI

PITI: Pretraining is All You Need for Image-to-Image Translation

机器视觉 image-generation image-synthesis image-to-image-translation pretraining

Python 494

9 个月前

PaddlePaddle / PaddleFleetX

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

paddlepaddle benchmark large-scale model-parallelism data-parallelism pipeline-parallelism cloud elastic lightning pretraining self-supervised-learning unsupervised-learning

Python 461

10 个月前

michiyasunaga / LinkBERT

[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links

language-model pretraining pretrained-models knowledge question-answering transformer

Python 430

3 年前

Coobiw / MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train...

multimodal-large-language-models deepspeed pipeline-parallelism mllm qwen fine-tuning pretraining

Jupyter Notebook 423

2 天前