model-merging · GitHub Topics

arcee-ai / mergekit

#大语言模型#Tools for merging pretrained large language models.

llama 大语言模型 model-merging

Python 5.4 k

2 小时前

EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.

attack-defense continual-learning ensemble-learning federated-learning generalization generative-model large-language-models model-merging multi-domain-learning multi-task-learning robustness diffusion-models few-shot-learning foundation-models meta-learning transfer-learning zero-shot-learning llms

333

4 天前

tanganke / fusion_bench

FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion

model-merging multi-tasking 深度神经网络机器学习 large-language-models

Python 115

5 天前

bloomberg / dataless-model-merging

Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)

language-model model-merging

Python 87

2 年前

EnnengYang / AdaMerging

AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.

model-merging multi-task-learning

Python 67

4 个月前

zhangyikaii / LAMDA-ZhiJian

ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse

pre-trained-model toolbox knowledge-distillation model-merging parameter-efficient-tuning regularization

Python 51

2 年前

nik-dim / tall_masks

Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]

model-merging

Python 40

5 个月前

EnnengYang / RepresentationSurgery

Representation Surgery for Multi-Task Model Merging. ICML, 2024.

model-merging multi-task-learning

Python 39

5 个月前

declare-lab / della

#大语言模型#DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling

huggingface 大语言模型 llms model-merging transformer

Python 30

8 个月前

naskio / mergeui

#大语言模型#All-in-one UI for merged LLMs in Hugging Face

huggingface 大语言模型 merge model-merging generative-ai large-language-models leaderboard 人工智能

Python 24

9 个月前

zjunlp / ModelKinship

#自然语言处理#Exploring Model Kinship for Merging Large Language Models

人工智能 kinship large-language-models model-merging 自然语言处理

Jupyter Notebook 23

15 天前

uiuctml / Localize-and-Stitch

#大语言模型#Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic

大语言模型 model-merging multi-task-learning

Python 23

2 个月前

Nithin-GK / MaxFusion

[ECCV'24] MaxFusion: Plug & Play multimodal generation in text to image diffusion models

diffusion-models multimodal plug-and-play txt2img model-merging

Jupyter Notebook 22

4 个月前

danielm1405 / magmax

[ECCV 2024] MagMax: Leveraging Model Merging for Seamless Continual Learning (official repository)

continual-learning model-merging

Python 18

7 个月前

kpup1710 / CAMEx

#计算机科学#[ICLR 2025] CAMEx: Curvature-Aware Merging of Experts

机器学习 mixture-of-experts model-merging

Python 17

12 天前

flowritecom / flow-merge

flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popular merge methods such as model soups, SLERP, ties-MERGING or DAR...

llms model-merging

Python 17

1 个月前

AliAtaollahi / Generalized-FFSM-Construction

A model merging project for generalizing Featured Finite State Machines (FFSMs) to unify behaviors across Software Product Lines (SPLs)

model-merging

Java 10

4 个月前

one-some / lazy-transformers-merge

#大语言模型#Merge transformers without using like a bajillion GB of RAM

大语言模型 model-merging PyTorch transformers

Python 10

2 年前

isaacus-dev / terge

#计算机科学#An easy-to-use Python library for merging PyTorch models.

人工智能深度学习机器学习 merge model-merging models PyTorch torch transformers

Python 9

9 个月前

EnnengYang / SurgeryV2

SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery. Arxiv, 2024.

model-merging multi-task-learning

Python 4

5 个月前