distributed-computing · GitHub Topics

#计算机科学# 一个整合高效并行技术的AI大模型训练系统。

deep-learning hpc large-scale data-parallelism pipeline-parallelism model-parallelism ai big-model distributed-computing inference

Python38.83 k

2 天前

catalyst

@catalyst-team

#计算机科学# Accelerated deep learning R&D

翻译 - 加快DL研发

deep-learning reinforcement-learning machine-learning computer-vision pytorch python distributed-computing infrastructure research reproducibility

Python3.3 k

8 个月前

alpa

@alpa-projects

#大语言模型# Training and serving large-scale neural networks with auto parallelization.

deep-learning machine-learning compiler distributed-training high-performance-computing alpa jax distributed-computing llm auto-parallelization

Python3.07 k

1 年前

distributed-consensus-reading-list

@heidihoward

A list of papers about distributed consensus.

distributed-systems paxos atomic-broadcast-protocol zookeeper fault-tolerance distributed-computing consensus-algorithms quorum-systems state-machine-replication consistency

2.53 k

3 个月前

@pytorch • Meta

#计算机科学# A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

ai control decision-making distributed-computing machine-learning marl model-based-reinforcement-learning multi-agent-reinforcement-learning pytorch reinforcement-learning

Python2.36 k

1 天前

Daft

@Eventual-Inc

#计算机科学# Distributed data engine for Python/SQL designed for the cloud, powered by Rust

machine-learning python data-engineering data-science dataframe distributed-computing rust big-data

Rust2.25 k

1 个月前

boinc

BOINC@BOINC

Open-source software for volunteer computing and grid computing.

翻译 - 用于志愿者计算和网格计算的开源软件。

boinc distributed-computing volunteer-computing high-performance-computing citizen-science scientific-computing grid-computing science high-throughput-computing php

PHP2.03 k

1 天前

distributed-llama

@b4rtaz

#大语言模型# Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

distributed-computing llama2 llm llm-inference neural-network llms open-llm distributed-llm llama3

C++1.51 k

1 天前

vizier

谷歌公司@google

Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

vizier hyperparameter-optimization tuning tuning-parameters blackbox-optimization hyperparameter-tuning bayesian-optimization evolutionary-algorithms distributed-systems distributed-computing

Python1.38 k

3 个月前

goflow

@s8sg

A Golang based high performance, scalable and distributed workflow framework

翻译 - 基于Golang的高性能，可扩展和分布式工作流框架

workflow-engine workload-automation framework golang workflow distributed-computing

CSS1.17 k

1 年前

fiber

Uber Open Source@uber

#计算机科学# Distributed Computing for AI Made Simple

翻译 - 简化AI的分布式计算

python distributed-computing multiprocessing sandbox machine-learning

Python1.04 k

2 年前

bluefog

@Bluefog-Lib

#计算机科学# Distributed and decentralized training framework for PyTorch over graph

翻译 - PyTorch over graph 的分布式和去中心化训练框架

mpi distributed-computing deeplearning machine-learning pytorch decentralized asynchronous one-sided nccl

Python291

4 个月前

easyFL

@WwZzz

#计算机科学# An experimental platform to quickly realize and compare with popular centralized federated learning algorithms. A realization of federated learning algorithm on fairness (FedFV, Federated Learning wit...

pytorch federated-learning distributed-computing deep-learning fairness machine-learning

Python188

2 年前