distributed-computing · GitHub Topics

#计算机科学#一个整合高效并行技术的AI大模型训练系统。

深度学习 hpc large-scale data-parallelism pipeline-parallelism model-parallelism 人工智能 big-model distributed-computing inference heterogeneous-training foundation-models

Python 40.58 k

15 小时前

ty4z2008 / Qix

#计算机科学#Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

机器学习 distributed-systems PostgreSQL 深度学习 Go Awesome Lists distributed-computing distributed-database

14.8 k

8 个月前

hazelcast / hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

翻译 - 开源内存数据网格

Java hazelcast in-memory big-data scalability distributed caching Hacktoberfest stream-processing low-latency distributed-computing distributed-systems data-in-motion data-insights real-time

Java 6.26 k

2 天前

livebook-dev / livebook

Automate code & data workflows with interactive Elixir notebooks

翻译 - 交互式和协作式代码笔记本-用Phoenix LiveView制作。

phoenix Elixir notebooks collaborative realtime liveview 数学 Markdown 可视化 charts distributed-computing

Elixir 5.21 k

5 天前

asynkron / protoactor-go

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

翻译 - Proto Actor-用于Go，C＃和Java / Kotlin的超快速分布式actor

gRPC actor-model actors cross-platform protobuf akka clustering distributed-computing Go distributed-systems

Go 5.16 k

7 个月前

chrislusf / gleam

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

翻译 - 快速，高效，可扩展的分布式地图/缩减系统，以纯Go编写的DAG在内存或磁盘上执行，可独立运行或分布式运行。

distributed-computing map-reduce Go distributed-systems

Go 3.5 k

3 个月前

catalyst-team / catalyst

#自然语言处理#Accelerated deep learning R&D

翻译 - 加快DL研发

深度学习 reinforcement-learning 机器学习机器视觉 PyTorch Python distributed-computing infrastructure research reproducibility 图像处理 image-classification image-segmentation object-detection 自然语言处理 text-classification information-retrieval recommender-system metric-learning

Python 3.34 k

1 年前

alpa-projects / alpa

#大语言模型#Training and serving large-scale neural networks with auto parallelization.

深度学习机器学习编译器 distributed-training high-performance-computing alpa jax distributed-computing 大语言模型 auto-parallelization

Python 3.11 k

1 年前

Eventual-Inc / Daft

#计算机科学#Distributed data engine for Python/SQL designed for the cloud, powered by Rust

机器学习 Python data-engineering 数据科学 dataframe distributed-computing Rust big-data

Rust 2.61 k

2 天前

pytorch / rl

#计算机科学#A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

人工智能 control decision-making distributed-computing 机器学习 marl model-based-reinforcement-learning multi-agent-reinforcement-learning PyTorch reinforcement-learning rl Robotics torch

Python 2.59 k

2 天前

heidihoward / distributed-consensus-reading-list

A list of papers about distributed consensus.

distributed-systems paxos atomic-broadcast-protocol zookeeper fault-tolerance distributed-computing consensus-algorithms quorum-systems state-machine-replication consistency replication

2.55 k

7 个月前

jostmey / NakedTensor

Bare bone examples of machine learning in TensorFlow

翻译 - TensorFlow中机器学习的裸露示例

Tensorflow distributed-computing simple big-data linear-regression tensorflow-exercises

Python 2.42 k

8 年前

microsoft / GraphEngine

Microsoft Graph Engine

翻译 - Microsoft图形引擎

graph-engine graph-query-language in-memory-storage in-memory-computations distributed-computing .NET

C# 2.21 k

5 个月前

BOINC / boinc

#安卓#Open-source software for volunteer computing and grid computing.

翻译 - 用于志愿者计算和网格计算的开源软件。

BOINC distributed-computing volunteer-computing high-performance-computing Citizen science scientific-computing Grid computing science high-throughput-computing PHP C++Hacktoberfest Android Java Kotlin

PHP 2.09 k

13 小时前

fugue-project / fugue

#计算机科学#A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Apache Spark dask 机器学习 distributed-systems distributed-computing distributed SQL pandas

Python 2.05 k

6 个月前

b4rtaz / distributed-llama

#大语言模型#Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

distributed-computing llama2 大语言模型 llm-inference 神经网络 llms open-llm distributed-llm llama3

C++ 1.94 k

6 天前

innovation-cat / Awesome-Federated-Machine-Learning

#计算机科学#Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond

federated-learning 机器学习深度学习 privacy-preserving-machine-learning 机器视觉 distributed-computing edge-computing 安全 differential-privacy

1.88 k

9 个月前

chapel-lang / chapel

#编程语言#a Productive Parallel Programming Language

翻译 - 一种高效的并行编程语言

编译器 gpu hpc language parallel concurrency distributed-computing high-performance-computing Open Source parallel-computing performance 编程语言 scientific-computing

Chapel 1.84 k

20 小时前

asynkron / protoactor-dotnet

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

actors clustering akka distributed-systems distributed-computing

C# 1.79 k

6 天前

moosefs / moosefs

MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage

software-defined-storage posix filesystem file-system distributed-file-system distributed-storage distributed-computing fuse high-availability storage posix-compliant erasure-coding tiering backup block-storage distributed-file-storage file-storage media

C 1.76 k

5 天前