tpu · GitHub Topics

#大语言模型#A high-throughput and memory-efficient inference and serving engine for LLMs

gpt 大语言模型 PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu deepseek qwen

Python 41.24 k

3 小时前

tensorflow / tensor2tensor

#计算机科学#Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

翻译 - 深度学习模型和数据集的库，旨在使深度学习更易于访问并加速ML研究。

机器学习 machine-translation 深度学习 reinforcement-learning tpu

Python 15.92 k

2 年前

skypilot-org / skypilot

#计算机科学#SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 14+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Python 7.48 k

2 天前

tensorflow / adanet

#计算机科学#Fast and flexible AutoML with learning guarantees.

翻译 - 具有学习保证的快速灵活的AutoML。

automl Tensorflow learning-theory 深度学习 neural-architecture-search gpu 机器学习 ensemble tpu Python distributed-training

Jupyter Notebook 3.46 k

1 年前

hollance / neural-engine

#IOS#Everything we actually know about the Apple Neural Engine (ANE)

neural-engine ane coreml iphone iOS 神经网络 tpu

2.17 k

5 天前

imcaspar / gpt2-ml

#自然语言处理#GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型

gpt-2 tpu bert pretrained-models 中文自然语言处理 Tensorflow text-generation colab

Python 1.71 k

2 年前

aphrodite-engine / aphrodite-engine

#计算机科学#Large-scale LLM inference engine

API inference-engine 机器学习 CUDA inferentia rocm intel lora speculative-decoding tpu

C++ 1.33 k

8 小时前

ayaka14732 / tpu-starter

#计算机科学#Everything you want to know about Google Cloud TPU

tpu 深度学习 Google 云机器学习 jax

Python 514

8 个月前

chrisbutner / ChessCoach

Neural network-based chess engine capable of natural language commentary

翻译 - 能够进行自然语言评论的基于神经网络的国际象棋引擎

alphazero chess chess-engine C++gpu Keras nlg Tensorflow tpu uci

C++ 484

2 年前

jofrfu / tinyTPU

Implementation of a Tensor Processing Unit for embedded systems and the IoT.

fpga Tensorflow tensor tpu vhdl zynq xilinx Assembly hardware-designs hardware-acceleration hardware-architectures Verilog embedded-systems Linux Internet of things

VHDL 436

6 年前

tumaer / JAXFLUIDS

#计算机科学#Differentiable Fluid Dynamics Package

automatic-differentiation cfd fluid-dynamics gpu gpu-computing high-performance hpc jax 机器学习 tpu 深度学习 CUDA computational-fluid-dynamics

Python 377

1 个月前

magic-blue-smoke / Dual-Edge-TPU-Adapter

Dual Edge TPU Adapter to use it on a system with single PCIe port on m.2 A/B/E/M slot

edge-ai tpu-acceleration tpu coral tensorflow-lite edgetpu Home Assistant

332

2 年前

AI-Hypercomputer / JetStream

#大语言模型#JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

gemma gpt gpu inference jax large-language-models llama llama2 大语言模型 model-serving PyTorch tpu llm-inference llmops mlops transformer

Python 287

13 天前

embedeep / Free-TPU

#计算机科学#Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

免费 tpu npu zynq fpga lstm PyTorch rnn caffe darknet 深度学习 hardware

Shell 246

2 年前

Kohulan / DECIMER-Image_Transformer

#计算机科学#DECIMER Image Transformer is a deep-learning-based tool designed for automated recognition of chemical structure images. Leveraging transformer architectures, the model converts chemical images into S...

transformers tpu 深度学习 Python Tensorflow

Python 237

4 个月前