”inference-optimization“ 的搜索结果

#计算机科学#The Triton Inference Server provides an optimized cloud and edge inferencing solution.

翻译 - Triton Inference Server提供了针对NVIDIA GPU优化的云推理解决方案。

#计算机科学#DeepSpeed Chat: 一键式RLHF训练，让你的类ChatGPT千亿大模型提速省钱15倍

#安卓#ncnn 是一个为手机端极致优化的高性能神经网络前向计算框架

#自然语言处理#OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

翻译 - OpenVINO™工具包存储库

Optimizing inference proxy for LLMs

#计算机科学#MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

翻译 - MACE是针对移动异构计算平台进行了优化的深度学习推理框架。

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.

翻译 - An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.

#计算机科学#Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

ML model optimization product to accelerate inference.

Facebook 的 LLaMA 模型在 C/C++ 中的移植

LLaMA模型的推理代码

Multivariate Regression and Classification Using an Adaptive Neuro-Fuzzy Inference System (Takagi-Sugeno) and Particle Swarm Optimization.

CodeLlama 模型推理代码

#大语言模型#Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...

Reference implementations of MLPerf™ inference benchmarks

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

#计算机科学#A hyperparameter optimization framework

翻译 - 超参数优化框架

Deep Learning Inference benchmark. Supports Intel® Distribution of OpenVINO™ Toolkit, Intel® Optimization for Caffe and Intel® Optimization for TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN

zod 是一个TypeScript数据类型验证库。从简单的 String类型到复杂的嵌套对象

TinyML AI inference library

#自然语言处理#Large Language Model Text Generation Inference

Home of StarCoder: fine-tuning & inference!

SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization