”inference-engine“ 的搜索结果

#大语言模型#浏览器中运行大模型，无需 server 支持

#大语言模型#A high-throughput and memory-efficient inference and serving engine for LLMs

Fast inference engine for Transformer models

用于谷歌Gemma模型的轻量级独立C++推理引擎。

#计算机科学#Large-scale LLM inference engine

#计算机科学#Tengine is a lite, high performance, modular inference engine for embedded device

翻译 - Tengine是适用于嵌入式设备的精简，高性能，模块化推理引擎

FeatherCNN is a high performance inference engine for convolutional neural networks.

ELFI - Engine for Likelihood-Free Inference

Inference engine powering open source models on OpenRouter

#大语言模型#Jlama is a modern LLM inference engine for Java

Prototype type inference engine

Highly optimized inference engine for Binarized Neural Networks

Machine Learning inference engine for Microcontrollers and Embedded devices

Local AI API Platform

Stock inference engine using Spring XD, Apache Geode / GemFire and Spark ML Lib.

This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server

Tensorflow Plugin for Unreal Engine using C API for inference focus.

#计算机科学#A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

翻译 - 轻巧的便携式纯C99 onnx推理引擎，适用于具有硬件加速支持的嵌入式设备。

Facebook 的 LLaMA 模型在 C/C++ 中的移植

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

LLaMA模型的推理代码

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server -...

Speech-to-Text interface for Emacs using OpenAI's whisper model and whisper.cpp as inference engine.