npu

#计算机科学#Tengine is a lite, high performance, modular inference engine for embedded device

翻译 - Tengine是适用于嵌入式设备的精简，高性能，模块化推理引擎

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Efficient Inference of Transformer models

An MLIR-based toolchain for AMD AI Engine-enabled devices.

#计算机科学#Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

#大语言模型#Local LLM Server with NPU Acceleration

FREE TPU V3plus for FPGA is the free version of a commercial AI processor (EEP-TPU) for Deep Learning EDGE Inference

#大语言模型#Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

hardware design of universal NPU(CNN accelerator) for various convolution neural network

#计算机科学#YoloV5 NPU for the RK3566/68/88

#大语言模型#High-speed and easy-use LLM serving framework for local deployment

C/C++ development kit for Sipeed Maix ecosystem boards

#安卓#Simplified AI runtime integration for mobile app development

Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).

#计算机科学#YoloV8 NPU for the RK3566/68/88

Advanced driver-assistance system with Google Coral Edge TPU Dev Board / USB Accelerator, Intel Movidius NCS (neural compute stick), Myriad 2/X VPU, Gyrfalcon 2801 Neural Accelerator, NVIDIA Jetson N...

#大语言模型#EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

#计算机科学#NPUsim: Full-Model, Cycle-Level, and Value-Aware Simulator for DNN Accelerators

#大语言模型#将LLM 模型部署到 Rockchip Rk3588芯片中，在开发板上使用NPU进行推理