ModelTC / lightllm

  Model Quantization Benchmark

  United Perception

  大模型Grok-1开源

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Open-Sora： 完全开源的高效复现类Sora视频生成方案

  本地化搭建和运行 Llama2 和其他大模型

  🙌 OpenHands: Code Less, Make More

  Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. D...

  小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 ｜ 评论爬虫、微博帖子 ｜ 评论爬虫、百度贴吧帖子 ｜ 百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫

  Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficientl...

  This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

#计算机科学#  Large Language Model Text Generation Inference

  Automate browser-based workflows with LLMs and Computer Vision

  本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

  MetaGPT：为 GPT 分配不同的角色，协作处理更复杂的任务。MetaGPT输入一句话的老板需求，输出用户故事 / 竞品分析 / 需求 / 数据结构 / APIs / 文件等

  Universal LLM Deployment Engine with ML Compilation

  SGLang is a fast serving framework for large language models and vision language models.

  利用AI大模型，一键生成高清短视频 Generate short videos with one click using AI LLM.

  Development repository for the Triton language and compiler

翻译 - Triton 语言和编译器的开发库

  Fast and memory-efficient exact attention