llama3-1 · GitHub Topics

#大语言模型#SGLang is a fast serving framework for large language models and vision language models.

CUDA inference llama llava 大语言模型 llm-serving moe PyTorch transformer vlm llama3 llama3-1 deepseek deepseek-llm deepseek-v3 deepseek-r1 deepseek-r1-zero

Python 11.8 k

1 小时前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 10.94 k

2 天前

EmbeddedLLM / JamAIBase

#大语言模型#The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...

agents 人工智能 ai-agents-framework baas 聊天机器人 lancedb 大语言模型 llm-ops Python Serverless backend-as-a-service ChatGPT orchestration rag retrieval-augmented-generation workflow Svelte Spreadsheet llama3-1

Python 846

8 天前

adalkiran / llama-nuts-and-bolts

#计算机科学#A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

深度学习 educational-project Go large-language-models llama 机器学习 transformers unicode utf-8 llama3-1

Go 261

7 个月前

datastax / astra-assistants-api

Drop in replacement for the OpenAI Assistants API

cohere gemini gpt-4 groq openai-assistants vector assistants-api openai-assistants-api assistants claude llama3-1 ollama

Python 186

13 天前

austin-starks / Promptimizer

#大语言模型#An Automated AI-Powered Prompt Optimization Framework

人工智能 genetic-algorithm large-language-model 大语言模型机器学习 MongoDB ollama Open Source optimization prompt-engineering prompt-management anthropic llama3 llama3-1 llamacpp openai

TypeScript 179

7 个月前

aimagelab / LLaVA-MORE

LLaVA-MORE: Enhancing Visual Instruction Tuning with LLaMA 3.1

llama3 llama3-1 llava llms vision-and-language

Python 104

16 天前

Debapriya-source / nyaya-gpt

#大语言模型#AI agent with RAG+ReAct on Indian Constitution & BNS

人工智能 groq llama3-1 大语言模型 rag Streamlit

Python 60

5 个月前

RMNCLDYO / perplexity-ai-toolkit

A versatile CLI and Python wrapper for Perplexity's suite of large language models including their flagship 'Sonar' models (built on top of Meta's latest and most advanced open-source model 'Llama-3.1...

perplexity perplexity-ai 聊天机器人 llama llama-3 llama3-1

Python 55

7 个月前

kyopark2014 / llama3.2-rag-bot

Multimodal RAG based on Llama 3.2

bedrock 聊天机器人 langchain llama3 llama3-1

Python 28

4 个月前

MaxiDonkey / DelphiGroqCloud

The GroqCloud API wrapper for Delphi provides access to models from Meta, OpenAI, MistralAI and Google on Groq’s LPUs, offering chat, text generation, image analysis, audio transcription, JSON output,...

API delphi gpt llama llama3-1 lpu vision groq groq-ai groq-api

Pascal 15

3 个月前

bigsk1 / ai-screen-analyzer

AI Screen Analyzer allows users to capture screenshots, analyze them using various AI providers and models, and engage in conversations about the images.

anthropic-claude ollama openai claude homelab image-recognition llama mistral 自托管 gpt4o llama3-1 ai-chatbot-framework

JavaScript 9

3 个月前

MoAshour93 / ConstructionAI

This repository contains projects developed to showcase how to apply Generative AI and open-source LLMs in the construction industry

人工智能聊天机器人 construction genai llama3-1 机器学习 open-webui

Jupyter Notebook 6

4 个月前

fireicewolf / joy-caption-cli

A Python base cli tool for tagging images with joy-caption-pre-alpha models.

llama3-1

Python 6

5 个月前

SwiftyAI / SwiftyMLC

#IOS#An example of integrating local LLMS using mlc-llm into an iOS app

iOS llama3-1 大语言模型 Swift local

Swift 6

3 个月前

elizabethsiegle / bike_walk_route_map_generator

Generate an optimal path on a map a la Traveling Salesman Problem to hit different landmarks in an input city using Cloudflare Workers AI (using LlaMA-3.1), LangChain (for prompt templates and comma s...

人工智能 Cloudflare folium langchain llama3-1 mapbox Python Streamlit workers-ai

Python 5

5 个月前