llama3-1 · GitHub Topics

#大语言模型#SGLang is a fast serving framework for large language models and vision language models.

CUDA inference llama llava 大语言模型 llm-serving moe PyTorch transformer vlm llama3 llama3-1 deepseek deepseek-llm deepseek-v3 deepseek-r1 deepseek-r1-zero

Python 13.13 k

6 小时前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.12 k

2 天前

EmbeddedLLM / JamAIBase

#大语言模型#The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...

agents 人工智能 ai-agents-framework baas 聊天机器人 lancedb 大语言模型 llm-ops Python Serverless backend-as-a-service ChatGPT orchestration rag retrieval-augmented-generation workflow Svelte Spreadsheet llama3-1

Python 1.01 k

1 个月前

adalkiran / llama-nuts-and-bolts

#计算机科学#A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

深度学习 educational-project Go large-language-models llama 机器学习 transformers unicode utf-8 llama3-1

Go 297

8 个月前

datastax / astra-assistants-api

Drop in replacement for the OpenAI Assistants API

cohere gemini gpt-4 groq openai-assistants vector assistants-api openai-assistants-api assistants claude llama3-1 ollama

Python 187

3 天前

austin-starks / Promptimizer

#大语言模型#An Automated AI-Powered Prompt Optimization Framework

人工智能 genetic-algorithm large-language-model 大语言模型机器学习 MongoDB ollama Open Source optimization prompt-engineering prompt-management anthropic llama3 llama3-1 llamacpp openai

TypeScript 182

8 个月前

aimagelab / LLaVA-MORE

LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning

llama3 llama3-1 llava llms vision-and-language deepseek-r1

Python 125

12 天前

Debapriya-source / nyaya-gpt

#大语言模型#AI agent with RAG+ReAct on Indian Constitution & BNS

人工智能 groq llama3-1 大语言模型 rag Streamlit

Python 61

6 个月前

husaynirfan1 / simple-rag

#大语言模型#Simple RAG system.

milvus vector vector-database deepseek-r1 llama3-1 大语言模型 Python qwen2-5 nltk

Python 59

10 天前

RMNCLDYO / perplexity-ai-toolkit

A versatile CLI and Python wrapper for Perplexity's suite of large language models including their flagship 'Sonar' models (built on top of Meta's latest and most advanced open-source model 'Llama-3.1...

perplexity perplexity-ai 聊天机器人 llama llama-3 llama3-1

Python 55

8 个月前

kyopark2014 / llama3.2-rag-bot

Multimodal RAG based on Llama 3.2

bedrock 聊天机器人 langchain llama3 llama3-1

Python 27

5 个月前

MaxiDonkey / DelphiGroqCloud

The GroqCloud API wrapper for Delphi provides access to models from Meta, OpenAI, MistralAI and Google on Groq’s LPUs, offering chat, text generation, image analysis, audio transcription, JSON output,...

API delphi gpt llama llama3-1 lpu vision groq groq-ai groq-api

Pascal 17

1 个月前

bigsk1 / ai-screen-analyzer

AI Screen Analyzer allows users to capture screenshots, analyze them using various AI providers and models, and engage in conversations about the images.

anthropic-claude ollama openai claude homelab image-recognition llama mistral 自托管 gpt4o llama3-1 ai-chatbot-framework

JavaScript 9

1 个月前

MoAshour93 / ConstructionAI

This repository contains projects developed to showcase how to apply Generative AI and open-source LLMs in the construction industry

人工智能聊天机器人 construction genai llama3-1 机器学习 open-webui

Jupyter Notebook 6

5 个月前

dcarpintero / ai-engineering

AI Engineering: Annotated NBs to dive into Self-Attention, In-Context Learning, RAG, Knowledge-Graphs, Fine-Tuning, Model Optimization, and many more.

bert chunking embeddings fine-tuning generative-ai huggingface-transformers in-context-learning knowledge-graph langchain large-language-models llama3-1 model-quantization retrieval-augmented-generation self-attention transformer weights-and-biases ai-engineering

Jupyter Notebook 6

10 天前

fireicewolf / joy-caption-cli

A Python base cli tool for tagging images with joy-caption-pre-alpha models.

llama3-1

Python 6

6 个月前

harshit433 / ResurrectAI

#计算机科学#ResurrectAI is an AI-driven chat application designed to bring the wisdom and knowledge of great historical personalities to life. Leveraging advanced language models and fine-tuning techniques, Resur...

Firebase Flask Flutter html-css-javascript llama3-1 ollama Python unsloth 人工智能聊天机器人 conversational-ai language-model 机器学习

Dart 6

6 个月前

SwiftyAI / SwiftyMLC

#IOS#An example of integrating local LLMS using mlc-llm into an iOS app

iOS llama3-1 大语言模型 Swift local

Swift 6

4 个月前

elizabethsiegle / bike_walk_route_map_generator

Generate an optimal path on a map a la Traveling Salesman Problem to hit different landmarks in an input city using Cloudflare Workers AI (using LlaMA-3.1), LangChain (for prompt templates and comma s...

人工智能 Cloudflare folium langchain llama3-1 mapbox Python Streamlit workers-ai

Python 5

6 个月前

AjinkyaTaranekar / ClickupLlama

Import Clickup Docs and chat with a local llama

clickup llama3-1 ollama

Python 4

7 个月前