llm deploy project based mnn. This project has merged into MNN.
test model inference benchmark(ChatGLM2-6B,LLaMA2-7b-chat,Baichuan2-7B-chat)
baichuan2-7b-chat-v1
deepspeed_baichuan2_7B_base
A tool for normalizing bibtex with official info.
Visualize the intermediate output of Mistral 7B
#自然语言处理#A large-scale 7B pretraining language model developed by BaiChuan-Inc.
#自然语言处理#Finetune LLaMA-7B with Chinese instruction datasets
Fine-tune mistral-7B on 3090s, a100s, h100s
Tutorial on training, evaluating LLM, as well as utilizing RAG, Agent, Chain to build entertaining applications with LLMs.分享如何训练、评估LLMs,如何基于RAG、Agent、Chain构建有趣的LLMs应用。
Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
Baichuan2代码的逐行解析版本,适合小白
#自然语言处理#通义千问-7B(Qwen-7B) 是阿里云研发的通义千问大模型系列的70亿参数规模的模型
Simple UI for Llama-3.2-11B-Vision & Molmo-7B-D
RAG (Retrievel Augmented Generation) implementation using the Mistral-7B-Instruct-v0.1
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
#大语言模型#Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
Local PDF Chat Application with Mistral 7B LLM, Langchain, Ollama, and Streamlit
#大语言模型#Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
Command-line script for inferencing from models such as MPT-7B-Chat
#大语言模型#The "vicuna-installation-guide" provides step-by-step instructions for installing and configuring Vicuna 13 and 7B
A Alpaca-7b replication no limitation and mutilingual finetuned instruction LLaMA LoRA