#大语言模型#Python bindings for the Transformer models implemented in C/C++ using GGML library.
ChatCSV bot using Llama 2, Sentence Transformers, CTransformers, Langchain, and Streamlit.
Run inference on replit-3B code instruct model using CPU
Investment Banker Chatbot using Intel's Neural Chat 7B LLM, BGE Embeddings, ChromaDB, Langchain, and CTransformers.
Basic ChatBot using CTransformers, ChromaDB and Gradio. Configured for CPU.
ctransformers wheels with pre-built CUDA binaries for additional CUDA and AVX versions.
Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.
ctransformers wrapper for model inferencing
A minimalist Docker project to help people getting started with Node, WizardCoder, CTransformers, Python, Express and TypeScript. Ready to be used in a Hugging Face Space.