4bit“ 的搜索结果

JavaScript1.02 k
8 个月前

llama-4bit-colab

Jupyter Notebook63
2 年前

simple 4-BIT CPU with 74-serials chip,origin by Kaoru Tonami in his book “How to build a CPU”

HTML304
4 年前

#大语言模型#FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

Python898
1 年前

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Python6.08 k
3 个月前

使用peft库,对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调,并做lora model和base model的merge及4bit的量化(quantize)。

Python357
2 年前

#计算机科学#Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

C++568
2 年前

Bitcoin Wallet Address Generator This is a simple Bitcoin non-deterministic wallet address generator coded in Python 3. It generates a Private Key in different formats (hex, wif and compressed wif) an...

Python14
3 年前

A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library

Python29
1 年前

MikroLeo project files (schematic, PCB, assembler, emulator/debugger, circuit simulation file, documentation, example of programs etc). MikroLeo is a 4-bit microcomputer developed mainly for education...

Python67
1 个月前