evaluation · GitHub Topics | GitHub 中文社区

ragas

@explodinggradients

#大语言模型#Supercharge Your LLM Application Evaluations 🚀

llm llmops evaluation

Python7.65 k

3 天前

langfuse

@langfuse

#大语言模型#🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

TypeScript7.43 k

10 分钟前

promptfoo

@promptfoo

#大语言模型#Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command ...

llm prompt-engineering prompts llmops prompt-testing Testing rag evaluation evaluation-framework llm-eval llm-evaluation llm-evaluation-framework 持续集成 CI/CD pentesting red-teaming vulnerability-scanners

TypeScript5.01 k

1 天前

opencompass

@open-compass

#大语言模型#OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

evaluation benchmark large-language-model ChatGPT llm llama2 openai llama3

Python4.35 k

4 天前

govaluate

@Knetic

Arbitrary expression evaluation for golang

翻译 - golang的任意表达式求值

Go evaluation Parsing expression

Go3.77 k

7 个月前

evo

@MichaelGrupp

Python package for the evaluation of odometry and SLAM

翻译 - Python package for the evaluation of odometry and SLAM

slam odometry evaluation 监控 Robotics trajectory benchmark ros kitti tum

Python3.55 k

8 天前

AutoRAG

@Marker-Inc-Korea

#大语言模型#AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

analysis automl benchmarking document-parser embeddings evaluation llm llm-evaluation llm-ops Open Source

Python2.78 k

1 个月前

helicone

@Helicone

#大语言模型#🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

large-language-models prompt-engineering agent-monitoring analytics evaluation gpt langchain llama-index llm llm-cost llm-evaluation llm-observability llmops 监控 Open Source openai playground prompt-management ycombinator

TypeScript2.68 k

1 天前

promptbench

Microsoft@microsoft

#大语言模型#A unified evaluation framework for large language models

adversarial-attacks ChatGPT evaluation large-language-models robustness prompt prompt-engineering benchmark

Python2.49 k

2 个月前

ChainForge

@ianarawjo

An open-source visual programming environment for battle-testing prompts to LLMs.

人工智能 evaluation large-language-models llmops llms prompt-engineering

TypeScript2.43 k

4 天前

evaluate

Hugging Face@huggingface

#计算机科学#🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

evaluation 机器学习

Python2.06 k

3 个月前

AB3DMOT

@xinshuoweng

#计算机科学#(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"

翻译 - 提交中的“ 3D多对象跟踪基准”的官方Python实现

机器视觉机器学习 Robotics tracking 3d-tracking multi-object-tracking real-time evaluation-metrics evaluation 3d-multi-object-tracking

Python1.69 k

9 个月前

alpaca_eval

@tatsu-lab

#自然语言处理#An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

深度学习 evaluation foundation-models instruction-following large-language-models leaderboard 自然语言处理 rlhf

Jupyter Notebook1.58 k

1 个月前

fuzzbench

谷歌公司@google

FuzzBench - Fuzzer benchmarking as a service.

翻译 - FuzzBench-Fuzzer基准测试即服务。

Fuzzing/Fuzz testing benchmarking benchmark-framework evaluation Security

Python943

1 年前

ncalc

@ncalc

NCalc is a fast and lightweight expression evaluator library for .NET, designed for flexibility and high performance. It supports a wide range of mathematical and logical operations.

C#.NET expressions ncalc runtime evaluation Parser antlr ANTLR Mathematics

C#709

6 天前