llm-security · GitHub Topics

#大语言模型#Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook 22.55 k

2 天前

Giskard-AI / giskard

#大语言模型#🐢 Open-Source Evaluation & Testing for AI & LLM systems

mlops ml-validation ml-testing llmops responsible-ai fairness-ai llm-eval llm-evaluation rag-evaluation ai-security llm-security ai-red-team red-team-tools 大语言模型

Python 4.36 k

2 天前

NVIDIA / garak

the LLM vulnerability scanner

人工智能 llm-evaluation llm-security security-scanners vulnerability-assessment

Python 4 k

1 天前

verazuo / jailbreak_llms

#大语言模型#[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

ChatGPT jailbreak 大语言模型 prompt large-language-model llm-security jailbreaking

Jupyter Notebook 2.99 k

3 个月前

protectai / llm-guard

#大语言模型#The Security Toolkit for LLM Interactions

large-language-models 大语言模型 ChatGPT 安全 adversarial-machine-learning prompt-engineering prompt-injection llmops llm-security transformers

Python 1.48 k

2 天前

msoedov / agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

llm-security ai-red-team llm-evaluation llm-evaluation-framework prompt-testing agent-framework

Python 1.14 k

10 小时前

mariocandela / beelzebub

#大语言模型#A secure low code honeypot framework, leveraging AI for System Virtualization.

Cybersecurity research 安全 honeypot 框架低代码 Go research-project Kubernetes cloudnative cloudsecurity openai 大语言模型 llm-security llama3 ollama deception

Go 860

11 天前

EasyJailbreak / EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

large-language-model llm-security jailbreak

Python 553

6 个月前

chawins / llm-sp

#Awesome#Papers and resources related to the security and privacy of LLMs 🤖

adversarial-machine-learning Awesome Lists 大语言模型 llm-security 隐私安全

Python 480

3 个月前

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

llm-security prompt-injection adversarial-attacks adversarial-machine-learning large-language-models llmops yara-scanner 安全

Python 354

1 年前

R3DRUN3 / sploitcraft

🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷

Cybersecurity Hacking offensive-security proof-of-concept redteam 教程人工智能 Amazon Web Services cloud container-security Docker Linux llm-security network-security Python Windows

Jupyter Notebook 193

19 天前

liu00222 / Open-Prompt-Injection

#大语言模型#This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses

llm-security llms prompt-injection 大语言模型

Python 177

2 个月前

phantasmlabs / phantasm

#大语言模型#Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

ai-agents ai-safety ai-security automation-tools control-flow dashboard human-computer-interaction human-in-the-loop 大语言模型 llm-security llmops 监控 Open Source Rust

Svelte 161

3 个月前

yevh / TaaC-AI

AI-driven Threat modeling-as-a-Code (TaaC-AI)

application-security devsecops gpt gpt-3 gpt-4 threat threat-modeling 人工智能 llm-security claude-3 mistral-7b

HTML 126

9 个月前

sshh12 / llm_backdoor

Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to potentially execute offline remote code execution without running a...

backdoor-attacks llm-security qwen2-5

Python 124

1 个月前

ZenGuard-AI / fast-llm-security-guardrails

The fastest && easiest LLM security guardrails for CX AI Agents and applications.

llm-security 安全

Python 120

1 个月前

Repello-AI / whistleblower

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and...

ai-security llm-security prompt-engineering

Python 113

7 个月前