llm-security · GitHub Topics

#大语言模型#Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook 23.3 k

2 天前

Giskard-AI / giskard

#大语言模型#🐢 Open-Source Evaluation & Testing for AI & LLM systems

mlops ml-validation ml-testing llmops responsible-ai fairness-ai llm-eval llm-evaluation rag-evaluation ai-security llm-security ai-red-team red-team-tools 大语言模型

Python 4.47 k

2 天前

NVIDIA / garak

the LLM vulnerability scanner

人工智能 llm-evaluation llm-security security-scanners vulnerability-assessment

Python 4.27 k

2 天前

verazuo / jailbreak_llms

#大语言模型#[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

ChatGPT jailbreak 大语言模型 prompt large-language-model llm-security jailbreaking

Jupyter Notebook 3.06 k

4 个月前

protectai / llm-guard

#大语言模型#The Security Toolkit for LLM Interactions

large-language-models 大语言模型 ChatGPT 安全 adversarial-machine-learning prompt-engineering prompt-injection llmops llm-security transformers

Python 1.59 k

6 天前

msoedov / agentic_security

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

llm-security ai-red-team llm-evaluation llm-evaluation-framework prompt-testing agent-framework

Python 1.28 k

2 天前

mariocandela / beelzebub

#大语言模型#A secure low code honeypot framework, leveraging LLM for System Virtualization.

Cybersecurity research 安全 honeypot 框架低代码 Go research-project Kubernetes cloudnative cloudsecurity openai 大语言模型 llm-security llama3 ollama deception

Go 1.01 k

4 天前

EasyJailbreak / EasyJailbreak

An easy-to-use Python framework to generate adversarial jailbreak prompts.

large-language-model llm-security jailbreak

Python 622

17 天前

cyberark / FuzzyAI

#大语言模型#A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

jailbreak jailbreaking 大语言模型 llms 人工智能安全 Fuzzing/Fuzz testing llm-evaluation llm-security

Jupyter Notebook 495

11 天前

chawins / llm-sp

#Awesome#Papers and resources related to the security and privacy of LLMs 🤖

adversarial-machine-learning Awesome Lists 大语言模型 llm-security 隐私安全

Python 493

5 个月前

splx-ai / agentic-radar

#大语言模型#A security scanner for your LLM agentic workflows

agentic-ai agentic-framework agentic-workflow 人工智能 ai-security 命令行界面 devsecops 大语言模型 llm-security red-teaming 安全 generative-ai

Python 395

2 天前

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

llm-security prompt-injection adversarial-attacks adversarial-machine-learning large-language-models llmops yara-scanner 安全

Python 374

1 年前

R3DRUN3 / sploitcraft

🏴‍☠️ Hacking Guides, Demos and Proof-of-Concepts 🥷

Cybersecurity Hacking offensive-security proof-of-concept redteam 教程人工智能 Amazon Web Services cloud container-security Docker Linux llm-security network-security Python Windows

Jupyter Notebook 195

17 天前

liu00222 / Open-Prompt-Injection

#大语言模型#This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses

llm-security llms prompt-injection 大语言模型

Python 181

3 个月前

phantasmlabs / phantasm

#大语言模型#Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

ai-agents ai-safety ai-security automation-tools control-flow dashboard human-computer-interaction human-in-the-loop 大语言模型 llm-security llmops 监控 Open Source Rust

Svelte 162

5 个月前

sshh12 / llm_backdoor

Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to potentially execute offline remote code execution without running a...

backdoor-attacks llm-security qwen2-5

Python 153

8 天前

yevh / TaaC-AI

AI-driven Threat modeling-as-a-Code (TaaC-AI)

application-security devsecops gpt gpt-3 gpt-4 threat threat-modeling 人工智能 llm-security claude-3 mistral-7b

HTML 129

10 个月前

ZenGuard-AI / fast-llm-security-guardrails

The fastest Trust Layer for AI Agents

llm-security 安全 agentic-ai ai-agent ai-agents

Python 128

1 个月前

Repello-AI / whistleblower

Whistleblower is a offensive security tool for testing against system prompt leakage and capability discovery of an AI application exposed through API. Built for AI engineers, security researchers and...

ai-security llm-security prompt-engineering

Python 115

8 个月前

arekusandr / last_layer

Ultra-fast, low latency LLM prompt injection/jailbreak detection ⛓️

chatgpt-prompts jailbreak large-language-models llm-security prompt-engineering 安全 llm-local

Python 114

9 个月前