awesome-MLSecOps
A curated list of MLSecOps tools and resources for securing machine learning and AI systems - adversarial ML defense, LLM security, AI red teaming, model scanni
What is awesome-MLSecOps?
A curated list of MLSecOps tools and resources for securing machine learning and AI systems - adversarial ML defense, LLM security, AI red teaming, model scanning, supply-chain protection, and MLOps pipeline security.
Overview of awesome-MLSecOps
What it is
awesome-MLSecOps is a curated directory of open-source tools, research, and resources for securing machine learning and AI systems. It covers adversarial ML defense, LLM security, AI red teaming, model scanning, supply-chain protection, and MLOps pipeline security. The repository is maintained by the author of The MLSecOps Hacker newsletter and is intended as a catalog for security engineers, ML practitioners, developers, and AI red teams.
Key features
- The readme states the catalog is a curated list of MLSecOps tools and resources.
- It includes sections on open-source security tools, commercial tools, data privacy, and ML code security.
- It covers model and artifact security, adversarial ML testing, LLM security and red teaming, and AI agent security.
- It also lists resources for threat modeling, attack vectors, blogs, MLOps infrastructure vulnerabilities, and community resources.
- It provides a table of open-source tools with descriptions for each.
- It includes a section on rogue agents and autonomous agent security.
Use cases
Security engineers can use the curated list to discover tools for testing, monitoring, and protecting machine learning models, data, pipelines, LLM applications, and AI agents. ML practitioners and developers can find resources for adversarial robustness testing, model serialization security, and AI agent runtime security. AI red teams can identify red-teaming tools for LLMs and autonomous agents.
Getting started
See the repository README.
License and pricing
The metadata states the license is MIT. The pricing type is listed as open source.
Based on the project's public README and repository metadata.