#44th of 4 in Security
ifixai
Python CLI that audits AI agents for policy, access and reliability failures
- Stars
- 24.2k
- License
- Apache-2.0
- Last commit
- Oct 2026
- Last release
- Oct 2026
- Language
- Python
Missed the latest GitHub check; these facts may be older.
Overview
iFixAi runs up to 60 inspections against a model or a deployed agent's HTTP endpoint and grades the answers with a separate judge model. The default run covers 10 checks, such as role-based tool access, prompt injection, privilege escalation and data leakage between users. It writes JSON and Markdown reports plus a terminal scorecard, and also ships as a Claude Code and Codex plugin and a skill for other agents.
Who it is for: Teams testing deployed AI agents for policy and access-control failures
Strengths
- Tests a real agent over its HTTP endpoint, not only a bare model API
- Default 10-check suite ends in a grade; --full-run covers all 60 inspections
- Citable grades use a judge from a different vendor than the system under test
- Runs from CLI, CI flags, a Claude Code/Codex plugin, or a skill for other editors
Weaknesses
- A citable grade needs two API keys from different vendors
- Full-suite judging costs roughly $10-18 per run, plus the agent's own bill
- Bundled default fixture has seeded defects, so a custom fixture is needed for real grades
- Full mode requires a hand-built fixture
What it needs
- no GPU
- Needs Python 3.10+, LLM provider API keys (system under test and judge), uv (for skill install)
- Models: OpenAI, Anthropic, Gemini, Azure, Bedrock
Head to head
Also in Security
See all 4| Rank | Project | Score |
|---|---|---|
| 1 | shannonAutonomous pentester that exploits web apps and APIs using source code analysis | 75 out of 100 |
| 2 | StrixAutonomous AI pentesting agents that validate vulnerabilities with working exploits | 74 out of 100 |
| 3 | pentagiAutonomous multi-agent penetration testing system with sandboxed security tools | 64 out of 100 |