InnerVault

OpenART

Stale GitHub, AI45Lab

OpenART is an open-source framework designed to evaluate the safety and robustness of autonomous AI agents in dynamic, long-horizon, and stateful environments. It stress-tests agent runtimes against multi-step state poisoning, privilege escalation, and tool-use vulnerabilities across 10,000+ benchmark scenarios.

Open the source (opens github.com) https://github.com/ai45lab/openart

What it is

Skills from AI45Lab.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/AI45Lab/OpenART.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. skill-up

    Skills

    Evaluate Agent Skills and environments. Evolve Skills with evidence.

    Indexed GitHub, alibaba 1,476 ★Apache-2.0Updated today

    git clone https://github.com/alibaba/skill-up.git
  2. Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Indexed GitHub, NVIDIA 1,963 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA/SkillEvaluator.git
  3. kasetto

    Skills

    📼 Declarative AI agent environment manager, written in Rust

    Indexed GitHub, pivoshenko 218 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/pivoshenko/kasetto.git
  4. coder_eval

    Skills

    Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.

    Indexed GitHub, UiPath 160 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/UiPath/coder_eval.git
  5. fable-method

    Skills

    The Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.

    Stale GitHub, Sahir619 2,300 ★MITUpdated 44 days ago

    git clone https://github.com/Sahir619/fable-method.git
  6. Build evals from traces, code, and coding sessions, then measure and improve AI agent behavior, including your coding agents

    Indexed GitHub, relai-ai 14 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/relai-ai/agent-eval-loop.git