Marker
Simulation and eval platform for voice and chat agents, deployable hosted, in your VPC, or air-gapped on-prem
0About Marker
Marker is an evaluation platform for voice and chat agents, with deployment flexibility as its main structural bet. It runs two loops. The first improves the agent: connect the version you are changing, exercise it with real traffic and lifelike simulations, evaluate every transcript against the same set of Markers, then fix the prompt, tools, model or workflow. The second loop improves the measurement itself, which is the part most eval products skip — route the right machine evaluations to humans for review, capture a label a human will stand behind, measure judge agreement against that label on the same coordinate, and refine the judges, simulations and monitors accordingly. Both rule-based and LLM-judge markers are supported, and voice simulation is a first-class capability rather than chat evaluation with audio bolted on. The deployment story is the differentiator for regulated buyers: the same image set runs hosted by Marker, inside your own VPC where transcripts, audio and evidence never leave your account and access controls, or fully on-premises beside private systems and models, with a zero-egress air-gapped mode as a stated first-release target for self-managed installs. Moving between modes does not require changing product. Enterprise installs ship signed images, a Helm chart and an offline licence, and support bring-your-own identity provider and models. Every plan gets the full platform with no feature gates — the tiers differ only by included credits and by where the software runs.
Does ChatGPT recommend your AI tool?
If you're building in AI Security & Testing, run a free AI-visibility scan on your own product — we ask ChatGPT across 5 prompt angles and score how often you get named. ~30 seconds, no signup, no card.
Key Features
Marker Pros & Cons
✅ Pros
- +Evaluating the evaluators is a loop almost no competitor implements explicitly
- +No feature gates — the cheapest plan is the whole product
- +VPC and on-prem paths make it viable where transcripts cannot leave the building
⚠️ Cons
- −$250/month entry price rules out solo builders and side projects
- −No free or trial tier published — every plan routes through Book Demo
- −Air-gapped mode is a stated target rather than a shipped feature
Tags
Is Marker your tool?
This is the page buyers and AI assistants read when they look up Marker. Claim your listing for $19 one-time — no subscription, nothing to cancel — and take a capped slot in your category: each one sells a fixed number, and yours ranks above every free tool in it, with a Featured badge. Prefer it ongoing? Monthly is one click away on the next page.
Complete Your Security Stack
Other security tools in our catalog:
1Password
Try FreeSecrets and credential manager
Keep API keys and .env secrets out of your repo
Gamma
Try FreeAI presentation builder
Turn ideas into polished decks instantly
AdCreative.ai
Try FreeAI-powered ad creatives
Generate marketing visuals in seconds
💰 Affiliate disclosure: We may earn a commission if you sign up through these links at no extra cost to you.
Stay updated on AI Security & Testing tools — join our weekly newsletter
One concise email with fresh launches, trending picks, and featured standouts.
Alternatives to Marker
View all Marker alternatives →More AI Security & Testing tools
Agentmetry
Local, open-source flight recorder that tags AI agent activity with MITRE ATT&CK
Trestle
Local secret scanner with an MCP server so coding agents check their own output
Tracecat
Open-source SOAR for AI-native security teams — agents, cases, and workflows with human approval gates
MCP Skills
Trust scores and monitoring for MCP servers and agent skills, checked before you install
Monitor Test
Free online monitor test suite for dead pixels, backlight bleed, gamma, contrast and screen uniformity checks.
NotSoHuman - EU AI Act Website Scanner
Scan your website for AI compliance.
Agent connectivity: not yet verified