EVALUATION STUDIO
Test it before it ships.
For the teams who stopped trusting the eval script.
FOR AI LABS · AURAONE PRODUCT
Frontier labs run on this.
Every model has a story. This is where it gets written.
PEOPLE
Human Data OS
Workforce, Cleo, Annotation.
STACK
14 modules
Eval, review, memory, release, compliance — one record.
OUTPUT
One record
Every decision, always attached.
AI LABS OPERATING SYSTEM
Every module shares one evidence spine.
Evaluation, human review, and model workflows stay separate enough for teams to own them, but connected enough for one release decision.
Evaluation OS
5 modules
Score, replay, release
- ·Evaluation Studio
- ·AuraQC
- ·Regression Bank
- ·Compliance Monitoring
- ·Control Center
Human Data OS
3 modules
Route expert work
- ·Workforce
- ·Cleo
- ·Annotation
Model OS
5 modules
Automate, train, simulate
- ·Autopilot
- ·Training
- ·Synthetic Populations
- ·RL Environments
- ·Federated Learning
SHARED SPINE
● Evidence● Control● Compliance
● ATTACHED · RELEASE OWNER · LIVE NOW
01→
One record
↳ Attached
02→
Signed evidence
↳ Release owner
03→
Release gate
↳ Live now
04
Export pack
↳ Customer-owned
EVALUATION OS · SCORE, REPLAY, RELEASE
Test the work. Review it. Remember what escaped.
Release it with the proof attached. Access, audit, retention, and exports live inside the workflow.
EvaluationReleaseProof
See the page →
AURAQC
Quality that doesn't end at ship day.
Every issue. Every reviewer. One screen.
BASELINE / CANDIDATE● GATE CLEAR
BASELINE
fail
fail
fail
fail
CANDIDATE
pass
pass
pass
pass
Risk −18Rubric 94SIGNED VERDICT
REGRESSION BANK
Every mistake. Only once.
Every escaped failure becomes a gate the next release cannot cross.
COMPLIANCE MONITORING
Compliance that writes itself.
The record builds as the work is done. Access, audit, retention, and exports live here too.
SIGNED PROOF● SEALED
Rubric142 cases
Reviewer19 overrides
Checksumsha256:7fa9…
EvidenceEP-4187
EVALREVIEWPOLICYRELEASE
SIGNED
EP·4187
EP·4187
Signed at release gate · EP-4187
CONTROL CENTER
The last check before it ships.
Tests, reviews, regressions, and compliance converge here.
OVERVIEW
The stack, on one page.
Start here. Every module, every group, one scroll.
HUMAN DATA OS · ROUTE EXPERT WORK
The people behind the models.
AuraOne Human Data OS. One system. One purchase order. One record.
WorkforceReviewHiring
WORKFORCE
The people behind every model.
One contract. One record. One bench of reviewed specialists deployed onto annotation, review, and approvals.
CLEO
Find the right mind. Interview them on the spot.
Reads the brief. Returns a ranked shortlist with fit reasons. Runs outreach. Conducts the structured interview with live rubric scoring.
ANNOTATION
Labels that don't end at delivery.
Labeling alone does not tell you whether a release should ship.
MODEL OS · AUTOMATE, TRAIN, SIMULATE
Describe the workflow. Train on the reviewed work.
Simulate. Learn together. Keep the updates without sharing the data.
AutopilotTrainingRL
AUTOPILOT
Describe it. Watch it run.
Workflows that build themselves — and wait for the approval you set.
SIGNED PROOF● SEALED
Rubric142 cases
Reviewer19 overrides
Checksumsha256:7fa9…
EvidenceEP-4187
EVALREVIEWPOLICYRELEASE
SIGNED
EP·4187
EP·4187
Signed at release gate · EP-4187
TRAINING
Your model. Yours to keep.
Train on reviewed work. Keep the tuned weights. Export the record.
SYNTHETIC POPULATIONS
Test it on a world that looks like yours.
A simulation layer. Not a substitute for real-world validation.
RL ENVIRONMENTS
Environments built by the people who use them.
Reviewed once. Approved once. Available to every team that needs them.
FEDERATED LEARNING
Learn together. Keep it separate.
Share the updates. Not the data.
ONE RECORD
A signal becomes a decision without losing context.
An evaluation miss can become a regression case, reviewer assignment, compliance finding, and release hold without becoming five separate stories.
SIGNAL · DECISION GRAPH
● LIVE
Failure to release hold
REVIEW · REGRESSION BANK
● GATE CLEAR
Saved regression
BASELINE / CANDIDATE● GATE CLEAR
BASELINE
fail
fail
fail
fail
CANDIDATE
pass
pass
pass
pass
Risk −18Rubric 94SIGNED VERDICT
DECISION · SIGNED PROOF
● SEALED
Decision evidence
SIGNED PROOF● SEALED
Rubric142 cases
Reviewer19 overrides
Checksumsha256:7fa9…
EvidenceEP-4187
EVALREVIEWPOLICYRELEASE
SIGNED
EP·4187
EP·4187
Signed at release gate · EP-4187
One record · One context · One decision.
WHAT COMES OUT
What teams leave with.
The point is not more tooling. It is leaving every run with something the team can act on.
01
Scorecards
One read on what passed, what failed, and what needs another look.
↳ ARTIFACT
02
Review records
The case, the reviewer notes, and the final call stay together.
↳ ARTIFACT
03
Replay suites
Escaped issues become repeatable checks the next release must pass.
↳ ARTIFACT
04
Decision timelines
What changed. Who approved it. Whether the work moved forward.
↳ ARTIFACT
05
Evidence packets
Checks, history, and proof — ready when someone asks.
↳ ARTIFACT
FOR AI LABS
Frontier labs run on this.
Bring the release, review queue, interview loop, or escaped issue that matters most. We will show how it runs.