39companies
$17Bpublished funding, 30 companies
2024median founding year
4with a partner program

Offerings: Evals and benchmarks (33), RL environments (31), Training data (31), Human data (21), Data annotation (9), RL infrastructure (5), Simulation (4).

Our coverage

Companies (39), by published funding

Figures as published by each company or the source on its profile. n/a means no source found.

CompanyWhat it doesBased inFundingPartner program
ScaleData-partnerships program for company data. Use the public program page, not outdated deal rumors.United States$15.9BYes
AliceThe former ActiveFence. Sells safety and security datasets, RL environments and red teaming to model labs, plus guardrail and moderation software.Israel$280Mn/a
TuringTraining data, evals and RL environments for coding, knowledge work and STEM, plus enterprise agent deployment.United States$225MYes
LabelboxLabeling platform company that now sells RL environments, expert preference data and evals to frontier labs.United States$189MNo
TolokaHuman expert and synthetic data, agent environments, evals and red teaming for labs and developers.Netherlands$72Mn/a
Patronus AIAI evaluation company that now builds simulated environments and training data, backed by research into where models fail.United States$70MYes
SuperAnnotateAI data platform plus managed expert services for labeling, training data, evals and RL environments.United States$67.5MNo
HalluminateSells finance-focused computer-use RL environments, simulated business apps, data and agent benchmarks.United States$38.5Mn/a
LuelLicenses multimodal datasets and runs paid contributor campaigns to collect rights-cleared audio, video and sensor data.United States$31.7Mn/a
AfterQuerySells AI labs and enterprises a mix of expert-made and synthetic datasets, RL environments and custom evals.United States$30.5MYes
Moonlake AITurns text prompts or real-world captures into 3D simulation environments for robotics and autonomy research.United States$28Mn/a
Deccan AISupplies expert post-training data, human feedback, RL environments and evals, plus enterprise AI operations services.United States$25Mn/a
HUDDeveloper kit and cloud service for creating, running and scoring RL environments, plus a marketplace where vendors sell them.United States$16Mn/a
PoseidonSells physical AI training data such as egocentric task video, robot manipulation, speech and motion capture.per its site$15Mn/a
Chakra LabsWrites expert task sets and graders, including computer-use environments, for model training and testing in finance, law and other fields.United States$10.1Mn/a
RunloopDevelopment sandboxes, orchestration and benchmarking tools for building and tuning coding agents.United States$7Mn/a
Huzzle LabsSells RL environments, expert data, evals and custom models for agents that handle real business software.United Kingdom$5.98Mn/a
MatricesBuilds simulated computer-use environments where agents practice browser and office tasks.United States$5Mn/a
DatoricLicenses robotics data such as first-person video and teleoperation recordings, and runs custom collections to spec.United States$4.5Mn/a
Vetto AISells labs expert-written post-training data, human evaluation work, custom RL environments and verifier-scored benchmarks.United States$3.64Mn/a
PlatoBuilds simulated software environments from real data for training and scoring browser and computer-use agents.United States$2.5Mn/a
Vibrant LabsRL-ready simulated environments, tasks and benchmarks for browser, computer and enterprise agents.United States$2.5Mn/a
AbundantBuilds reinforcement learning environments, benchmarks and datasets for labs and companies working on AI agents.United States$500Kn/a
Andon LabsBuilds custom evals and benchmarks that put AI agents through simulated and real business, spatial and robotics tasks.United States$500Kn/a
AviroSells RL environments, post-training data and evals for long-running agents across coding, computer use and office work.United States$500Kn/a
CoarenaHosts a public site where people compare two computer-use agents on the same task, and sells the vote data to AI labs.per its site (San Francisco per its Y Combinator profile)$500Kn/a
CuaAgent infrastructure company offering desktop sandboxes and runtimes for computer use, plus RL environments, benchmarks and trajectory data.USA$500Kn/a
MarkovSells computer-use datasets and environments built from expert CAD, office, coding and gaming workflows.United States$500Kn/a
RefreshSimulated software environments, verifiable evals and real-workflow coding data for agent training.United States$500Kn/a
ThetaBuilds custom simulations of business workflows and helps labs and enterprises train specialized agents on them.United States$500Kn/a
Consequence LabsProduces custom human data such as workflow demos, speech, expert judgments and labels, recruiting and managing contributors.n/an/an/a
DeepLLMDataXlairs Inc. brand making expert training and eval data, including repository-level coding trajectories with tests.per its site; it also lists Mumbai and Delhin/an/a
FasterLabelingVira Hub LLC brand that builds made-to-order RL environments with programmatic graders, shipped as Docker images.is a Wyoming limited liability company)n/an/a
InnodataData engineering firm supplying training data, human feedback, RL environments, evals and red teaming.United Statesn/an/a
Olam LabsBuilds multi-agent simulations, behavioral evals and game-based data for studying social and safety behavior.United Statesn/an/a
OriginatorEarly-stage company with a waitlist, aiming to build data that teaches AI to run legacy software.n/an/an/a
RL LabsMakes multi-step coding environments that run for a long time, used by frontier labs to train models on complex engineering work.n/an/an/a
SieveSupplies curated or freshly collected video, audio, images and interaction data, with labels, eval sets and environments.United Statesn/an/a
Tiki AICustom post-training data for frontier teams: coding RL environments, computer-use fine-tuning sets and tool-use environments.per its siten/an/a