RL environments and simulation
Builders of reinforcement learning environments and simulations.
Our coverage
Expert network Guidepoint launches Guidepoint Labs to sell expert data to AI labs
The unit ran in stealth for more than six months and says it already works with frontier labs. It draws on Guidepoint's network of more than 2 million advisors.
Scale AI's $12.5 million contractor settlement still shows no final approval
The California class covers Outlier and Remotasks contributors from Dec. 2020 to Feb. 2026. Up to $4.17 million can go to lawyers' fees.
Mercor posts $350 an hour for cardiologists to train AI
micro1 listed about 350 expert roles on Nov. 17. Outlier posts no hourly rate.
Mercor asks Texas court to send contractor misclassification suit to arbitration
Heidi White's suit says Mercor paid AI training experts as contractors on 1099s. Mercor's amended motion is pending.
Judge approves Google's $10 million purchase of Spirit Airlines data
Judge Sean Lane ruled from the bench on Nov. 17 after Google agreed to added privacy protections, Reuters reported. Mercor was the $7.5 million alternate bidder.
Mercor hires Jason Wei, formerly of Meta's TBD lab, as chief scientist
The expert-data company announced the hire a week after its $750 million Series D. Wei created benchmarks including SimpleQA.
Companies (131), by published funding
Figures as published by each company or the source on its profile. n/a means no source found.
| Company | What it does | Based in | Funding | Partner program |
|---|---|---|---|---|
| Scale | Data-partnerships program for company data. Use the public program page, not outdated deal rumors. | United States | $15.9B | Yes |
| Applied Intuition | Simulation and autonomy software company serving automakers, defense buyers and other teams building machines that drive or fly themselves. | United States | $1.2B | n/a |
| Snorkel | Snorkel AI. Expert-built datasets, agent environments, benchmarks and evals, sold as products and custom services. | United States | $587M | n/a |
| Mercor | Expert-data vendor. Alternate bidder at $7.5 million in the Spirit Airlines de-identified data auction, per Business Insider. | United States | $483.6M | Yes |
| Handshake | Employer data-partnerships program; licenses professional documents, per the public page. | United States | $435.5M | Yes |
| Lightwheel | Sells physics-accurate simulation assets, demonstration data and validation tools to robotics teams. | United States | $293M | n/a |
| Alice | The former ActiveFence. Sells safety and security datasets, RL environments and red teaming to model labs, plus guardrail and moderation software. | Israel | $280M | n/a |
| Bugcrowd | Crowdsourced security testing company that also offers AI developers cyber training environments and an exploitation benchmark. | United States | $230M | n/a |
| Turing | Training data, evals and RL environments for coding, knowledge work and STEM, plus enterprise agent deployment. | United States | $225M | Yes |
| Labelbox | Labeling platform company that now sells RL environments, expert preference data and evals to frontier labs. | United States | $189M | No |
| Prime Intellect | Open stack covering RL environments, evals, hosted training and inference, sandboxes and GPU rental. | United States | $150M+ | n/a |
| Invisible Technologies | Supplies expert training data, fine-tuning, evals and custom RL environments, plus enterprise AI services. | United States | $144M | n/a |
| micro1 | Expert network and company-data program (Data Payout). Take rates, when quoted, come from its public program page. | United States | $135M+ | Yes |
| Toloka | Human expert and synthetic data, agent environments, evals and red teaming for labs and developers. | Netherlands | $72M | n/a |
| Patronus AI | AI evaluation company that now builds simulated environments and training data, backed by research into where models fail. | United States | $70M | Yes |
| SuperAnnotate | AI data platform plus managed expert services for labeling, training data, evals and RL environments. | United States | $67.5M | No |
| Centific | Provides multimodal training data, annotation, evals and simulated enterprise RL environments to labs and corporate AI teams. | United States | $60M | No |
| Fleet | Sells simulated practice environments and evaluation tools for AI agents to labs, cloud providers and enterprises. | United States | $60M | n/a |
| Mind Lab | Builds custom benchmarks, task environments and post-training for pharma, finance, public sector and gaming clients. | Singapore | $60M | n/a |
| e2f | Renamed TrustScale in 2026. Sells custom datasets, expert labeling, evals and RL feedback through its ArgusRL platform. | United States | $50M | n/a |
| Deeptune | Built simulated workplace software environments for training agents on multi-step digital work. Acquired by Mercor in 2026. | United States | $46.1M | n/a |
| Revelo | Developer talent firm selling code-focused training data, evals, benchmarks and RL environments. | United States | $46M | n/a |
| Vals AI | Evaluation software, expert benchmarks and review tools for testing models on practical domain tasks. | United States | $45M | n/a |
| Bespoke Labs | Builds company-scale RL environments and agent training and evaluation infrastructure for frontier labs and enterprises. | United States | $40M | n/a |
| Halluminate | Sells finance-focused computer-use RL environments, simulated business apps, data and agent benchmarks. | United States | $38.5M | n/a |
| AfterQuery | Sells AI labs and enterprises a mix of expert-made and synthetic datasets, RL environments and custom evals. | United States | $30.5M | Yes |
| Moonlake AI | Turns text prompts or real-world captures into 3D simulation environments for robotics and autonomy research. | United States | $28M | n/a |
| Deccan AI | Supplies expert post-training data, human feedback, RL environments and evals, plus enterprise AI operations services. | United States | $25M | n/a |
| Taste Labs | Preference and reasoning data and eval environments for design quality, plus a Brand API for developers. | United States | $18.5M | n/a |
| Pareto | Specialist-made training data, evals and RL environments for frontier labs. | United States | $17.8M | n/a |
| Datacurve | Expert coding data vendor offering RL environments, benchmarks and evals to model labs and developer tool companies. | United States | $17.7M | n/a |
| HUD | Developer kit and cloud service for creating, running and scoring RL environments, plus a marketplace where vendors sell them. | United States | $16M | n/a |
| Preference Model | Builds RL environments that train models on machine learning research and engineering tasks. | United States | $16M | n/a |
| Midcentury | Sells human action and gameplay datasets and cloud simulation tools to physical AI developers. | United States | $15M | n/a |
| Million | Research lab building front-end coding data, RL environments and evals, including the ReactBench benchmark. | per its Y Combinator profile and SEC filing | $14.15M over 3 rounds, per CB Insights | n/a |
| General Reasoning | Hosts RL environments behind an API, plus infrastructure to deploy them and to train or test agents at scale. | United Kingdom | $10.9M | n/a |
| Arga Labs | Builds stateful copies of business software so agent developers can train and test against realistic workflows safely. | United States | $10.5M | n/a |
| Chakra Labs | Writes expert task sets and graders, including computer-use environments, for model training and testing in finance, law and other fields. | United States | $10.1M | n/a |
| BioStack Platforms | Sells clinical and preclinical data, healthcare training environments and eval tools to medical and drug discovery AI teams. | United States | $10M | n/a |
| Collinear | Sells simulated environments, agent evals and synthetic training data to labs and enterprise teams building agents. | United States | $10M | No |
| Idler | Sells RL environments, benchmarks and eval sets built from real production work. | United States | $9.5M | n/a |
| Mechanize | Builds simulated software engineering tasks and graded benchmarks for frontier labs training coding agents. | United States | $9.1M | n/a |
| Incalmo | Builds RL cyber ranges and security evals for training and testing cybersecurity-capable models. | United States | $8.7M | n/a |
| Veris AI | Simulation and RL platform that mimics enterprise systems and the people who use them, for agent training and testing. | United States | $8.5M | n/a |
| Polymath | Builds environments, tasks and verifiers for long-horizon agents, including the Horizon-SWE benchmark. | United States | $8M | n/a |
| Runloop | Development sandboxes, orchestration and benchmarking tools for building and tuning coding agents. | United States | $7M | n/a |
| Aptura | Produces expert training and eval data, benchmarks and RL environments for finance, healthcare and legal AI. | United Kingdom | $6.7M | n/a |
| Huzzle Labs | Sells RL environments, expert data, evals and custom models for agents that handle real business software. | United Kingdom | $5.98M | n/a |
| Phinity | Builds chip design RL environments and training infrastructure while developing its own chip design agents. | United States | $5.5M | n/a |
| Matrices | Builds simulated computer-use environments where agents practice browser and office tasks. | United States | $5M | n/a |
| Vetto AI | Sells labs expert-written post-training data, human evaluation work, custom RL environments and verifier-scored benchmarks. | United States | $3.64M | n/a |
| Good Start Labs | RL environments built on video games, plus gameplay training data and public benchmarks. | United States | $3.6M | n/a |
| Paper Instruments | Research shop that fine-tunes language models for knowledge-heavy work and builds the evals, tooling and agent software around them. | United States | $3.6M | n/a |
| Besimple AI | Supplies licensed conversational audio, expert labeling and benchmarks to teams building speech and voice models. | United States | $3.5M | n/a |
| Plato | Builds simulated software environments from real data for training and scoring browser and computer-use agents. | United States | $2.5M | n/a |
| Vibrant Labs | RL-ready simulated environments, tasks and benchmarks for browser, computer and enterprise agents. | United States | $2.5M | n/a |
| Quesma | Publishes coding agent benchmarks, builds RL environments, and sells agent cost and workflow analytics. | Poland | $2.3M | n/a |
| Synthetic Sciences | AI research workbench for literature review, experiments and drafting, plus scientific evals. | United States | $1.9M | n/a |
| BenchFlow | Builds simulated workflow environments and benchmarks for agents, and also runs post-training as a managed service on its own runtime. | United States | $1M | n/a |
| Sticker | Builds RL environments and benchmarks for procurement work such as backorders and invoice mismatches. | United States | $1M | n/a |
| Emulated | Provides post-training data, production-style engineering environments and benchmarks for coding and ops agents. | United States | $850K | n/a |
| Abundant | Builds reinforcement learning environments, benchmarks and datasets for labs and companies working on AI agents. | United States | $500K | n/a |
| Andon Labs | Builds custom evals and benchmarks that put AI agents through simulated and real business, spatial and robotics tasks. | United States | $500K | n/a |
| Archal | Sells resettable sandboxes that imitate third-party software APIs so teams can train and test agents without live accounts. | United States | $500K | n/a |
| Aviro | Sells RL environments, post-training data and evals for long-running agents across coding, computer use and office work. | United States | $500K | n/a |
| Cua | Agent infrastructure company offering desktop sandboxes and runtimes for computer use, plus RL environments, benchmarks and trajectory data. | USA | $500K | n/a |
| CueBench | Builds RL environments and benchmarks on hard science reasoning and performance engineering problems. | United States | $500K | n/a |
| dmodel | Builds RL environments where agents practice interpretability and alignment research. | United States | $500K | n/a |
| EdotEnv | Offers RL environments and benchmarks built on financial markets for quantitative research agents. | United States | $500K | n/a |
| Enact | Finds where robot models fail on real hardware, records recovery demos, and fine-tunes and evaluates the models. | United States | $500K | n/a |
| Hillclimb | Frontier lab supplier of math RL environments and fine-tuning examples written by expert problem solvers. | United States | $500K | n/a |
| hiloop | Sells automated research infrastructure that runs experiments against a customer's own evals and reports results. | United States | $500K | n/a |
| Magma | Collects approved agent interaction traces and corrections from companies, anonymizes them and licenses them as data. | United States | $500K | n/a |
| Maingen | Builds industrial operations simulations and RL environments, such as running solar portfolios or factories. | United States | $500K | n/a |
| Markov | Sells computer-use datasets and environments built from expert CAD, office, coding and gaming workflows. | United States | $500K | n/a |
| Monte | Infrastructure for continual learning and post-training, used to test models on work tasks and improve specialized agents. | United States | $500K | n/a |
| Ooak Data | Y Combinator company that describes turning internal company data into a training ground for AI agents. | France | $500K | No |
| Refresh | Simulated software environments, verifiable evals and real-workflow coding data for agent training. | United States | $500K | n/a |
| TensorTest | Private evals, RL environments and expert data for creative agents, starting with video editing (TimelineBench). | United States | $500K | n/a |
| Theta | Builds custom simulations of business workflows and helps labs and enterprises train specialized agents on them. | United States | $500K | n/a |
| Traverse | RL environments and data for training models on judgment-heavy, long-horizon professional work. | United States | $500K | n/a |
| Vmax | Markets Campaign, a self-play platform that builds training environments from a developer's own data and evals. | United States | $250K | n/a |
| AIChamp | Runs robot policies through simulated environments and physics-checked tests, then reports scores, recordings and failure analysis to robotics teams. | United States | n/a | n/a |
| AITraining.jobs | Expert data shop run by O-mega Enterprise that staffs US professionals on evals, rubrics, preference data and RL tasks for AI developers. | Delaware) | n/a | n/a |
| Align AI | Supplies expert data, simulated RL environments, ongoing evals and runtime checks for agents built for regulated work. | United States | n/a | n/a |
| Andromede | Turns real-world data into tasks, verifiers and RL environments used to train and test agents on long jobs. | Switzerland | n/a | n/a |
| Appen | Human data vendor. Labs and product teams buy its labeling, expert review, model evaluation and RL environment work. | Australia | Public | No |
| Archangel Health | Medical AI data vendor offering EHR sandbox RL environments, physician-written answers and rubrics, de-identified clinical data and labeling. | per its site (Y Combinator lists San Francisco) | n/a | n/a |
| ARIMLABS | Creates simulated workspaces and verifiable benchmarks for agents doing security, incident response and software tasks. | Poland | n/a | n/a |
| Autelica | Scans real robot deployment sites with drones or cameras and turns them into simulations for MuJoCo or Isaac Lab, sold through paid pilots. | per its site | n/a | n/a |
| DARE Labs | Sells Cerebro, software that turns company operational data into training sets, RL data and outcome-graded environments. | United States | n/a | n/a |
| DecisionFacts | Runs custom robot data collection with trained operators recording teleoperated and handheld manipulation demos. | per its site | n/a | n/a |
| Diffuse Labs | Builds RL environments with generated tasks and checkable rewards in areas like coding and chip design. | United States | n/a | n/a |
| Dissei | Finance-focused vendor selling RL environments, benchmarks, transaction data and analyst trajectories. | n/a | n/a | n/a |
| Eigent AI | Open-source multi-agent desktop software maker that also builds custom RL environments and benchmarks for enterprises. | United Kingdom | n/a | n/a |
| Exabite | Supplies large pretraining and post-training corpora, including code, documents and video, plus STEM RL environments. | United States | Self-funded | n/a |
| exponential | Sells multi-agent security environments, security training data and adaptive red team testing. | Germany | n/a | n/a |
| FasterLabeling | Vira Hub LLC brand that builds made-to-order RL environments with programmatic graders, shipped as Docker images. | is a Wyoming limited liability company) | n/a | n/a |
| Foundry AI | Creates expert-reviewed coding and technical workflow data, RL task suites and private evals. | India | n/a | n/a |
| FS Studio | Flakasoft Inc. brand running robot data collection, including teleoperation floors and handheld gripper demos. | per its site | n/a | n/a |
| G2i | Runs managed coding data projects and places contract engineers inside lab teams for post-training work. | United States | Self-funded | n/a |
| HyperPrior Research | Small London firm building environments, graders and agent test suites on fixed-scope or retainer terms. | United Kingdom | Self-funded | n/a |
| Innodata | Data engineering firm supplying training data, human feedback, RL environments, evals and red teaming. | United States | n/a | n/a |
| Metaphi | Builds simulated workplaces, custom or off the shelf, along with datasets and evals for agent training. | United States | n/a | n/a |
| Noumad | Builds formally verified RL environments on open problems in machine learning, science, robotics and security. | United States | n/a | n/a |
| Olam Labs | Builds multi-agent simulations, behavioral evals and game-based data for studying social and safety behavior. | United States | n/a | n/a |
| Panoptive | Makes clinical trial operations agents and publishes ClinOpsBench, a simulated trial oversight environment. | per its YC page | n/a | n/a |
| pre.dev | Sells graded coding environments and data built from licensed private code repositories. | United States | n/a | n/a |
| Proximal | Builds coding tasks, data and RL environments for training software engineering agents. | United States | n/a | n/a |
| Raycaster | Eval programs, data and reproducible environments for agents working in documents and spreadsheets. | United States | n/a | n/a |
| ReadySolve | Licenses MartechBench, a marketing workflow environment for RL and evaluation with deterministic checks. | n/a | n/a | n/a |
| ReasonCore | Expert-curated datasets, RL environments and adaptive evals for labs and enterprises. | n/a | n/a | n/a |
| Redpine | Swedish company licensing non-public data from publishers and research firms and reselling access to AI builders. | per its site | n/a | n/a |
| Rise Data Labs | Human and synthetic data production, labeling and evaluation services for generative AI teams. | United States | n/a | n/a |
| RL Labs | Makes multi-step coding environments that run for a long time, used by frontier labs to train models on complex engineering work. | n/a | n/a | n/a |
| Sepal AI | Expert training and eval data, benchmarks and RL environments for frontier and enterprise model teams. | United States | n/a | n/a |
| Sherpa Labs | San Francisco builder of coding and finance RL environments, with tasks written by senior engineers and private equity professionals. | United States | n/a | n/a |
| Sieve | Supplies curated or freshly collected video, audio, images and interaction data, with labels, eval sets and environments. | United States | n/a | n/a |
| Surge | Human-data and RLHF vendor. | United States | n/a | n/a |
| Symbal | Multimodal post-training data, private evals and human-in-the-loop data for labs, plus enterprise agents. | United States | n/a | n/a |
| Tacit Labs | Expert-written life science evals, agent environments and datasets for biology and chemistry work. | United States | n/a | n/a |
| TELUS Digital | TELUS unit supplying expert data, labeling, RL environments, red teaming, evals and physical AI datasets. | Canada | Public | n/a |
| The General Data Company | Brokers anonymized operating records and workflow data from European companies to AI labs. | USA | n/a | Yes |
| Theta Lab | On-premises agent training stack that turns a customer's production traces into private RL environments. | United States | n/a | n/a |
| Tiki AI | Custom post-training data for frontier teams: coding RL environments, computer-use fine-tuning sets and tool-use environments. | per its site | n/a | n/a |
| Trajectory Labs | Safety evals, expert red teaming and RL environments for finding and fixing model vulnerabilities. | United States | n/a | n/a |
| Twinbay | Sells hand-built stateful copies of APIs such as Stripe, HubSpot and GitHub as agent environments. | Delaware address) | n/a | n/a |
| Uber AI Solutions | Uber's AI data arm: collection, labeling, specialist RLHF, red teaming and evals for labs and robotics firms. | United States | n/a | n/a |
| Ulam | Math and STEM focused vendor of reasoning data, expert-checked solution traces, benchmarks and RL environments with verifiers. | Poland | n/a | n/a |
| Verita AI | Supplies vetted domain experts and project operations for labeling, feedback, eval and RL environment work. | United States | n/a | n/a |
| Xplore AI | Expert-designed RL environments and evals for mechanical, electrical and aerospace engineering, including RWE-bench. | n/a | n/a | n/a |