Coding
Software engineering and coding agents.
Offerings: Evals and benchmarks (63), RL environments (60), Training data (59), Human data (41), Data annotation (18), RL infrastructure (9), Simulation (5).
Our coverage
Expert network Guidepoint launches Guidepoint Labs to sell expert data to AI labs
The unit ran in stealth for more than six months and says it already works with frontier labs. It draws on Guidepoint's network of more than 2 million advisors.
Scale AI's $12.5 million contractor settlement still shows no final approval
The California class covers Outlier and Remotasks contributors from Dec. 2020 to Feb. 2026. Up to $4.17 million can go to lawyers' fees.
Mercor posts $350 an hour for cardiologists to train AI
micro1 listed about 350 expert roles on Nov. 17. Outlier posts no hourly rate.
Mercor asks Texas court to send contractor misclassification suit to arbitration
Heidi White's suit says Mercor paid AI training experts as contractors on 1099s. Mercor's amended motion is pending.
Judge approves Google's $10 million purchase of Spirit Airlines data
Judge Sean Lane ruled from the bench on Nov. 17 after Google agreed to added privacy protections, Reuters reported. Mercor was the $7.5 million alternate bidder.
Mercor hires Jason Wei, formerly of Meta's TBD lab, as chief scientist
The expert-data company announced the hire a week after its $750 million Series D. Wei created benchmarks including SimpleQA.
Companies (80), by published funding
Figures as published by each company or the source on its profile. n/a means no source found.
| Company | What it does | Based in | Funding | Partner program |
|---|---|---|---|---|
| Scale | Data-partnerships program for company data. Use the public program page, not outdated deal rumors. | United States | $15.9B | Yes |
| Snorkel | Snorkel AI. Expert-built datasets, agent environments, benchmarks and evals, sold as products and custom services. | United States | $587M | n/a |
| Mercor | Expert-data vendor. Alternate bidder at $7.5 million in the Spirit Airlines de-identified data auction, per Business Insider. | United States | $483.6M | Yes |
| Arena | Model evaluation business built on large-scale human preference voting, sold to labs, enterprises and developers. | United States | $450M | n/a |
| Alice | The former ActiveFence. Sells safety and security datasets, RL environments and red teaming to model labs, plus guardrail and moderation software. | Israel | $280M | n/a |
| Turing | Training data, evals and RL environments for coding, knowledge work and STEM, plus enterprise agent deployment. | United States | $225M | Yes |
| Labelbox | Labeling platform company that now sells RL environments, expert preference data and evals to frontier labs. | United States | $189M | No |
| Claru | Supplies custom and licensed video, robot demonstrations and annotation for robotics and world model work. | United States | $170M | n/a |
| Prime Intellect | Open stack covering RL environments, evals, hosted training and inference, sandboxes and GPU rental. | United States | $150M+ | n/a |
| Invisible Technologies | Supplies expert training data, fine-tuning, evals and custom RL environments, plus enterprise AI services. | United States | $144M | n/a |
| micro1 | Expert network and company-data program (Data Payout). Take rates, when quoted, come from its public program page. | United States | $135M+ | Yes |
| Toloka | Human expert and synthetic data, agent environments, evals and red teaming for labs and developers. | Netherlands | $72M | n/a |
| Patronus AI | AI evaluation company that now builds simulated environments and training data, backed by research into where models fail. | United States | $70M | Yes |
| SuperAnnotate | AI data platform plus managed expert services for labeling, training data, evals and RL environments. | United States | $67.5M | No |
| Revelo | Developer talent firm selling code-focused training data, evals, benchmarks and RL environments. | United States | $46M | n/a |
| Vals AI | Evaluation software, expert benchmarks and review tools for testing models on practical domain tasks. | United States | $45M | n/a |
| AfterQuery | Sells AI labs and enterprises a mix of expert-made and synthetic datasets, RL environments and custom evals. | United States | $30.5M | Yes |
| Deccan AI | Supplies expert post-training data, human feedback, RL environments and evals, plus enterprise AI operations services. | United States | $25M | n/a |
| SimpleClosure | Wind-down firm whose AssetHub, per TechSpot on April 19, 2026 (citing Forbes), had facilitated nearly 100 data transactions with reported payouts of $10,000 to $100,000 per company. | United States | $20.5M | No |
| Pareto | Specialist-made training data, evals and RL environments for frontier labs. | United States | $17.8M | n/a |
| Datacurve | Expert coding data vendor offering RL environments, benchmarks and evals to model labs and developer tool companies. | United States | $17.7M | n/a |
| Preference Model | Builds RL environments that train models on machine learning research and engineering tasks. | United States | $16M | n/a |
| Poseidon | Sells physical AI training data such as egocentric task video, robot manipulation, speech and motion capture. | per its site | $15M | n/a |
| Million | Research lab building front-end coding data, RL environments and evals, including the ReactBench benchmark. | per its Y Combinator profile and SEC filing | $14.15M over 3 rounds, per CB Insights | n/a |
| Replay | Pays companies for work history such as code, docs, tickets and CRM records, strips identifiers, and licenses the data. | United States | $12M+ | Yes |
| Idler | Sells RL environments, benchmarks and eval sets built from real production work. | United States | $9.5M | n/a |
| Mechanize | Builds simulated software engineering tasks and graded benchmarks for frontier labs training coding agents. | United States | $9.1M | n/a |
| Veris AI | Simulation and RL platform that mimics enterprise systems and the people who use them, for agent training and testing. | United States | $8.5M | n/a |
| Polymath | Builds environments, tasks and verifiers for long-horizon agents, including the Horizon-SWE benchmark. | United States | $8M | n/a |
| Intelligence | Operates DesignArena, a voting site for AI-made sites, games and media, and sells model evals to labs. | United States | $7.9M | n/a |
| Runloop | Development sandboxes, orchestration and benchmarking tools for building and tuning coding agents. | United States | $7M | n/a |
| Huzzle Labs | Sells RL environments, expert data, evals and custom models for agents that handle real business software. | United Kingdom | $5.98M | n/a |
| Phinity | Builds chip design RL environments and training infrastructure while developing its own chip design agents. | United States | $5.5M | n/a |
| Vetto AI | Sells labs expert-written post-training data, human evaluation work, custom RL environments and verifier-scored benchmarks. | United States | $3.64M | n/a |
| Quesma | Publishes coding agent benchmarks, builds RL environments, and sells agent cost and workflow analytics. | Poland | $2.3M | n/a |
| Emulated | Provides post-training data, production-style engineering environments and benchmarks for coding and ops agents. | United States | $850K | n/a |
| Abundant | Builds reinforcement learning environments, benchmarks and datasets for labs and companies working on AI agents. | United States | $500K | n/a |
| Aviro | Sells RL environments, post-training data and evals for long-running agents across coding, computer use and office work. | United States | $500K | n/a |
| CueBench | Builds RL environments and benchmarks on hard science reasoning and performance engineering problems. | United States | $500K | n/a |
| dmodel | Builds RL environments where agents practice interpretability and alignment research. | United States | $500K | n/a |
| hiloop | Sells automated research infrastructure that runs experiments against a customer's own evals and reports results. | United States | $500K | n/a |
| Markov | Sells computer-use datasets and environments built from expert CAD, office, coding and gaming workflows. | United States | $500K | n/a |
| Petrarch | Sources company records under contract, de-identifies them inside the supplier's systems with its own software, and licenses them. | United States | $500K+ | n/a |
| Refresh | Simulated software environments, verifiable evals and real-workflow coding data for agent training. | United States | $500K | n/a |
| Theta | Builds custom simulations of business workflows and helps labs and enterprises train specialized agents on them. | United States | $500K | n/a |
| Vmax | Markets Campaign, a self-play platform that builds training environments from a developer's own data and evals. | United States | $250K | n/a |
| Anthromind | Runs managed projects that deliver curated preference and training data, custom model evals and fine-tuning support, using experts. | United States | $200,000 | n/a |
| AITraining.jobs | Expert data shop run by O-mega Enterprise that staffs US professionals on evals, rubrics, preference data and RL tasks for AI developers. | Delaware) | n/a | n/a |
| Apex Data Sciences | AI unit of Apex CoVantage, started in 2024, selling expert RLHF and SFT data, benchmarks and multimodal annotation. | United States | n/a | n/a |
| Appen | Human data vendor. Labs and product teams buy its labeling, expert review, model evaluation and RL environment work. | Australia | Public | No |
| ARIMLABS | Creates simulated workspaces and verifiable benchmarks for agents doing security, incident response and software tasks. | Poland | n/a | n/a |
| CNTXT AI | Abu Dhabi data shop sourcing, labeling and evaluating training data, including Arabic speech and ranked model responses. | United Arab Emirates | n/a | n/a |
| Curiosity Stream | Nasdaq-listed streaming company (CURI) that also licenses video, audio and code datasets to AI developers. | United States | Public | n/a |
| DataOcean AI | Sells stock datasets and custom collection, labeling and evaluation for speech, vision, LLM and driving models. | United States | n/a | n/a |
| DeepLLMData | Xlairs Inc. brand making expert training and eval data, including repository-level coding trajectories with tests. | per its site; it also lists Mumbai and Delhi | n/a | n/a |
| Diffuse Labs | Builds RL environments with generated tasks and checkable rewards in areas like coding and chip design. | United States | n/a | n/a |
| Exabite | Supplies large pretraining and post-training corpora, including code, documents and video, plus STEM RL environments. | United States | Self-funded | n/a |
| FasterLabeling | Vira Hub LLC brand that builds made-to-order RL environments with programmatic graders, shipped as Docker images. | is a Wyoming limited liability company) | n/a | n/a |
| Foundry AI | Creates expert-reviewed coding and technical workflow data, RL task suites and private evals. | India | n/a | n/a |
| G2i | Runs managed coding data projects and places contract engineers inside lab teams for post-training work. | United States | Self-funded | n/a |
| Innodata | Data engineering firm supplying training data, human feedback, RL environments, evals and red teaming. | United States | n/a | n/a |
| Logitly | Hong Kong firm that generates agent training traces with AI and checks them automatically, including DPO trace pairs. | per its site | n/a | n/a |
| Metaphi | Builds simulated workplaces, custom or off the shelf, along with datasets and evals for agent training. | United States | n/a | n/a |
| Miro Advisory | Advisory firm that helps established businesses and software companies license their operating records to AI buyers. | United States | n/a | Yes |
| Navaday | Manages specialists who write examples, fix data and compare model answers across professional fields. | n/a | n/a | n/a |
| Olam Labs | Builds multi-agent simulations, behavioral evals and game-based data for studying social and safety behavior. | United States | n/a | n/a |
| pre.dev | Sells graded coding environments and data built from licensed private code repositories. | United States | n/a | n/a |
| Proximal | Builds coding tasks, data and RL environments for training software engineering agents. | United States | n/a | n/a |
| ReasonCore | Expert-curated datasets, RL environments and adaptive evals for labs and enterprises. | n/a | n/a | n/a |
| Redpine | Swedish company licensing non-public data from publishers and research firms and reselling access to AI builders. | per its site | n/a | n/a |
| RL Labs | Makes multi-step coding environments that run for a long time, used by frontier labs to train models on complex engineering work. | n/a | n/a | n/a |
| San Francisco Data | Licenses training data built from the logs of companies' AI systems in production. Coding agents come first. | United States | n/a | n/a |
| Sherpa Labs | San Francisco builder of coding and finance RL environments, with tasks written by senior engineers and private equity professionals. | United States | n/a | n/a |
| Surge | Human-data and RLHF vendor. | United States | n/a | n/a |
| Symbal | Multimodal post-training data, private evals and human-in-the-loop data for labs, plus enterprise agents. | United States | n/a | n/a |
| Telegraph Lab | Sources business records for AI training, reviews rights, de-identifies and structures them, and arranges delivery to labs. | United States | n/a | Yes |
| TELUS Digital | TELUS unit supplying expert data, labeling, RL environments, red teaming, evals and physical AI datasets. | Canada | Public | n/a |
| Tiki AI | Custom post-training data for frontier teams: coding RL environments, computer-use fine-tuning sets and tool-use environments. | per its site | n/a | n/a |
| Uber AI Solutions | Uber's AI data arm: collection, labeling, specialist RLHF, red teaming and evals for labs and robotics firms. | United States | n/a | n/a |
| Ulam | Math and STEM focused vendor of reasoning data, expert-checked solution traces, benchmarks and RL environments with verifiers. | Poland | n/a | n/a |