Toloka

Toloka is a Dutch multinational data services company based in Amsterdam, Netherlands. It delivers human-in-the-loop annotation and evaluation work that supports the development of generative AI and large language models. It provides expertly curated data for AI agents and models development as a managed service. Its services include customized human evaluation and red teaming.

Toloka was founded in 2014 by Olga Megorskaya as a crowdsourcing and microtasking platform for data markup. Toloka is a unit of Nasdaq-listed AI infrastructure provider Nebius Group NV. Its clients include Amazon, Microsoft, Anthropic, Shopify, and poolside.

Toloka mainly works with domain experts, such as physicists, scientists, lawyers, and software engineers. It collaborates with data workers from 100+ countries speaking 40+ languages. In 2024, its Russian operations were sold to Russian investors.