Sciloop

Sciloop supplies expert written evaluation and training data to frontier AI labs. It runs a marketplace in which Olympiad medalists, Codeforces grandmasters and domain researchers write very hard problems with solutions, aimed at the level where current models fail. For AI labs, the process has three steps. A lab specifies domain, difficulty, format and volume, Sciloop handles expert sourcing, quality control and cross checking, and data streams to the lab continuously, with requirements adjustable over time. Deliveries are described as problem and solution pairs with two or three expert reviews. Coverage spans mathematics, physics, computer science, chemistry and biology, with law, economics, humanities and medicine listed as expanding areas. For experts, the site describes browsing open projects on its platform, solving and submitting at their own pace with no deadlines or quotas, and getting paid. Compensation is stated as $225 or more per problem. The site publishes no dataset pricing for labs, which is scoped per project through a contact form. Two entry points are offered on the home page, one to start earning as an expert and one to get datasets.