SpreadsheetBench

Use it with BoltzLabs

BoltzLabs does not host this project. To record an agent working on one of its tasks:

1. Prepare one task from the project: its starter files, instructions, dependencies and check command.
2. In Evals, choose New eval, upload the starter folder or enter its repository, then set the task and check command.
3. Choose BoltzLabs models or your own endpoint. Each run gets its own machine.
4. When the run finishes, open it to read the agent’s trace, file changes and check result.

Projects that need a desktop or phone, self-hosted websites, a game or a simulator need that runtime set up separately; an eval machine does not include it. Machine time uses account credits; hosted model calls are billed separately.