What it is
We run a test copy of your web app next to the model and write jobs a user would do in it, such as filling a form, changing a setting or finding a record. The model works through a browser, and the check reads the app’s data afterwards.
Jobs in your web app, done through a browser and checked on the app’s data.
Coming soon. This kind of eval can't be run or requested yet. Today BoltzLabs runs codebase evals: each task is a repository, a job to do in it and a test that checks the result, run on its own machine.
We run a test copy of your web app next to the model and write jobs a user would do in it, such as filling a form, changing a setting or finding a record. The model works through a browser, and the check reads the app’s data afterwards.