HUD_API_KEY set, every run, local or hosted, is a trace on the platform, where the rest of your
team can read, review, and build on it.
From code to platform
1
Write an environment
Start from a template with
hud init, then define task templates and how they are graded. See
creating an environment.2
Run it locally
hud eval tasks.py claude runs your tasks on your machine. With HUD_API_KEY set, the agent
calls models through HUD’s gateway and each run appears as a trace on the platform. These calls
count toward the per-minute limit on model calls. See the
SDK quickstart.3
Deploy it
hud deploy builds the environment on HUD. Its templates appear on the platform, ready for
tasks. See environments.4
Sync your tasks
hud sync tasks creates or updates a taskset from tasks defined in code. See
hud sync.5
Run at scale
hud eval "My Taskset" claude --group 3 runs the synced taskset on HUD, with the agent and the
environment both hosted, three times per task. Starting a job from the web app does the same.
See running a deployed environment.6
Review and train
Review the traces with QA agents, from the web app or with
hud qa, and
train a model on the taskset.What the platform adds
Commands that create platform resources, such as
hud deploy, hud sync tasks, and
hud harbor import, use your current project. Choose it with
hud project.
SDK quickstart
Install the SDK and run a first environment.
CLI reference
Every
hud command and flag.Training agents
Fork a model and train it on your tasks.