> ## Documentation Index > Fetch the complete documentation index at: https://docs.hud.ai/llms.txt > Use this file to discover all available pages before exploring further. # Ops diagnostics > Walk through an ops diagnostics task where the agent gathers logs, metrics, and traces, integrates evidence, and produces a graded root-cause diagnosis. An **investigation** task asks the agent to reach a conclusion that no single piece of evidence gives away. Here the agent reads several log files, integrates what they say, and produces a root-cause diagnosis that an LLM judge grades against a rubric. This is the shape of a good training task - multi-step, multi-channel, and graded on substance rather than keywords. ## The environment We give the agent shell access to a directory of logs and traces, then ask for a diagnosis. The cause sits in one file and the symptoms in others, so the agent has to read across them - no single artifact contains the answer. ```python env.py theme={"dark"} from pathlib import Path from hud.environment import Environment from hud.graders import LLMJudgeGrader ROOT = Path("/workspace/incident") env = Environment(name="ops-diagnostics") env.workspace("/workspace") @env.initialize async def _seed(): ROOT.mkdir(parents=True, exist_ok=True) (ROOT / "api.log").write_text( "12:01 INFO request /checkout ok 120ms\n" "12:02 WARN db pool wait 1400ms\n" "12:03 ERROR /checkout 503 upstream timeout\n" ) (ROOT / "db.log").write_text( "12:02 connections=100/100 saturated\n" "12:02 slow query: SELECT * FROM carts (no index on user_id)\n" ) (ROOT / "deploy.log").write_text("11:58 deployed v412: 'remove cart index migration'\n") @env.template() async def diagnose(): answer = yield ( "Checkout started returning 503s at 12:03. The logs and deploy history are " "in the incident/ directory of your workspace. What is the root cause, and " "what's the evidence?" ) result = await LLMJudgeGrader.grade( weight=1.0, answer=answer, question="Root cause of the checkout 503s", criteria=[ "Identifies the removed cart index (deploy v412) as the root cause", "Connects DB pool saturation and the slow cart query to the 503s", ("Cites specific log evidence rather than guessing", 2.0), ], ) yield result.value tasks = [diagnose()] ``` The answer is the agent's **text diagnosis** (`answer = yield ...`). The judge scores it against weighted criteria via the HUD gateway, no extra install needed. ## Why this is a good training task It satisfies the [signal](/v6/reference/advice) principles: * **Multi-channel integration** - the cause (a removed index) is in `deploy.log`, but the symptom path runs through `db.log` and `api.log`. No single file is decisive, so the agent must *integrate*. * **Multi-step** - the agent reads several files, forms a hypothesis, and checks it against the evidence. * **Substance over surface** - the judge credits a correct, evidence-cited diagnosis, not keywords. A generic "it's a database issue" with no evidence scores low. * **No leakage** - no file names the root cause as "the bug"; the agent has to derive it. ## Run it ```bash theme={"dark"} hud eval env.py claude ``` Inspect the trace at [hud.ai](https://hud.ai) to see which files the agent read and how it reasoned - useful for spotting whether the reward tracks real investigation. ## Build a spread Vary the incident to mint a dataset with a difficulty range - some with an obvious deploy cause, some where the evidence is more scattered. A controlled difficulty distribution is what makes the set trainable (see [Designing tasks for signal](/v6/reference/advice)). ## See also