Agentic Evaluation — Agentic Engineering Field Guide

Agentic Evaluation

Agentic Engineering — what's going wrong, and what to try

click a petal to jump to its problems · or use search

What is this?

A field guide for engineers and product managers building or running LLM agents. It maps 201 practitioner problems from a curated 2025–2026 bibliography to 11 symptom themes, shown as petals on the mandala.

Browse — click a petal on the left to drop down its theme of problems.
Search — type a pain point (e.g. "judge scores keep changing") to filter across all 201 problems.
Drill in — every card shows the problem, a suggested action, and a clickable link to the original 2025–2026 source.

No problems matched.

Try a shorter phrase, a single keyword, or click a petal in the map.

201 problems across 11 themes, drawn from 43 curated 2025–2026 sources. Structural reference (Physics-of-AI constraint) shown per card.