Classifiers

All classifiers satisfy the Classifier protocol:

class Classifier(Protocol):
    def classify(self, trajectory: Trajectory, task: str) -> FailureType: ...

classify() is always def (not async def). triage runs it via anyio.to_thread.run_sync() to keep the event loop unblocked.

---

RulesClassifier

from triage.classifier.rules import RulesClassifier

Pattern-based, zero API calls, microseconds per call.

clf = RulesClassifier()
clf = RulesClassifier(constraints=["must return JSON", "no markdown"])

Rules (priority order):

1. LOOP_DETECTED — last 3 steps: same tool_called + identical canonical tool_input
2. WRONG_TOOL_CALLED — error matches tool.{0,30}not found|no tool named
3. SCHEMA_MISMATCH — error matches validation error|json.*parse|jsondecodeerror
4. EXTERNAL_FAULT — error contains "429", "500", "502", or "503"
5. CONSTRAINT_IGNORED — any step's llm_output contains a constraint string
6. UNKNOWN — no rule matched

---

LLMClassifier

from triage.classifier.llm import LLMClassifier

Semantic classifier. Calls an LLM to read the trajectory and name the failure type.

# Anthropic (default)
clf = LLMClassifier()
clf = LLMClassifier(api_key="sk-ant-...", model="claude-haiku-4-5-20251001")

# OpenAI-compatible
clf = LLMClassifier(base_url="http://localhost:11434/v1", model="llama3.2")
clf = LLMClassifier(base_url="https://api.groq.com/openai/v1",
                    api_key="gsk_...", model="llama-3.1-8b-instant")

Parameters:

Parameter	Default	Description
api_key	None → TRIAGE_LLM_API_KEY env var	API key
model	claude-haiku-4-5-20251001 (Anthropic) or llama3.2 (OpenAI-compat)	Model name
max_trajectory_steps	10	Steps included in the prompt
base_url	None → TRIAGE_LLM_BASE_URL env var	If set, uses OpenAI-compatible client

Falls back to UNKNOWN silently on any error.

Install:

pip install "triage-agent[anthropic]"   # Anthropic backend
pip install openai                       # OpenAI-compatible backend

---

HybridClassifier

from triage.classifier.hybrid import HybridClassifier

Runs RulesClassifier first; calls the LLM only when rules return UNKNOWN.

clf = HybridClassifier(llm=LLMClassifier())

Recommended for production: free for structural failures, semantic fallback for ambiguous ones.

---

Custom classifiers

Any class with a synchronous classify() method satisfies the protocol:

class MyClassifier:
    def classify(self, trajectory: Trajectory, task: str) -> FailureType:
        if any("budget" in (s.error or "") for s in trajectory.steps):
            return FailureType.CONSTRAINT_IGNORED
        return FailureType.UNKNOWN

agent = triage.Agent(my_agent, policy=policy, classifier=MyClassifier())