RLM Multi-Step Tool-Call Report

Tool Calls per Rollout

First Proposed Structure Turn

First Checker Turn

Second Checker Turn

Harness Exploration Calls per Rollout

Candidate + Checker Same Call by Turn

Average Pre-Action Exploration

Primary Labels

Top Secondary Tags

Reasoning Context Tags

Error Subtypes

Python Exception Details

Silent / Non-Exception Bugs

Error Cause Tags

Clickable Tag and Error Index

All error/cause tags

All common behavior tags

Per-Rollout Compact Audit

Examples