Luma Payroll Gym
← Heatmap / MiMo V2.6 Pro · Task 79
MiMo V2.6 Pro · Single-turn · Task 79 (Traps, missing month) Mean 100.0%
Field Expected Rollout #1 (100%) Rollout #2 (100%) Rollout #3 (100%)
decision clarify clarify clarify clarify
reason code MISSING_PAYROLL_MONTH MISSING_PAYROLL_MONTH MISSING_PAYROLL_MONTH MISSING_PAYROLL_MONTH
clauses R1 R7 R1 R7 R1 R7 R1 R7
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"3306732e853a7389-payroll": {"kind": "payroll", "record": {"gross_pay": "2524.56", "allowed_deduction": "208.50"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.06", "cap": "5000.00", "deduction": "400.00", "free": "1200.00", "upper": "3600.00", "middle_rate": "0.12", "upper_rate": "0.18"}, "second-half": {"rate": "0.08", "cap": "3500.00", "deduction": "400.00", "free": "1100.00", "upper": "3000.00", "middle_rate": "0.14", "upper_rate": "0.22"}}
Rollouts
Rollout #1 100.0% passed · 4.1s · $0.0003
ComponentScoreClauses
decision 100.0% R1 R7
exact 100.0% R1 R7
field accuracy 100.0% R1 R7
citations 100.0% R1 R7
explanation 100.0% R1 R7
Assistant
{
  "decision": "clarify",
  "reason_code": "MISSING_PAYROLL_MONTH",
  "clauses": ["R1", "R7"],
  "explanation": "The payroll record lacks the required payroll_month, so no reference row can be selected. Please provide the month in YYYY-MM format."
}
Reasoning
Missing payroll_month → clarify MISSING_PAYROLL_MONTH. Cite R1 and R7.
Rollout #2 100.0% passed · 6.9s · $0.0002
ComponentScoreClauses
decision 100.0% R1 R7
exact 100.0% R1 R7
field accuracy 100.0% R1 R7
citations 100.0% R1 R7
explanation 100.0% R1 R7
Assistant
{
  "decision": "clarify",
  "reason_code": "MISSING_PAYROLL_MONTH",
  "clauses": ["R1", "R7"],
  "explanation": "The required payroll_month is missing, so the reference row cannot be selected; please supply the payroll month in YYYY-MM format."
}
Reasoning
Payroll month missing! R1 requires gross_pay and payroll_month. Order: missing gross_pay first (not missing), then missing payroll_month → clarify MISSING_PAYROLL_MONTH. Cite R1 and R7.
Rollout #3 100.0% passed · 5.2s · $0.0002
ComponentScoreClauses
decision 100.0% R1 R7
exact 100.0% R1 R7
field accuracy 100.0% R1 R7
citations 100.0% R1 R7
explanation 100.0% R1 R7
Assistant
{
  "decision": "clarify",
  "reason_code": "MISSING_PAYROLL_MONTH",
  "explanation": "The payroll record does not supply the required payroll_month, so the applicable reference row cannot be selected; please provide the payroll month in YYYY-MM format.",
  "clauses": ["R1", "R7"]
}
Reasoning
Missing payroll_month -> clarify MISSING_PAYROLL_MONTH, cite R1, R7. Don't calculate.