Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 79
Gemini 3.1 Flash Lite · Single-turn · Task 79 (Traps, missing month) Mean 100.0%
Field Expected Rollout #1 (100%) Rollout #2 (100%) Rollout #3 (100%)
decision clarify clarify clarify clarify
reason code MISSING_PAYROLL_MONTH MISSING_PAYROLL_MONTH MISSING_PAYROLL_MONTH MISSING_PAYROLL_MONTH
clauses R1 R7 R1 R7 R1 R7 R1 R7
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"3306732e853a7389-payroll": {"kind": "payroll", "record": {"gross_pay": "2524.56", "allowed_deduction": "208.50"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.06", "cap": "5000.00", "deduction": "400.00", "free": "1200.00", "upper": "3600.00", "middle_rate": "0.12", "upper_rate": "0.18"}, "second-half": {"rate": "0.08", "cap": "3500.00", "deduction": "400.00", "free": "1100.00", "upper": "3000.00", "middle_rate": "0.14", "upper_rate": "0.22"}}
Rollouts
Rollout #1 100.0% passed · 5.0s · $0.0009
ComponentScoreClauses
decision 100.0% R1 R7
exact 100.0% R1 R7
field accuracy 100.0% R1 R7
citations 100.0% R1 R7
explanation 100.0% R1 R7
Assistant
{
  "decision": "clarify",
  "reason_code": "MISSING_PAYROLL_MONTH",
  "clauses": ["R1", "R7"],
  "explanation": "The payroll month is missing from the record, which is required to determine the applicable reference schedule and perform calculations."
}
Rollout #2 100.0% passed · 4.1s · $0.0008
ComponentScoreClauses
decision 100.0% R1 R7
exact 100.0% R1 R7
field accuracy 100.0% R1 R7
citations 100.0% R1 R7
explanation 100.0% R1 R7
Assistant
{
  "decision": "clarify",
  "reason_code": "MISSING_PAYROLL_MONTH",
  "clauses": ["R1", "R7"],
  "explanation": "The payroll month is missing from the record, which is required to determine the applicable reference schedule and perform calculations."
}
Rollout #3 100.0% passed · 4.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R7
exact 100.0% R1 R7
field accuracy 100.0% R1 R7
citations 100.0% R1 R7
explanation 100.0% R1 R7
Assistant
{
  "decision": "clarify",
  "reason_code": "MISSING_PAYROLL_MONTH",
  "clauses": ["R1", "R7"],
  "explanation": "The payroll month is missing from the record, which is required to select the applicable reference row and perform calculations."
}