Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 37
Gemini 3.1 Flash Lite · Single-turn · Task 37 (Calculation, wage cap binds) Mean -40.0%
Field Expected Rollout #1 (-40%) Rollout #2 (-40%) Rollout #3 (-40%)
decision calculate calculate calculate calculate
currency LCR LCR LCR LCR
gross pay 8070.19 8070.19 8070.19 8070.19
employee contribution 200.00 200.00 200.00 200.00
allowed deduction 287.02 287.02 287.02 287.02
taxable pay 7583.17 7583.17 7583.17 7583.17
income tax 1184.63 1176.63 1176.63 1176.63
net pay 6398.54 6406.54 6406.54 6406.54
clauses R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"4c09f376cdcad6f5-payroll": {"kind": "payroll", "record": {"gross_pay": "8070.19", "payroll_month": "2026-03", "allowed_deduction": "287.02"}}, "4c09f376cdcad6f5-contract": {"kind": "contract", "gross_pay": "8070.19"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.04", "cap": "5000.00", "deduction": "400.00", "free": "900.00", "upper": "2800.00", "middle_rate": "0.12", "upper_rate": "0.20"}, "second-half": {"rate": "0.05", "cap": "4000.00", "deduction": "400.00", "free": "1100.00", "upper": "3600.00", "middle_rate": "0.08", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 0.9s · $0.0008
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "8070.19",
  "employee_contribution": "200.00",
  "allowed_deduction": "287.02",
  "taxable_pay": "7583.17",
  "income_tax": "1176.63",
  "net_pay": "6406.54",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #2 -40.0% wrong income tax · 1.0s · $0.0008
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "8070.19",
  "employee_contribution": "200.00",
  "allowed_deduction": "287.02",
  "taxable_pay": "7583.17",
  "income_tax": "1176.63",
  "net_pay": "6406.54",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 -40.0% wrong income tax · 1.0s · $0.0008
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "8070.19",
  "employee_contribution": "200.00",
  "allowed_deduction": "287.02",
  "taxable_pay": "7583.17",
  "income_tax": "1176.63",
  "net_pay": "6406.54",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}