Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 6
Gemini 3.1 Flash Lite · Single-turn · Task 6 (Calculation, upper bracket) Mean -40.0%
Field Expected Rollout #1 (-40%) Rollout #2 (-40%) Rollout #3 (-40%)
decision calculate calculate calculate calculate
currency LCR LCR LCR LCR
gross pay 3468.15 3468.15 3468.15 3468.15
employee contribution 138.73 138.73 138.73 138.73
allowed deduction 47.85 47.85 47.85 47.85
taxable pay 3281.57 3281.57 3281.57 3281.57
income tax 329.95 301.95 301.95 301.95
net pay 2951.62 2979.62 2979.62 2979.62
clauses R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"0eb088af1b0a1e64-payroll": {"kind": "payroll", "record": {"gross_pay": "3468.15", "payroll_month": "2026-06", "allowed_deduction": "47.85"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.04", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "2800.00", "middle_rate": "0.14", "upper_rate": "0.22"}, "second-half": {"rate": "0.07", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "3000.00", "middle_rate": "0.08", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "3468.15",
  "employee_contribution": "138.73",
  "allowed_deduction": "47.85",
  "taxable_pay": "3281.57",
  "income_tax": "301.95",
  "net_pay": "2979.62",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #2 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "3468.15",
  "employee_contribution": "138.73",
  "allowed_deduction": "47.85",
  "taxable_pay": "3281.57",
  "income_tax": "301.95",
  "net_pay": "2979.62",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "3468.15",
  "employee_contribution": "138.73",
  "allowed_deduction": "47.85",
  "taxable_pay": "3281.57",
  "income_tax": "301.95",
  "net_pay": "2979.62",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}