Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 3
Gemini 3.1 Flash Lite · Single-turn · Task 3 (Calculation, at the wage cap) Mean -40.0%
Field Expected Rollout #1 (-40%) Rollout #2 (-40%) Rollout #3 (-40%)
decision calculate calculate calculate calculate
currency LCR LCR LCR LCR
gross pay 5000.02 5000.02 5000.02 5000.02
employee contribution 300.00 300.00 300.00 300.00
allowed deduction 0.00 0.00 0.00 0.00
taxable pay 4700.02 4700.02 4700.02 4700.02
income tax 472.00 556.00 556.00 556.00
net pay 4228.02 4144.02 4144.02 4144.02
clauses R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"713704016144c9f9-payroll": {"kind": "payroll", "record": {"gross_pay": "5000.02", "payroll_month": "2026-05", "allowed_deduction": "0.00"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.06", "cap": "5000.00", "deduction": "400.00", "free": "1100.00", "upper": "3300.00", "middle_rate": "0.10", "upper_rate": "0.18"}, "second-half": {"rate": "0.07", "cap": "4000.00", "deduction": "400.00", "free": "1100.00", "upper": "3600.00", "middle_rate": "0.12", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "5000.02",
  "employee_contribution": "300.00",
  "allowed_deduction": "0.00",
  "taxable_pay": "4700.02",
  "income_tax": "556.00",
  "net_pay": "4144.02",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #2 -40.0% wrong income tax · 1.2s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "5000.02",
  "employee_contribution": "300.00",
  "allowed_deduction": "0.00",
  "taxable_pay": "4700.02",
  "income_tax": "556.00",
  "net_pay": "4144.02",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "5000.02",
  "employee_contribution": "300.00",
  "allowed_deduction": "0.00",
  "taxable_pay": "4700.02",
  "income_tax": "556.00",
  "net_pay": "4144.02",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}