Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 22
Gemini 3.1 Flash Lite · Single-turn · Task 22 (Calculation, at the wage cap) Mean -40.0%
Field Expected Rollout #1 (-40%) Rollout #2 (-40%) Rollout #3 (-40%)
decision calculate calculate calculate calculate
currency LCR LCR LCR LCR
gross pay 4499.98 4499.98 4499.98 4499.98
employee contribution 270.00 270.00 270.00 270.00
allowed deduction 93.05 93.05 93.05 93.05
taxable pay 4136.93 4136.93 4136.93 4136.93
income tax 371.39 427.39 427.39 427.39
net pay 3765.54 3709.54 3709.54 3709.54
clauses R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"b3c7b35caa7886e2-payroll": {"kind": "payroll", "record": {"gross_pay": "4499.98", "payroll_month": "2026-04", "allowed_deduction": "93.05"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.06", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "3000.00", "middle_rate": "0.08", "upper_rate": "0.20"}, "second-half": {"rate": "0.06", "cap": "4500.00", "deduction": "400.00", "free": "1100.00", "upper": "3000.00", "middle_rate": "0.12", "upper_rate": "0.24"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "4499.98",
  "employee_contribution": "270.00",
  "allowed_deduction": "93.05",
  "taxable_pay": "4136.93",
  "income_tax": "427.39",
  "net_pay": "3709.54",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #2 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "4499.98",
  "employee_contribution": "270.00",
  "allowed_deduction": "93.05",
  "taxable_pay": "4136.93",
  "income_tax": "427.39",
  "net_pay": "3709.54",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 -40.0% wrong income tax · 1.0s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "4499.98",
  "employee_contribution": "270.00",
  "allowed_deduction": "93.05",
  "taxable_pay": "4136.93",
  "income_tax": "427.39",
  "net_pay": "3709.54",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}