Luma Payroll Gym
← Heatmap / Gemini 3.1 Flash Lite · Task 19
Gemini 3.1 Flash Lite · Single-turn · Task 19 (Calculation, upper bracket) Mean -40.0%
Field Expected Rollout #1 (-40%) Rollout #2 (-40%) Rollout #3 (-40%)
decision calculate calculate calculate calculate
currency LCR LCR LCR LCR
gross pay 4326.01 4326.01 4326.01 4326.01
employee contribution 302.82 302.82 302.82 302.82
allowed deduction 386.64 386.64 386.64 386.64
taxable pay 3636.55 3636.55 3636.55 3636.55
income tax 198.58 258.58 258.58 258.58
net pay 3437.97 3377.97 3377.97 3377.97
clauses R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6 R1 R2 R3 R4 R5 R6
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"f8d9f5fe0eb33c57-payroll": {"kind": "payroll", "record": {"gross_pay": "4326.01", "payroll_month": "2026-03", "allowed_deduction": "386.64"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.07", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "3600.00", "middle_rate": "0.08", "upper_rate": "0.18"}, "second-half": {"rate": "0.05", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "3600.00", "middle_rate": "0.08", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.5s · $0.0011
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "4326.01",
  "employee_contribution": "302.82",
  "allowed_deduction": "386.64",
  "taxable_pay": "3636.55",
  "income_tax": "258.58",
  "net_pay": "3377.97",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
  "explanation": "Calculated using the authoritative first-half schedule (Rate: 0.07, Wage Cap: 4500.00, Deduction Cap: 400.00, Tax-free: 1200.00, Upper Boundary: 3600.00, Middle Rate: 0.08, Upper Rate: 0.18). Employee contribution: 4326.01 * 0.07 = 302.82. Taxable pay: 4326.01 - 302.82 - 386.64 = 3636.55. Income tax: (3600.00 - 1200.00) * 0.08 + (3636.55 - 3600.00) * 0.18 = 192.00 + 6.58 = 198.58."
}
Rollout #2 -40.0% wrong income tax · 1.5s · $0.0010
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "4326.01",
  "employee_contribution": "302.82",
  "allowed_deduction": "386.64",
  "taxable_pay": "3636.55",
  "income_tax": "258.58",
  "net_pay": "3377.97",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
  "explanation": "Calculated using the authoritative first-half schedule provided in the case. Employee contribution: 4326.01 * 0.07 = 302.82. Taxable pay: 4326.01 - 302.82 - 386.64 = 3636.55. Income tax: (3600.00 - 1200.00) * 0.08 + (3636.55 - 3600.00) * 0.18 = 192.00 + 6.58 = 258.58."
}
Rollout #3 -40.0% wrong income tax · 1.0s · $0.0008
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6
exact 0.0% R1 R2 R3 R4 R5 R6
field accuracy 50.0% R1 R2 R3 R4 R5 R6
citations 100.0% R1 R2 R3 R4 R5 R6
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "4326.01",
  "employee_contribution": "302.82",
  "allowed_deduction": "386.64",
  "taxable_pay": "3636.55",
  "income_tax": "258.58",
  "net_pay": "3377.97",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}