← Heatmap / Gemini 3.1 Flash Lite · Task 92
Gemini 3.1 Flash Lite · Single-turn · Task 92 (Calculation, at the wage cap)
Mean -40.0%
| Field | Expected | Rollout #1 (-40%) | Rollout #2 (-40%) | Rollout #3 (-40%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 3999.99 | 3999.99 | 3999.99 | 3999.99 |
| employee contribution | 280.00 | 280.00 | 280.00 | 280.00 |
| allowed deduction | 391.99 | 391.99 | 391.99 | 391.99 |
| taxable pay | 3328.00 | 3328.00 | 3328.00 | 3328.00 |
| income tax | 324.16 | 338.16 | 312.16 | 338.16 |
| net pay | 3003.84 | 2989.84 | 3015.84 | 2989.84 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"96ed6aa66caaba7d-payroll": {"kind": "payroll", "record": {"gross_pay": "3999.99", "payroll_month": "2026-09", "allowed_deduction": "391.99"}}, "96ed6aa66caaba7d-contract": {"kind": "contract", "gross_pay": "3999.99"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.05", "cap": "3500.00", "deduction": "400.00", "free": "1100.00", "upper": "3000.00", "middle_rate": "0.14", "upper_rate": "0.20"}, "second-half": {"rate": "0.07", "cap": "4000.00", "deduction": "400.00", "free": "1200.00", "upper": "3000.00", "middle_rate": "0.14", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.5s · $0.0012
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "3999.99",
"employee_contribution": "280.00",
"allowed_deduction": "391.99",
"taxable_pay": "3328.00",
"income_tax": "338.16",
"net_pay": "2989.84",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "The employee contribution is 0.07 * 3999.99 = 279.9993, rounded to 280.00. Taxable pay is 3999.99 - 280.00 - 391.99 = 3328.00. Income tax: (3000.00 - 1200.00) * 0.14 + (3328.00 - 3000.00) * 0.22 = 252.00 + 72.16 = 324.16. Wait, re-calculating: (3000.00 - 1200.00) * 0.14 = 252.00, (3328.00 - 3000.00) * 0.22 = 72.16. 252.00 + 72.16 = 324.16. Net pay: 3999.99 - 280.00 - 391.99 - 324.16 = 3003.84."
}
Rollout #2 -40.0% wrong income tax · 1.5s · $0.0011
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "3999.99",
"employee_contribution": "280.00",
"allowed_deduction": "391.99",
"taxable_pay": "3328.00",
"income_tax": "312.16",
"net_pay": "3015.84",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculation based on second-half schedule: employee_contribution = 3999.99 * 0.07 = 279.9993 (rounded to 280.00). Taxable pay = 3999.99 - 280.00 - 391.99 = 3328.00. Tax = (3000.00 - 1200.00) * 0.14 + (3328.00 - 3000.00) * 0.22 = 252.00 + 72.16 = 324.16. Net = 3999.99 - 280.00 - 391.99 - 312.16 = 3015.84."
}
Rollout #3 -40.0% wrong income tax · 1.5s · $0.0009
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "3999.99",
"employee_contribution": "280.00",
"allowed_deduction": "391.99",
"taxable_pay": "3328.00",
"income_tax": "338.16",
"net_pay": "2989.84",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using second-half reference values: rate 0.07, cap 4000.00, deduction 400.00, free 1200.00, upper 3000.00, middle_rate 0.14, upper_rate 0.22."
}