← Heatmap / Gemini 3.1 Flash Lite · Task 90
Gemini 3.1 Flash Lite · Single-turn · Task 90 (Calculation, at the wage cap)
Mean -40.0%
| Field | Expected | Rollout #1 (-40%) | Rollout #2 (-40%) | Rollout #3 (-40%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 4999.99 | 4999.99 | 4999.99 | 4999.99 |
| employee contribution | 350.00 | 350.00 | 350.00 | 350.00 |
| allowed deduction | 355.71 | 355.71 | 355.71 | 355.71 |
| taxable pay | 4294.28 | 4294.28 | 4294.28 | 4294.28 |
| income tax | 536.74 | 700.74 | 704.74 | 704.74 |
| net pay | 3757.54 | 3593.54 | 3589.54 | 3589.54 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"9aeda9b75546629e-payroll": {"kind": "payroll", "record": {"gross_pay": "4999.99", "payroll_month": "2026-02", "allowed_deduction": "355.71"}}, "9aeda9b75546629e-contract": {"kind": "contract", "gross_pay": "4999.99"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.07", "cap": "5000.00", "deduction": "400.00", "free": "900.00", "upper": "3000.00", "middle_rate": "0.12", "upper_rate": "0.22"}, "second-half": {"rate": "0.06", "cap": "5000.00", "deduction": "400.00", "free": "1000.00", "upper": "2800.00", "middle_rate": "0.08", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 2.0s · $0.0012
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4999.99",
"employee_contribution": "350.00",
"allowed_deduction": "355.71",
"taxable_pay": "4294.28",
"income_tax": "700.74",
"net_pay": "3593.54",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using the authoritative first-half schedule provided in the case. Employee contribution is 0.07 * 4999.99 = 349.9993, rounded to 350.00. Taxable pay = 4999.99 - 350.00 - 355.71 = 4294.28. Income tax: (3000.00 - 900.00) * 0.12 + (4294.28 - 3000.00) * 0.22 = 252.00 + 284.7416 = 536.7416, which is 536.74. Correction: Income tax = (3000.00 - 900.00) * 0.12 + (4294.28 - 3000.00) * 0.22 = 252.00 + 284.7416 = 536.74. Net pay = 4999.99 - 350.00 - 355.71 - 536.74 = 3757.54."
}
Rollout #2 -40.0% wrong income tax · 2.0s · $0.0014
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4999.99",
"employee_contribution": "350.00",
"allowed_deduction": "355.71",
"taxable_pay": "4294.28",
"income_tax": "704.74",
"net_pay": "3589.54",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using first-half reference schedule: contribution (4999.99 * 0.07 = 349.9993, rounded to 350.00), taxable pay (4999.99 - 350.00 - 355.71 = 4294.28), income tax ((3000.00 - 900.00) * 0.12 + (4294.28 - 3000.00) * 0.22 = 252.00 + 284.7416 = 536.7416, rounded to 536.74 per R2, wait: tax is 252.00 + 284.74 = 536.74. Correction: (4294.28 - 3000) * 0.22 = 284.7416. 252 + 284.7416 = 536.74. Net pay = 4999.99 - 350.00 - 355.71 - 536.74 = 3757.54. Recalculating: Taxable = 4294.28. Tax = (3000-900)*0.12 + (4294.28-3000)*0.22 = 252 + 284.7416 = 536.7416. Rounded income_tax = 536.74. Net pay = 4999.99 - 350.00 - 355.71 - 536.74 = 3757.54."
}
Rollout #3 -40.0% wrong income tax · 2.0s · $0.0012
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4999.99",
"employee_contribution": "350.00",
"allowed_deduction": "355.71",
"taxable_pay": "4294.28",
"income_tax": "704.74",
"net_pay": "3589.54",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using the authoritative first-half schedule: contribution (4999.99 * 0.07 = 349.9993, rounded to 350.00), taxable pay (4999.99 - 350.00 - 355.71 = 4294.28), and income tax ( (3000.00 - 900.00) * 0.12 + (4294.28 - 3000.00) * 0.22 = 252.00 + 284.7416 = 536.7416, rounded to 536.74). Wait, correcting tax: (2100.00 * 0.12) + (1294.28 * 0.22) = 252.00 + 284.7416 = 536.74. Net: 4999.99 - 350.00 - 355.71 - 536.74 = 3757.54."
}