← Heatmap / Gemini 3.1 Flash Lite · Task 43
Gemini 3.1 Flash Lite · Single-turn · Task 43 (Calculation, at the upper bracket line)
Mean -40.0%
| Field | Expected | Rollout #1 (-40%) | Rollout #2 (-40%) | Rollout #3 (-40%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 3260.87 | 3260.87 | 3260.87 | 3260.87 |
| employee contribution | 260.87 | 260.87 | 260.87 | 260.87 |
| allowed deduction | 0.00 | 0.00 | 0.00 | 0.00 |
| taxable pay | 3000.00 | 3000.00 | 3000.00 | 3000.00 |
| income tax | 190.00 | 234.00 | 234.00 | 234.00 |
| net pay | 2810.00 | 2766.00 | 2766.00 | 2766.00 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"266ad92a0f7f5085-payroll": {"kind": "payroll", "record": {"gross_pay": "3260.87", "payroll_month": "2026-08", "allowed_deduction": "0.00"}}, "266ad92a0f7f5085-contract": {"kind": "contract", "gross_pay": "3260.87"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.07", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "2800.00", "middle_rate": "0.08", "upper_rate": "0.18"}, "second-half": {"rate": "0.08", "cap": "5000.00", "deduction": "400.00", "free": "1100.00", "upper": "3000.00", "middle_rate": "0.10", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.4s · $0.0011
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "3260.87",
"employee_contribution": "260.87",
"allowed_deduction": "0.00",
"taxable_pay": "3000.00",
"income_tax": "234.00",
"net_pay": "2766.00",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using the second-half schedule provided in the case reference: employee contribution (3260.87 * 0.08 = 260.87), taxable pay (3260.87 - 260.87 - 0.00 = 3000.00), and income tax ((3000.00 - 1100.00) * 0.10 + (3000.00 - 3000.00) * 0.22 = 190.00) - wait, calculation correction: (3000 - 1100) * 0.10 = 190.00. Taxable pay 3000.00. Tax = 190.00. Net = 3260.87 - 260.87 - 0.00 - 190.00 = 2810.00."
}
Rollout #2 -40.0% wrong income tax · 1.1s · $0.0008
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "3260.87",
"employee_contribution": "260.87",
"allowed_deduction": "0.00",
"taxable_pay": "3000.00",
"income_tax": "234.00",
"net_pay": "2766.00",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 -40.0% wrong income tax · 1.4s · $0.0011
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "3260.87",
"employee_contribution": "260.87",
"allowed_deduction": "0.00",
"taxable_pay": "3000.00",
"income_tax": "234.00",
"net_pay": "2766.00",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using the second-half reference schedule provided in the case: contribution = 3260.87 * 0.08 = 260.87. Taxable pay = 3260.87 - 260.87 - 0.00 = 3000.00. Income tax = (3000.00 - 1100.00) * 0.10 = 190.00 (Wait, recalculating: Taxable pay 3000.00. Bracket 1: 1100.00 to 3000.00 is 1900.00 at 0.10 = 190.00. Total tax 190.00. Net pay = 3260.87 - 260.87 - 0.00 - 190.00 = 2810.00)."
}