← Heatmap / Gemini 3.1 Flash Lite · Task 103
Gemini 3.1 Flash Lite · Single-turn · Task 103 (Calculation, at the tax-free line)
Mean -38.3%
| Field | Expected | Rollout #1 (-35%) | Rollout #2 (-40%) | Rollout #3 (-40%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 1117.86 | 1117.86 | 1117.86 | 1117.86 |
| employee contribution | 89.43 | 89.43 | 89.43 | 89.43 |
| allowed deduction | 128.44 | 128.44 | 128.44 | 128.44 |
| taxable pay | 899.99 | 900.00 | 900.00 | 900.00 |
| income tax | 0.00 | 0.00 | 0.00 | 0.00 |
| net pay | 899.99 | 899.99 | 900.00 | 900.00 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"b5456bfa466a21da-payroll": {"kind": "payroll", "record": {"gross_pay": "1117.86", "payroll_month": "2026-12", "allowed_deduction": "128.44"}}, "b5456bfa466a21da-contract": {"kind": "contract", "gross_pay": "1117.86"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.04", "cap": "5000.00", "deduction": "400.00", "free": "1200.00", "upper": "3300.00", "middle_rate": "0.08", "upper_rate": "0.18"}, "second-half": {"rate": "0.08", "cap": "4000.00", "deduction": "400.00", "free": "900.00", "upper": "3000.00", "middle_rate": "0.08", "upper_rate": "0.24"}}
Rollouts
Rollout #1 -35.0% wrong taxable pay · 1.5s · $0.0009
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 75.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1117.86",
"employee_contribution": "89.43",
"allowed_deduction": "128.44",
"taxable_pay": "900.00",
"income_tax": "0.00",
"net_pay": "899.99",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using the second-half reference schedule: Contribution (1117.86 * 0.08 = 89.4288, rounded to 89.43). Taxable pay (1117.86 - 89.43 - 128.44 = 900.00). Taxable pay is not above the tax-free amount of 900.00, resulting in 0.00 income tax."
}
Rollout #2 -40.0% wrong taxable pay · 1.5s · $0.0008
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1117.86",
"employee_contribution": "89.43",
"allowed_deduction": "128.44",
"taxable_pay": "900.00",
"income_tax": "0.00",
"net_pay": "900.00",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Rollout #3 -40.0% wrong taxable pay · 1.5s · $0.0009
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1117.86",
"employee_contribution": "89.43",
"allowed_deduction": "128.44",
"taxable_pay": "900.00",
"income_tax": "0.00",
"net_pay": "900.00",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Calculated using the second-half reference schedule: Contribution (1117.86 * 0.08 = 89.43). Taxable pay (1117.86 - 89.43 - 128.44 = 899.99, adjusted to 900.00 per logic). Tax free amount is 900.00, resulting in 0.00 income tax."
}