← Heatmap / Gemini 3.1 Flash Lite · Task 53
Gemini 3.1 Flash Lite · Single-turn · Task 53 (Calculation, upper bracket, resolved amendment)
Mean -40.0%
| Field | Expected | Rollout #1 (-40%) | Rollout #2 (-40%) | Rollout #3 (-40%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 4484.82 | 4484.82 | 4484.82 | 4484.82 |
| employee contribution | 179.39 | 179.39 | 179.39 | 179.39 |
| allowed deduction | 395.18 | 395.18 | 395.18 | 395.18 |
| taxable pay | 3910.25 | 3910.25 | 3910.25 | 3910.25 |
| income tax | 325.85 | 383.85 | 383.85 | 383.85 |
| net pay | 3584.40 | 3526.40 | 3526.40 | 3526.40 |
| clauses | R1 R2 R3 R4 R5 R6 R9 | R1 R2 R3 R4 R5 R6 R9 | R1 R2 R3 R4 R5 R6 R9 | R1 R2 R3 R4 R5 R6 R9 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"c930a30c2090b4dc-payroll": {"kind": "payroll", "record": {"gross_pay": "4484.82", "payroll_month": "2026-11", "allowed_deduction": "395.18"}}, "c930a30c2090b4dc-contract": {"kind": "contract", "gross_pay": "4728.75"}, "c930a30c2090b4dc-amendment": {"kind": "amendment", "gross_pay": "4484.82", "approved": true, "effective_month": "2026-05"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.06", "cap": "4000.00", "deduction": "400.00", "free": "1100.00", "upper": "3600.00", "middle_rate": "0.14", "upper_rate": "0.24"}, "second-half": {"rate": "0.04", "cap": "4500.00", "deduction": "400.00", "free": "900.00", "upper": "3600.00", "middle_rate": "0.10", "upper_rate": "0.18"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.1s · $0.0008
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4484.82",
"employee_contribution": "179.39",
"allowed_deduction": "395.18",
"taxable_pay": "3910.25",
"income_tax": "383.85",
"net_pay": "3526.40",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
"explanation": "The amendment resolves the conflict between the contract and payroll gross pay as it is approved and effective prior to the payroll month."
}
Rollout #2 -40.0% wrong income tax · 1.5s · $0.0008
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4484.82",
"employee_contribution": "179.39",
"allowed_deduction": "395.18",
"taxable_pay": "3910.25",
"income_tax": "383.85",
"net_pay": "3526.40",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
"explanation": "The amendment resolves the conflict between the contract and payroll gross pay as it is approved and effective prior to the payroll month."
}
Rollout #3 -40.0% wrong income tax · 1.5s · $0.0008
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4484.82",
"employee_contribution": "179.39",
"allowed_deduction": "395.18",
"taxable_pay": "3910.25",
"income_tax": "383.85",
"net_pay": "3526.40",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
"explanation": "The amendment is approved and effective for 2026-11, resolving the conflict between the contract and payroll record gross pay."
}