← Heatmap / Gemini 3.1 Flash Lite · Task 24
Gemini 3.1 Flash Lite · Single-turn · Task 24 (Calculation, at the wage cap, resolved amendment)
Mean -40.0%
| Field | Expected | Rollout #1 (-40%) | Rollout #2 (-40%) | Rollout #3 (-40%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 4999.99 | 4999.99 | 4999.99 | 4999.99 |
| employee contribution | 350.00 | 350.00 | 350.00 | 350.00 |
| allowed deduction | 264.22 | 264.22 | 264.22 | 264.22 |
| taxable pay | 4385.77 | 4385.77 | 4385.77 | 4385.77 |
| income tax | 387.44 | 377.34 | 371.44 | 371.44 |
| net pay | 3998.33 | 4008.43 | 4014.33 | 4014.33 |
| clauses | R1 R2 R3 R4 R5 R6 R9 | R1 R2 R3 R4 R5 R6 R9 | R1 R2 R3 R4 R5 R6 R9 | R1 R2 R3 R4 R5 R6 R9 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"f6c75cab8c86e7df-payroll": {"kind": "payroll", "record": {"gross_pay": "4999.99", "payroll_month": "2026-02", "allowed_deduction": "264.22"}}, "f6c75cab8c86e7df-contract": {"kind": "contract", "gross_pay": "5019.61"}, "f6c75cab8c86e7df-amendment": {"kind": "amendment", "gross_pay": "4999.99", "approved": true, "effective_month": "2026-01"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.07", "cap": "5000.00", "deduction": "400.00", "free": "900.00", "upper": "3300.00", "middle_rate": "0.08", "upper_rate": "0.18"}, "second-half": {"rate": "0.08", "cap": "3500.00", "deduction": "400.00", "free": "1000.00", "upper": "3000.00", "middle_rate": "0.14", "upper_rate": "0.24"}}
Rollouts
Rollout #1 -40.0% wrong income tax · 1.0s · $0.0008
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4999.99",
"employee_contribution": "350.00",
"allowed_deduction": "264.22",
"taxable_pay": "4385.77",
"income_tax": "377.34",
"net_pay": "4008.43",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
"explanation": "The amendment resolves the conflict between the contract and payroll gross pay as it is approved and effective for the month."
}
Rollout #2 -40.0% wrong income tax · 1.5s · $0.0012
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4999.99",
"employee_contribution": "350.00",
"allowed_deduction": "264.22",
"taxable_pay": "4385.77",
"income_tax": "371.44",
"net_pay": "4014.33",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
"explanation": "The contract conflict is resolved by the approved amendment (R9). Employee contribution calculated as 4999.99 * 0.07 = 349.9993, rounded to 350.00 (R2, R3). Taxable pay: 4999.99 - 350.00 - 264.22 = 4385.77 (R4). Income tax: (3300.00 - 900.00) * 0.08 + (4385.77 - 3300.00) * 0.18 = 192.00 + 195.4386 = 387.4386, rounded to 387.44? No, recalculating: (3300.00 - 900.00) * 0.08 = 192.00. (4385.77 - 3300.00) * 0.18 = 195.4386. Total 387.4386. Rounding to 387.44."
}
Rollout #3 -40.0% wrong income tax · 1.4s · $0.0011
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 R9 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 R9 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 R9 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4999.99",
"employee_contribution": "350.00",
"allowed_deduction": "264.22",
"taxable_pay": "4385.77",
"income_tax": "371.44",
"net_pay": "4014.33",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
"explanation": "The contract conflict was resolved by the approved amendment under R9. Employee contribution calculated as 0.07 * 4999.99 = 349.9993, rounded to 350.00. Taxable pay: 4999.99 - 350.00 - 264.22 = 4385.77. Income tax: (3300.00 - 900.00) * 0.08 + (4385.77 - 3300.00) * 0.18 = 192.00 + 195.4386 = 387.4386, rounded to 387.44."
}