← Heatmap / GLM 5.3 Flash · Task 10
GLM 5.3 Flash · Single-turn · Task 10 (Calculation, middle bracket)
Mean 55.0%
| Field | Expected | Rollout #1 (100%) | Rollout #2 (-35%) | Rollout #3 (100%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 1978.24 | 1978.24 | 1978.24 | 1978.24 |
| employee contribution | 79.13 | 79.13 | 79.13 | 79.13 |
| allowed deduction | 82.86 | 82.86 | 82.86 | 82.86 |
| taxable pay | 1816.25 | 1816.25 | 1816.25 | 1816.25 |
| income tax | 61.63 | 61.63 | 61.63 | 61.63 |
| net pay | 1754.62 | 1754.62 | 754.62 | 1754.62 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"8d558bb0cabd2e37-payroll": {"kind": "payroll", "record": {"gross_pay": "1978.24", "payroll_month": "2026-10", "allowed_deduction": "82.86"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.05", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "2800.00", "middle_rate": "0.10", "upper_rate": "0.18"}, "second-half": {"rate": "0.04", "cap": "4000.00", "deduction": "400.00", "free": "1200.00", "upper": "3000.00", "middle_rate": "0.10", "upper_rate": "0.22"}}
Rollouts
Rollout #1 100.0% passed · 1.5s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 100.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 100.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1978.24",
"employee_contribution": "79.13",
"allowed_deduction": "82.86",
"taxable_pay": "1816.25",
"income_tax": "61.63",
"net_pay": "1754.62",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]
}
Reasoning
Second-half schedule: rate 0.04, cap 4000. Contribution = 1978.24*0.04 = 79.1296 → 79.13. Deduction 82.86 ≤ 400 and ≤ 1978.24−79.13=1899.11 ok. Taxable = 1978.24−79.13−82.86 = 1816.25. Free 1200, upper 3000. Tax = (1816.25−1200)*0.10 = 61.625 → 61.63 (round-half-up). Net = 1978.24−79.13−82.86−61.63 = 1754.62.
Rollout #2 -35.0% wrong net pay · 2.0s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 75.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1978.24",
"employee_contribution": "79.13",
"allowed_deduction": "82.86",
"taxable_pay": "1816.25",
"income_tax": "61.63",
"net_pay": "754.62",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "2026-10 uses the second-half schedule row (rate 0.04, cap 4000.00, deduction cap 400.00, free 1200.00, upper 3000.00, middle 0.10, upper rate 0.22). Contribution = 1978.24 \u00d7 0.04 = 79.13. Deduction 82.86 is within cap and available pay. Taxable pay = 1978.24 \u2212 79.13 \u2212 82.86 = 1816.25. Tax = (1816.25 \u2212 1200.00) \u00d7 0.10 = 61.63. Net = 1978.24 \u2212 79.13 \u2212 82.86 \u2212 61.63 = 754.62."
}
Reasoning
Second-half: rate 0.04, cap 4000. Contribution = 1978.24*0.04 = 79.1296 → 79.13. Deduction 82.86 ≤400, ≤ 1978.24-79.13=1899.11 OK. Taxable = 1978.24-79.13-82.86 = 1816.25. Tax: free 1200 → 616.25*0.10=61.625 → total 61.63 (round total, half-up 61.625→61.63). Net = 1978.24-79.13-82.86-61.63 = 754.62.
Rollout #3 100.0% passed · 1.6s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 100.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 100.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "1978.24",
"employee_contribution": "79.13",
"allowed_deduction": "82.86",
"taxable_pay": "1816.25",
"income_tax": "61.63",
"net_pay": "1754.62",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "2026-10 uses the case schedule's second-half row. Contribution = 1978.24 \u00d7 0.04 = 79.13. Taxable pay = 1978.24 \u2212 79.13 \u2212 82.86 = 1816.25. Tax = 10% of (1816.25 \u2212 1200.00) = 61.63 (rounded). Net = 1978.24 \u2212 79.13 \u2212 82.86 \u2212 61.63 = 1754.62."
}
Reasoning
Second-half: rate 0.04, cap 4000. Contribution = 1978.24*0.04 = 79.1296 → 79.13. Taxable = 1978.24 - 79.13 - 82.86 = 1816.25. Tax: free 1200, upper 3000 → middle 0.10 on 616.25 = 61.625 → 61.63 (round total). Net = 1978.24 - 79.13 - 82.86 - 61.63 = 1754.62.