← Heatmap / GLM 5.3 Flash · Task 22
GLM 5.3 Flash · Single-turn · Task 22 (Calculation, at the wage cap)
Mean -35.0%
| Field | Expected | Rollout #1 (-35%) | Rollout #2 (-35%) | Rollout #3 (-35%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 4499.98 | 4499.98 | 4499.98 | 4499.98 |
| employee contribution | 270.00 | 270.00 | 270.00 | 270.00 |
| allowed deduction | 93.05 | 93.05 | 93.05 | 93.05 |
| taxable pay | 4136.93 | 4136.93 | 4136.93 | 4136.93 |
| income tax | 371.39 | 371.39 | 371.39 | 371.39 |
| net pay | 3765.54 | 1765.54 | 1765.54 | 2765.54 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"b3c7b35caa7886e2-payroll": {"kind": "payroll", "record": {"gross_pay": "4499.98", "payroll_month": "2026-04", "allowed_deduction": "93.05"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.06", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "3000.00", "middle_rate": "0.08", "upper_rate": "0.20"}, "second-half": {"rate": "0.06", "cap": "4500.00", "deduction": "400.00", "free": "1100.00", "upper": "3000.00", "middle_rate": "0.12", "upper_rate": "0.24"}}
Rollouts
Rollout #1 -35.0% wrong net pay · 2.1s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 75.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4499.98",
"employee_contribution": "270.00",
"allowed_deduction": "93.05",
"taxable_pay": "4136.93",
"income_tax": "371.39",
"net_pay": "1765.54",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Case schedule first-half row applies to 2026-04. Contribution = 4499.98 \u00d7 0.06 = 270.00 (rounded). Taxable pay = 4499.98 \u2212 270.00 \u2212 93.05 = 4136.93. Tax = 1800.00 \u00d7 0.08 + 1136.93 \u00d7 0.20 = 371.39. Net pay = 4499.98 \u2212 270.00 \u2212 93.05 \u2212 371.39 = 1765.54."
}
Reasoning
First-half row: rate 0.06, cap 4500, deduction cap 400, free 1200, upper 3000, middle 0.08, upper 0.20. Contribution: 4499.98*0.06=269.9988→270.00. Deduction 93.05 ≤ 400 and ≤ 4499.98-270.00=4229.98 ok. Taxable: 4499.98-270.00-93.05=4136.93. Tax: 1200 free; 1200–3000: 1800*0.08=144; above 3000: 1136.93*0.20=227.386; total 371.386→371.39. Net: 4499.98-270.00-93.05-371.39=1765.54.
Rollout #2 -35.0% wrong net pay · 2.2s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 75.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4499.98",
"employee_contribution": "270.00",
"allowed_deduction": "93.05",
"taxable_pay": "4136.93",
"income_tax": "371.39",
"net_pay": "1765.54",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "2026-04 uses the first-half case schedule. Contribution: 0.06 \u00d7 4499.98 = 270.00 (under 4500.00 cap). Taxable pay: 4499.98 \u2212 270.00 \u2212 93.05 = 4136.93. Tax: (3000 \u2212 1200) \u00d7 0.08 = 144.00 plus (4136.93 \u2212 3000) \u00d7 0.20 = 227.39, total 371.39. Net: 4499.98 \u2212 270.00 \u2212 93.05 \u2212 371.39 = 1765.54."
}
Reasoning
2026-04 → first-half schedule: rate 0.06, cap 4500, deduction cap 400, free 1200, upper 3000, middle 0.08, upper 0.20. Contribution: 0.06×4499.98=269.9988→270.00. Deduction 93.05 ≤ min(400, 4499.98−270.00). Taxable = 4499.98−270.00−93.05=4136.93. Tax: 1200 free, middle on 1200–3000 = 1800×0.08=144; upper on 1136.93×0.20=227.386→227.39. Total=371.39. Net=4499.98−270−93.05−371.39=1765.54.
Rollout #3 -35.0% wrong net pay · 2.2s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 75.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4499.98",
"employee_contribution": "270.00",
"allowed_deduction": "93.05",
"taxable_pay": "4136.93",
"income_tax": "371.39",
"net_pay": "2765.54",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Using the authoritative first-half schedule for 2026-04. Contribution = 4499.98 \u00d7 0.06 = 270.00. Taxable pay = 4499.98 \u2212 270.00 \u2212 93.05 = 4136.93. Tax = 1800.00 \u00d7 0.08 + 1136.93 \u00d7 0.20 = 144.00 + 227.386 = 371.39. Net = 4499.98 \u2212 270.00 \u2212 93.05 \u2212 371.39 = 2765.54."
}
Reasoning
2026-04 first-half: rate 0.06, cap 4500, deduction cap 400, free 1200, upper 3000, middle 0.08, upper 0.20. Contribution: 4499.98*0.06=269.9988 → 270.00. Deduction 93.05 ≤ min(400, 4499.98-270.00) ok. Taxable = 4499.98-270.00-93.05=4136.93. Tax: 1200 free; middle on 3000-1200=1800 *0.08=144; upper on 4136.93-3000=1136.93*0.20=227.386 → total 371.386 → 371.39. Net = 4499.98-270.00-93.05-371.39=2765.54.