← Heatmap / GLM 5.3 Flash · Task 50
GLM 5.3 Flash · Single-turn · Task 50 (Calculation, upper bracket)
Mean -43.3%
| Field | Expected | Rollout #1 (-45%) | Rollout #2 (-45%) | Rollout #3 (-40%) |
|---|---|---|---|---|
| decision | calculate | calculate | calculate | calculate |
| currency | LCR | LCR | LCR | LCR |
| gross pay | 4481.05 | 4481.05 | 4481.05 | 4481.05 |
| employee contribution | 358.48 | 358.48 | 358.48 | 358.48 |
| allowed deduction | 0.00 | 0.00 | 0.00 | 0.00 |
| taxable pay | 4122.57 | 3122.57 | 3122.57 | 4122.57 |
| income tax | 346.06 | 166.06 | 166.06 | 241.81 |
| net pay | 3776.51 | 2956.51 | 2956.51 | 3880.76 |
| clauses | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 | R1 R2 R3 R4 R5 R6 |
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"227b8baccea20880-payroll": {"kind": "payroll", "record": {"gross_pay": "4481.05", "payroll_month": "2026-05", "allowed_deduction": "0.00"}}}
Authoritative case reference schedule: {"first-half": {"rate": "0.08", "cap": "4500.00", "deduction": "400.00", "free": "1200.00", "upper": "3000.00", "middle_rate": "0.08", "upper_rate": "0.18"}, "second-half": {"rate": "0.05", "cap": "4500.00", "deduction": "400.00", "free": "900.00", "upper": "3000.00", "middle_rate": "0.08", "upper_rate": "0.24"}}
Rollouts
Rollout #1 -45.0% wrong taxable pay · 10.9s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 25.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4481.05",
"employee_contribution": "358.48",
"allowed_deduction": "0.00",
"taxable_pay": "3122.57",
"income_tax": "166.06",
"net_pay": "2956.51",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Case schedule first-half applies for 2026-05: contribution 0.08 \u00d7 min(4481.05, 4500.00) = 358.48; taxable pay 3122.57; tax = 1800.00\u00d70.08 + 122.57\u00d70.18 = 166.06; net = 4481.05 \u2212 358.48 \u2212 0.00 \u2212 166.06 = 2956.51."
}
Reasoning
First-half schedule: rate 0.08, cap 4500. Contribution = 4481.05*0.08 = 358.484 → 358.48. Taxable = 4481.05 - 358.48 - 0 = 3122.57. Tax: free 1200, upper 3000. Middle portion 1200→3000 = 1800*0.08 = 144. Above 3000: 122.57*0.18 = 22.0626 → total 166.0626 → 166.06. Net = 4481.05-358.48-0-166.06 = 2956.51.
Rollout #2 -45.0% wrong taxable pay · 14.3s · $0.0003
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 25.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4481.05",
"employee_contribution": "358.48",
"allowed_deduction": "0.00",
"taxable_pay": "3122.57",
"income_tax": "166.06",
"net_pay": "2956.51",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "Case schedule first-half applies (2026-05). Contribution 0.08*min(4481.05,4500)=358.48. Taxable 3122.57; tax = 1800*0.08 + 122.57*0.18 = 166.06. Net 2956.51."
}
Reasoning
First-half: rate 0.08, cap 4500. Contribution = 4481.05*0.08=358.484→358.48. Taxable = 4481.05−358.48−0=3122.57. Tax: free 1200, upper 3000. Middle band 1200–3000: 1800*0.08=144. Above 3000: 122.57*0.18=22.0626→ include in sum: total 166.0626→166.06. Net = 4481.05−358.48−0−166.06=2956.51.
Rollout #3 -40.0% wrong income tax · 4.1s · $0.0002
| Component | Score | Clauses |
|---|---|---|
| decision | 100.0% | R1 R2 R3 R4 R5 R6 |
| exact | 0.0% | R1 R2 R3 R4 R5 R6 |
| field accuracy | 50.0% | R1 R2 R3 R4 R5 R6 |
| citations | 100.0% | R1 R2 R3 R4 R5 R6 |
Assistant
{
"decision": "calculate",
"currency": "LCR",
"gross_pay": "4481.05",
"employee_contribution": "358.48",
"allowed_deduction": "0.00",
"taxable_pay": "4122.57",
"income_tax": "241.81",
"net_pay": "3880.76",
"clauses": ["R1", "R2", "R3", "R4", "R5", "R6"],
"explanation": "First-half schedule applies. Contribution 0.08\u00d74481.05=358.484\u2192358.48. Taxable 4481.05\u2212358.48=4122.57. Tax: 1200 free, (3000\u22121200)\u00d70.08=144.00, (4122.57\u22123000)\u00d70.18=202.0626\u2192 total 346.06? Recheck: 144.00+202.0626=346.0626\u2192346.06. Net 4481.05\u2212358.48\u22120\u2212346.06=3776.51."
}