Luma Payroll Gym
← Heatmap / GLM 5.3 Flash · Task 104
GLM 5.3 Flash · Single-turn · Task 104 (Calculation, wage cap binds, resolved amendment) Mean 5.0%
Field Expected Rollout #1 (-35%) Rollout #2 (-50%) Rollout #3 (100%)
decision calculate calculate (malformed) calculate
currency LCR LCR (malformed) LCR
gross pay 5662.30 5662.30 (malformed) 5662.30
employee contribution 180.00 180.00 (malformed) 180.00
allowed deduction 169.02 169.02 (malformed) 169.02
taxable pay 5313.28 5313.28 (malformed) 5313.28
income tax 748.92 748.92 (malformed) 748.92
net pay 4564.36 4664.36 (malformed) 4564.36
clauses R1 R2 R3 R4 R5 R6 R9 R1 R2 R3 R4 R5 R6 R9 (malformed) R1 R2 R3 R4 R5 R6 R9
Prompt
Process this monthly payroll record under the supplied rulebook. Return the R6 or R7 JSON answer.
Source documents: {"1fb17c8b15731951-payroll": {"kind": "payroll", "record": {"gross_pay": "5662.30", "payroll_month": "2026-09", "allowed_deduction": "169.02"}}, "1fb17c8b15731951-contract": {"kind": "contract", "gross_pay": "6025.51"}, "1fb17c8b15731951-amendment": {"kind": "amendment", "gross_pay": "5662.30", "approved": true, "effective_month": "2026-03"}}
Authoritative case reference schedule: {"first-half": {"rate": "0.07", "cap": "3500.00", "deduction": "400.00", "free": "1100.00", "upper": "2800.00", "middle_rate": "0.14", "upper_rate": "0.20"}, "second-half": {"rate": "0.04", "cap": "4500.00", "deduction": "400.00", "free": "1000.00", "upper": "3000.00", "middle_rate": "0.12", "upper_rate": "0.22"}}
Rollouts
Rollout #1 -35.0% wrong net pay · 4.8s · $0.0007
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6 R9
exact 0.0% R1 R2 R3 R4 R5 R6 R9
field accuracy 75.0% R1 R2 R3 R4 R5 R6 R9
citations 100.0% R1 R2 R3 R4 R5 R6 R9
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "5662.30",
  "employee_contribution": "180.00",
  "allowed_deduction": "169.02",
  "taxable_pay": "5313.28",
  "income_tax": "748.92",
  "net_pay": "4664.36",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
  "explanation": "Payroll month 2026-09 selects the second-half row of the authoritative case schedule (rate 0.05? no ? rate 0.04, cap 4500.00, deduction cap 400.00, free 1000.00, upper 3000.00, middle 0.12, upper rate 0.22). The contract gross (6025.51) conflicts with the payroll record (5662.30), but the amendment is approved, effective 2026-03 (no later than 2026-09), and matches the payroll record amount, so the conflict is resolved per R9. Employee contribution = 0.04 \u00d7 min(5662.30, 4500.00) = 180.00. Allowed deduction 169.02 is within the 400.00 cap and within 5662.30 - 180.00. Taxable pay = 5662.30 - 180.00 - 169.02 = 5313.28. Income tax = 0.00 on the first 1000.00 + 0.12 \u00d7 2000.00 + 0.22 \u00d7 2313.28 = 748.92 (rounded once). Net pay = 5662.30 - 180.00 - 169.02 - 748.92 = 4664.36."
}
Reasoning
Let me work through this payroll case.

Payroll month: 2026-09 → second-half row of the authoritative case schedule:
- rate: 0.04
- cap: 4500.00
- deduction cap: 400.00
- tax-free: 1000.00
- upper begins: 3000.00
- middle rate: 0.12
- upper rate: 0.22

Gross pay: 5662.30 (payroll record). Contract says 6025.51, but amendment: gross_pay 5662.30, approved true, effective_month 2026-03 ≤ 2026-09, amount equals payroll record's gross pay (5662.30). So the amendment resolves the contract conflict under R9. So no clarification needed; calculate.

Employee contribution: rate × min(gross, cap) = 0.04 × min(5662.30, 4500.00) = 0.04 × 4500.00 = 180.00.

Allowed deduction check: must not exceed deduction cap (400.00) and not exceed gross pay minus rounded employee contribution = 5662.30 − 180.00 = 5482.30. Allowed deduction 169.02 is fine.

Taxable pay = 5662.30 − 180.00 − 169.02 = 5313.28.

Income tax (marginal):
- First 1000.00: 0 tax.
- 1000.00 to 3000.00: 2000.00 × 0.12 = 240.00.
- Above 3000.00: 5313.28 − 3000.00 = 2313.28 × 0.22 = 508.9216 → keep unrounded until sum. Sum = 240 + 508.9216 = 748.9216 → round to 748.92.

Net pay = 5662.30 − 180.00 − 169.02 − 748.92 = 4664.36.

Check: 5662.30 − 180.00 = 5482.30; − 169.02 = 5313.28; − 748.92 = 4664.36.

Fields:
- decision: "calculate"
- currency: "LCR"
- gross_pay: "5662.30"
- employee_contribution: "180.00"
- allowed_deduction: "169.02"
- taxable_pay: "5313.28"
- income_tax: "748.92"
- net_pay: "4664.36"

Clauses: R1 (row selection, schedule), R2 (rounding), R3 (contribution), R4 (deduction, taxable), R5 (tax), R6 (net pay/answer), and R9 (amendment resolves conflict).

Do not include input-only fields like payroll_month, contract_gross_pay, amendment. Include clauses.
Rollout #2 -50.0% malformed · 5.3s · $0.0006
ComponentScoreClauses
decision 0.0% R1 R2 R3 R4 R5 R6 R9
exact 0.0% R1 R2 R3 R4 R5 R6 R9
field accuracy 0.0% R1 R2 R3 R4 R5 R6 R9
citations 0.0% R1 R2 R3 R4 R5 R6 R9
Assistant
```json
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "5662.30",
  "employee_contribution": "180.00",
  "allowed_deduction": "169.02",
  "taxable_pay": "5313.28",
  "income_tax": "748.92",
  "net_pay": "4564.36",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
  "explanation": "The approved amendment (effective 2026-03, amount 5662.30 equal to the payroll gross pay) resolves the contract conflict under R9. Payroll month 2026-09 selects the second-half row of the case schedule. Employee contribution: 0.04 × min(5662.30, 4500.00) = 180.00. Allowed deduction 169.02 is within the 400.00 cap and within gross pay minus contribution. Taxable pay: 5662.30 − 180.00 − 169.02 = 5313.28. Marginal tax: 0.00 on first 1000.00, plus 2000.00 × 0.12 = 240.00, plus 2313.28 × 0.22 = 508.9216, total 748.9216 rounded to 748.92. Net pay: 5662.30 − 180.00 − 169.02 − 748.92 = 4564.36."
}
```
Reasoning
Let me work through this payroll case.

Inputs:
- Payroll record: gross_pay = 5662.30, payroll_month = 2026-09, allowed_deduction = 169.02
- Contract gross_pay = 6025.51
- Amendment: gross_pay = 5662.30, approved = true, effective_month = 2026-03

Reference schedule (authoritative, replaces defaults):
- Second-half (2026-07 through 2026-12): rate = 0.04, cap = 4500.00, deduction = 400.00, free = 1000.00, upper = 3000.00, middle_rate = 0.12, upper_rate = 0.22

Payroll month 2026-09 → second-half row.

Check R7 order:
1. gross_pay present: 5662.30 ✓
2. payroll_month present: 2026-09 ✓
3. Month covered: 2026-09 in second-half ✓
4. Contract conflict: contract gross_pay = 6025.51 differs from payroll gross_pay = 5662.30. Amendment present: approved = true, effective_month 2026-03 ≤ 2026-09, amount 5662.30 equals payroll gross_pay 5662.30. So conflict is resolved under R9. Cite R9.

Calculate:
- Employee contribution: rate 0.04 × min(5662.30, 4500.00) = 0.04 × 4500.00 = 180.00
- Allowed deduction check: 169.02 ≤ deduction cap 400.00 ✓; must not exceed gross pay minus contribution: 5662.30 − 180.00 = 5482.30; 169.02 ≤ 5482.30 ✓
- Taxable pay: 5662.30 − 180.00 − 169.02 = 5313.28
- Income tax (second-half: free = 1000.00, upper = 3000.00, middle_rate = 0.12, upper_rate = 0.22):
  - Portion up to 1000.00: untaxed
  - 1000.00 to 3000.00: 2000.00 × 0.12 = 240.00
  - Above 3000.00: 5313.28 − 3000.00 = 2313.28 × 0.22 = 508.9216
  - Total tax = 240.00 + 508.9216 = 748.9216 → round to 748.92
- Net pay: 5662.30 − 180.00 − 169.02 − 748.92 = 4564.36

Check: 5662.30 − 180.00 = 5482.30; 5482.30 − 169.02 = 5313.28; 5313.28 − 748.92 = 4564.36. ✓

Answer fields:
- decision: "calculate"
- currency: "LCR"
- gross_pay: "5662.30"
- employee_contribution: "180.00"
- allowed_deduction: "169.02"
- taxable_pay: "5313.28"
- income_tax: "748.92"
- net_pay: "4564.36"
- clauses: R1, R2, R3, R4, R5, R6, R9

The amendment was needed to resolve the conflict, so cite R9 (Calculated answers cite R1 through R6, and also R9 only when an amendment is needed to resolve a conflict).

Maybe add explanation about the schedule being used and amendment resolving conflict.
Rollout #3 100.0% passed · 4.4s · $0.0005
ComponentScoreClauses
decision 100.0% R1 R2 R3 R4 R5 R6 R9
exact 100.0% R1 R2 R3 R4 R5 R6 R9
field accuracy 100.0% R1 R2 R3 R4 R5 R6 R9
citations 100.0% R1 R2 R3 R4 R5 R6 R9
Assistant
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "5662.30",
  "employee_contribution": "180.00",
  "allowed_deduction": "169.02",
  "taxable_pay": "5313.28",
  "income_tax": "748.92",
  "net_pay": "4564.36",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"],
  "explanation": "The payroll month 2026-09 selects the second-half row of the authoritative case schedule. The contract gross pay (6025.51) conflicts with the payroll record (5662.30), but the approved amendment effective 2026-03 matches the payroll record's gross pay, resolving the conflict under R9. Contribution: 0.04 \u00d7 min(5662.30, 4500.00) = 180.00. Allowed deduction 169.02 is within the 400.00 cap and below available pay (5662.30 \u2212 180.00 = 5482.30). Taxable pay: 5662.30 \u2212 180.00 \u2212 169.02 = 5313.28. Tax: first 1000.00 untaxed, (3000.00 \u2212 1000.00) \u00d7 0.12 = 240.00, (5313.28 \u2212 3000.00) \u00d7 0.22 = 508.9216, total 748.9216 rounded to 748.92. Net pay: 5662.30 \u2212 180.00 \u2212 169.02 \u2212 748.92 = 4564.36."
}
Reasoning
Let me work through this payroll record.

Payroll month: 2026-09 → second-half row of the case schedule: rate 0.04, cap 4500.00, deduction cap 400.00, free 1000.00, upper 3000.00, middle_rate 0.12, upper_rate 0.22.

Gross pay: 5662.30. Contract gross pay: 6025.51. Conflict? Amendment present: gross_pay 5662.30, approved true, effective_month 2026-03 (no later than 2026-09), and amount equals payroll record's gross pay (5662.30). So the amendment resolves the conflict under R9. Cite R7 and... wait, R7 item 4: conflict resolved under R9 via approved amendment → calculate. Calculated answers cite R1 through R6, and also R9 when amendment resolves conflict.

Employee contribution: 0.04 × min(5662.30, 4500.00) = 0.04 × 4500.00 = 180.00.

Allowed deduction: 169.02. Check: ≤ 400.00 cap, and ≤ gross pay minus contribution = 5662.30 − 180.00 = 5482.30. OK.

Taxable pay: 5662.30 − 180.00 − 169.02 = 5313.28.

Income tax: free up to 1000.00 → 0. Middle: (3000.00 − 1000.00) × 0.12 = 2000.00 × 0.12 = 240.00. Upper: (5313.28 − 3000.00) × 0.22 = 2313.28 × 0.22 = 508.9216 → sum = 240.00 + 508.9216 = 748.9216 → round half up 748.92.

Net pay: 5662.30 − 180.00 − 169.02 − 748.92 = 4564.36.

Check: 5662.30 − 180.00 = 5482.30; − 169.02 = 5313.28; − 748.92 = 4564.36. Yes.

Output JSON:
{
  "decision": "calculate",
  "currency": "LCR",
  "gross_pay": "5662.30",
  "employee_contribution": "180.00",
  "allowed_deduction": "169.02",
  "taxable_pay": "5313.28",
  "income_tax": "748.92",
  "net_pay": "4564.36",
  "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R9"]
}

Maybe include an explanation. The rules say confirmation no extra fields beyond allowed ones plus explanation optional. I'll include a brief explanation.