Luma Payroll Gym
Rules Report
← Training / β 0.04, rubric 6
β 0.04, rubric 6
β 0.001, rubric 5 β 0.04, rubric 5 β 0.04, rubric 3 β 0.04, rubric 4 β 0.04, rubric 6 β 0.001, rubric 7 β 0.04, rubric 7 β 0.04, rubric 7, answer-weighted SFT + RL, β 0.001 SFT + RL, β 0.001, seed 8 SFT + RL, β 0.001, seed 9 SFT + RL, β 0.04 SFT + RL, β 0.04, balanced SFT + RL, β 0.04, more signal SFT + RL, β 10 SFT + RL, β 100
KL β
0.04
Rubric
6
Steps
23 / 80
LR
1e-05
Group size
4-16
Epochs
2
Prompt
decision examples, thinking disabled
GPU time
1.0h
Training curves, 23 steps

Mean reward

0% 20% 40% Step 0 Step 40 Step 80

KL divergence (k3)

0 0.05 0.1 0.15 Step 0 Step 40 Step 80

Policy entropy

0 0.2 0.4 Step 0 Step 40 Step 80

Completion length (tokens)

0 50 100 150 Step 0 Step 40 Step 80

Trap pass rate

0% 20% 40% Step 0 Step 40 Step 80

Payslip pass rate

0.0% 2.0% 4.0% 6.0% Step 0 Step 40 Step 80

Correct clarifications

0% 50% 100% Step 0 Step 40 Step 80

Calculates through traps

0% 50% 100% Step 0 Step 40 Step 80

Non-tied groups

0% 20% 40% 60% Step 0 Step 40 Step 80
Sampled completions
Step 1
generated-1001-00064 · Calculation
0% retrieve · wrong decision
{"decision": "retrieve", "field": "contribution_rate", "value": "0.04", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"], "explanation": "The task requires retrieving information from the rulebook based on the provided month, and R1 and R2 are needed for the calculation. These are the required tools and sources for the task."}
0% calculate · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "6717.67", "employee_contribution": "1075.95", "allowed_deduction": "326.05", "taxable_pay": "1075.45", "income_tax": "65.25", "net_pay": "1061.30", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
0% calculate · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "6717.67", "employee_contribution": "1103.67", "allowed_deduction": "326.05", "taxable_pay": "1824.98", "income_tax": "39.30", "net_pay": "1794.38", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
0% calculate · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "6717.67", "employee_contribution": "1001.63", "allowed_deduction": "1001.63", "taxable_pay": "1822.25", "income_tax": "42.25", "net_pay": "4794.49", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7", "R9"]}
generated-1001-00055 · Calculation
0% retrieve · wrong decision
{"decision": "retrieve", "field": "2026-11", "value": "2891.48", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% calculate · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "2891.48", "employee_contribution": "144.48", "allowed_deduction": "0.00", "taxable_pay": "2314.00", "income_tax": "38.50", "net_pay": "2063.98", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% calculate · scored
{ "decision": "calculate", "currency": "LCR", "gross_pay": "2891.48", "employee_contribution": "1727.00", "allowed_deduction": "0.00", "taxable_pay": "2058.48", "income_tax": "107.00", "net_pay": "2174.48", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7", "R9"] }
0% retrieve · wrong decision
{"decision": "retrieve", "field": "2026-11-05", "value": "2891.48", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
generated-1001-00092 · Trap CONFLICTING_GROSS_PAY
0% calculate · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "6265.40", "employee_contribution": "217.00", "allowed_deduction": "217.79", "taxable_pay": "2178.79", "income_tax": "43.40", "net_pay": "6040.10", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% calculate · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "6265.40", "employee_contribution": "1308.26", "allowed_deduction": "217.79", "taxable_pay": "2100.51", "income_tax": "210.21", "net_pay": "4062.20", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
generated-1001-00096 · Trap MISSING_GROSS_PAY
0% retrieve · invalid format
{"decision": "retrieve", "field": "contribution_rate", "value": "0.08", "clauses": ["R1", "R3", "R4"], "clauses": ["R1", "R3", "R4", "R5"]}
0% calculate · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "2400.00", "employee_contribution": "120.00", "allowed_deduction": "100.00", "taxable_pay": "2180.00", "income_tax": "118.00", "net_pay": "2062.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
0% calculate · wrong decision
{ "decision": "calculate", "currency": "LCR", "gross_pay": "2400.00", "employee_contribution": "120.00", "allowed_deduction": "100.00", "taxable_pay": "2180.00", "income_tax": "118.00", "net_pay": "2062.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"] }
0% calculate · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "1800.00", "employee_contribution": "102.33", "allowed_deduction": "102.33", "taxable_pay": "2142.00", "income_tax": "429.33", "net_pay": "1789.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
Step 11
generated-1001-00043 · Calculation
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "clauses": ["R1", "R7"], "explanation": "No reference row covers this payroll month. Please provide an authoritative schedule that covers it."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_PAYROLL_MONTH", "clauses": ["R1", "R7"], "explanation": "The payroll month is missing, so no reference row can be chosen. Please provide an authoritative schedule that covers this month."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "clauses": ["R1", "R7"], "explanation": "No reference row covers this payroll month. Please provide an authoritative schedule that covers it."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_PAYROLL_MONTH", "clauses": ["R1", "R7"], "explanation": "The provided payroll month (2026-08) is not covered by the default 2026 first-half or second-half reference tables. No reference row applies, so this data is invalid for calculation."}
generated-1001-00040 · Calculation
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% calculate · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "6173.69", "employee_contribution": "240.69", "allowed_deduction": "100.00", "taxable_pay": "2100.00", "income_tax": "60.00", "net_pay": "5072.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% calculate · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "6173.69", "employee_contribution": "289.29", "allowed_deduction": "100.00", "taxable_pay": "2192.00", "income_tax": "1178.35", "net_pay": "2014.40", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
generated-1001-00042 · Trap CONFLICTING_GROSS_PAY
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_PAYROLL_MONTH", "clauses": ["R1", "R7"], "explanation": "The payroll month is missing, so no reference row can be chosen. Please provide an authoritative schedule that covers it."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
generated-1001-00026 · Trap MISSING_GROSS_PAY
0% calculate · invalid format
{"decision": "calculate", "currency": "LCR", "gross_pay": null, "employee_contribution": null, "allowed_deduction": null, "taxable_pay": null, "income_tax": null, "net_pay": null, "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
97% clarify · scored
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_PAYROLL_MONTH", "clauses": ["R1", "R7"], "explanation": "The provided record uses 2026-12, which is one half of the 2026 calendar months. No reference row covers 2026-12 in the 2026 calendar months. Please provide a reference row or confirm the 2026 calendar month."}
0% invalid · invalid format
{"decision": "calculate", "currency": "LCR", "gross_pay": "1800.00", "employee_contribution": "1800.00 * 66.63 = 1193.61", "allowed_deduction": "66.63", "taxable_pay": "1193.61 * 0.06 then 0.04, then 0.10, then 0.24 = 1193.61 * 0.06 = 71.61, 1193.61 * 0.04 = 47.7444, 1193.61 * 0.10 = 119.361, 1193.61 * 0.24 = 287.1624", "income_tax": 0.04 * 1193.61 = 47.7444, 0.10 * 1193.61 = 119.361, 0.24 * 1193.61 = 287.1624, "net_pay": 1800.00 - 1193.61 * 0.06 - 1193.61 * 0.04 - 1193.61 * 0.10 - 1193
Step 23
generated-1001-00037 · Calculation
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "clauses": ["R1", "R7"], "explanation": "The provided record lacks a reference row for the specified payroll month, which is required for R6 calculation. A reference row must be available for the month under R1. Please provide an authoritative reference table for the 2026-03 month."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
generated-1001-00078 · Calculation
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "clauses": ["R1", "R7"], "explanation": "No reference row covers this payroll month. Please provide an authoritative schedule that covers it."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "clauses": ["R1", "R7"], "explanation": "No reference row covers the given payroll month. Please provide an authoritative schedule that covers the month."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_PAYROLL_MONTH", "clauses": ["R1", "R7"], "explanation": "The payroll month is missing, so no reference row can be chosen. Please provide an authoritative schedule that covers this month."}
0% clarify · wrong decision
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
generated-1001-00062 · Trap CONFLICTING_GROSS_PAY
0% clarify · invalid format
{"decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "explanation": "No reference row covers this payroll month. Please provide an authoritative schedule that covers it."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_PAYROLL_MONTH", "clauses": ["R1", "R7"], "explanation": "Missing `payroll_month` requires clarification as the reference is not available, so the process will need to provide the correct month to proceed."}
generated-1001-00053 · Trap MISSING_GROSS_PAY
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "clauses": ["R1", "R7"], "explanation": "No reference row covers this payroll month. Please provide an authoritative schedule that covers it."}
100% clarify · scored
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "clauses": ["R1", "R7"], "explanation": "Gross pay is missing. Provide the monthly gross pay before calculation."}
0% clarify · wrong clarification
{"decision": "clarify", "reason_code": "MISSING_PAYROLL_MONTH", "clauses": ["R1", "R7"], "explanation": "The payroll month (2026-09) is not covered by the reference table. Please provide the correct reference row for this month."}
0% clarify · invalid format
{ "decision": "clarify", "reason_code": "NO_APPLICABLE_REFERENCE", "explanation": "No reference row covers this payroll month. Please provide an authoritative schedule that covers it." }