Luma Payroll Gym
Rules Report
← Training / β 0.04, rubric 5
β 0.04, rubric 5
β 0.001, rubric 5 β 0.04, rubric 5 β 0.04, rubric 3 β 0.04, rubric 4 β 0.04, rubric 6 β 0.001, rubric 7 β 0.04, rubric 7 β 0.04, rubric 7, answer-weighted SFT + RL, β 0.001 SFT + RL, β 0.001, seed 8 SFT + RL, β 0.001, seed 9 SFT + RL, β 0.04 SFT + RL, β 0.04, balanced SFT + RL, β 0.04, more signal SFT + RL, β 10 SFT + RL, β 100
KL β
0.04
Rubric
5
Steps
100 / 100
LR
2e-05
Group size
4-4
Epochs
1
Prompt
balanced three-example scaffold, thinking disabled
GPU time
1.6h
Training curves, 100 steps

Mean reward

0% 20% 40% Step 0 Step 50 Step 100

KL divergence (k3)

0 0.05 0.1 Step 0 Step 50 Step 100

Policy entropy

0 0.1 0.2 0.3 Step 0 Step 50 Step 100

Completion length (tokens)

0 50 100 150 Step 0 Step 50 Step 100

Trap pass rate

0.0% 2.0% 4.0% 6.0% Step 0 Step 50 Step 100

Payslip pass rate

0% 20% 40% 60% Step 0 Step 50 Step 100

Non-tied groups

0% 50% 100% Step 0 Step 50 Step 100
Sampled completions
Step 1
generated-1001-00075 · Calculation
0% invalid · wrong decision
{"decision": "retrieve", "field": "employee_contribution", "value": "0.05", "clauses": ["R1", "R3", "R4"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "976.76", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "976.76", "employee_contribution": "50.00", "allowed_deduction": "350.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "976.76", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% invalid · invalid format
{"decision": "calculate", "currency": "LCR", "gross_pay": "976.76", "employee_contribution": "50.00", "allowed_deduction": "350.00", "taxable_pay": "950.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
generated-1001-00070 · Calculation
0% invalid · wrong decision
{"decision": "retrieve", "field": "contribution_rate", "value": "0.05", "clauses": ["R1", "R3"]}
0% invalid · invalid format
{"decision": "clarify", "reason_code": "MISSING_GROSS_PAY", "explanation": "Gross pay is missing. Please provide the monthly gross pay before calculation."}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "7022.36", "employee_contribution": "50.00", "allowed_deduction": "31.67", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% invalid · wrong decision
{"decision": "retrieve", "field": "contribution_rate", "value": "0.05", "clauses": ["R1", "R3"]}
generated-1001-00071 · Trap
0% invalid · wrong decision
{"decision": "retrieve", "field": "allowed_deduction", "value": "400.00", "clauses": ["R1", "R3", "R4"]}
0% invalid · wrong decision
{"decision": "retrieve", "field": "deduction_cap", "value": "3500.00", "clauses": ["R1", "R3", "R4", "R5", "R6"]}
0% invalid · invalid format
{"decision": "calculate", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"], "gross_pay": "3713.85", "employee_contribution": "164.48", "allowed_deduction": "400.00", "taxable_pay": "1000.00", "income_tax": "0.00", "net_pay": "3713.85", "reason": "Mention the correct contribution rate for the payroll month for accurate calculation."}
0% invalid · wrong decision
{"decision": "retrieve", "field": "deduction_cap", "value": "3500.00", "clauses": ["R1", "R3", "R4"]}
generated-1001-00054 · Calculation
0% invalid · wrong decision
{"decision": "retrieve", "field": "contribution_rate", "value": "0.03", "clauses": ["R1", "R3"]}
0% invalid · wrong decision
{"decision": "retrieve", "field": "contribution_rate", "value": "0.04", "clauses": ["R1"]}
0% invalid · wrong decision
{"decision": "retrieve", "field": "digit", "value": "0.04", "clauses": ["R1", "R5", "R6", "R7"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "6750.61", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "7251.50", "income_tax": "0.00", "net_pay": "7251.50", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
Step 50
generated-1001-00090 · Calculation
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "35.52", "allowed_deduction": "0.00", "taxable_pay": "689.36", "income_tax": "0.00", "net_pay": "704.36", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "0.05", "allowed_deduction": "350.00", "taxable_pay": "750.35", "income_tax": "0.00", "net_pay": "750.35", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "35.28", "allowed_deduction": "0.00", "taxable_pay": "674.80", "income_tax": "0.00", "net_pay": "674.80", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "0.05", "allowed_deduction": "0.00", "taxable_pay": "700.00", "income_tax": "0.00", "net_pay": "700.36", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
generated-1001-00047 · Trap
0% invalid · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "4500.02", "employee_contribution": "0.04", "allowed_deduction": "93.12", "taxable_pay": "0.00", "income_tax": "0.00", "net_pay": "4500.02", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% invalid · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "4500.02", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.02", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% invalid · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "4500.02", "employee_contribution": "50.00", "allowed_deduction": "93.12", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
0% invalid · wrong decision
{ "decision": "calculate", "currency": "LCR", "gross_pay": "4500.02", "employee_contribution": "93.12", "allowed_deduction": "93.12", "taxable_pay": "0.00", "income_tax": "0.00", "net_pay": "4500.02", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"] }
generated-1001-00096 · Trap
0% invalid · wrong decision
{ "decision": "calculate", "currency": "LCR", "gross_pay": "1000.00", "employee_contribution": "50.00", "allowed_deduction": "102.33", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"] }
0% invalid · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "1000.00", "employee_contribution": "50.00", "allowed_deduction": "102.33", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% invalid · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "1000.00", "employee_contribution": "50.00", "allowed_deduction": "102.33", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% invalid · wrong decision
{"decision": "calculate", "currency": "LCR", "gross_pay": "1000.00", "employee_contribution": "50.00", "allowed_deduction": "102.33", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
generated-1001-00021 · Calculation
5% invalid · scored
{ "decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"] }
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "51.99", "allowed_deduction": "0.00", "taxable_pay": "990.01", "income_tax": "0.00", "net_pay": "990.01", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "48.99", "allowed_deduction": "0.00", "taxable_pay": "950.01", "income_tax": "0.00", "net_pay": "950.01", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
Step 100
generated-1001-00069 · Calculation
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3510.62", "employee_contribution": "35.31", "allowed_deduction": "0.00", "taxable_pay": "3500.00", "income_tax": "0.00", "net_pay": "3500.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3510.62", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3510.62", "employee_contribution": "37.14", "allowed_deduction": "0.00", "taxable_pay": "3747.48", "income_tax": "0.00", "net_pay": "3747.48", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
0% invalid · invalid format
{"decision": "calculate", "currency": "LCR", "gross_pay": "3510.62", "employee_contribution": "0.00", "allowed_deduction": "0.00", "taxable_pay": "3510.62", "net_pay": "3510.62", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
generated-1001-00094 · Calculation
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "1170.19", "employee_contribution": "343.92", "allowed_deduction": "343.92", "taxable_pay": "323.09", "income_tax": "0.00", "net_pay": "323.09", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "1170.19", "employee_contribution": "50.00", "allowed_deduction": "343.92", "taxable_pay": "1100.00", "income_tax": "0.00", "net_pay": "1100.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "1170.19", "employee_contribution": "50.00", "allowed_deduction": "350.00", "taxable_pay": "970.00", "income_tax": "0.00", "net_pay": "970.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "1170.19", "employee_contribution": "343.92", "allowed_deduction": "343.92", "taxable_pay": "673.07", "income_tax": "0.00", "net_pay": "673.07", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6", "R7"]}
generated-1001-00021 · Calculation
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "50.00", "allowed_deduction": "35.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
5% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "3999.98", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "950.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
generated-1001-00090 · Calculation
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "750.00", "income_tax": "0.00", "net_pay": "750.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "35.04", "allowed_deduction": "350.00", "taxable_pay": "350.00", "income_tax": "0.00", "net_pay": "354.36", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "2800.00", "allowed_deduction": "350.00", "taxable_pay": "950.00", "income_tax": "0.00", "net_pay": "854.36", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}
9% invalid · scored
{"decision": "calculate", "currency": "LCR", "gross_pay": "704.36", "employee_contribution": "50.00", "allowed_deduction": "0.00", "taxable_pay": "850.00", "income_tax": "0.00", "net_pay": "850.00", "clauses": ["R1", "R2", "R3", "R4", "R5", "R6"]}