Training Results Master Summary
Executive Snapshot
Generated At:
2026-04-14T17:40:47Program State: active
Current Completed Wave:
Wave 1structured-baseline familywise optimization passCurrent Focus: the immediate implementation branch is now the offline
Active Campaign Status:
finishedActive Campaign Name:
track1_svm_open_cell_repair_campaign_2026_04_14_17_17_21Current Global Winner:
te_hist_gbr_tabular| Familytree| Test MAE0.002885
Main Takeaways
Strongest current neural family:
residual_harmonic_mlpCurrent plain MLP anchor:
te_feedforward_stride1_high_compute_long_remoteActive family-improvement branch count:
0Implemented and benchmarked family count:
5
Current Project Status
Implemented And Benchmarked Families
Family |
Current Role |
Best Run |
Model Type |
Test MAE [deg] |
Params |
Last Update |
|---|---|---|---|---|---|---|
|
Current Global Winner |
|
|
0.002885 |
5 |
|
|
Strongest Neural Family |
|
|
0.003152 |
26,266 |
|
|
Current Plain MLP Anchor |
|
|
0.003264 |
109,953 |
|
|
Implemented Benchmark |
|
|
0.003317 |
27,265 |
|
|
Implemented Benchmark |
|
|
0.020782 |
150 |
|
Active Training Or Improvement Branches
No campaign is currently in
preparedorrunningstate.The next active implementation branch should therefore be read from the live backlog focus and the next approved campaign plan.
Roadmap And Planned Work
Wave Or Track |
Status |
|---|---|
Wave 0. Shared Infrastructure |
completed |
Wave 1. Structured Static Baselines |
planning report: completed; implementation: completed; smoke-tests: completed; validation checks: completed; campaign execution: completed; results report: completed |
Wave 2. Temporal Models |
planned after the harmonic-wise intermediate branch; temporal-model scope will start only after the harmonic-wise comparison |
Intermediate Branch. Harmonic-Wise Comparison Pipeline |
current primary implementation branch; focused scope: implement harmonic-wise prediction of |
Wave 3. Hybrid Structured Models |
pending; paper-reproduction scope:; compare hybrid structured predictors against the paper-style harmonic stack; prepare the repository-owned deployable predictor package |
Wave 4. PINN Formulation And First PINN |
pending; paper-reproduction scope:; implement the repository-side compensation-loop evaluation path in the; implement uncompensated vs compensated |
Wave 5. Cross-Wave Comparison And Best Solution |
pending; paper-reproduction scope:; execute Table 9 style online compensation tests; evaluate |
Low-priority exploratory families currently listed in the backlog:
Lightweight TransformerState-Space Sequence ModelNeural ODEHamiltonian-Inspired Modeloptional Kernel Ridge / Gaussian Process benchmark
Recent Campaign Changes
Campaign |
Generated At |
Completed |
Failed |
Winner |
Impact |
|---|---|---|---|---|---|
|
|
12 |
0 |
|
Canonical |
|
|
20 |
0 |
|
Full paper-matrix row-reproduction surface prepared; no family-best registry change |
|
|
8 |
0 |
|
No family-best change |
|
|
5 |
0 |
|
No family-best change |
|
|
4 |
1 |
|
No family-best change |
|
|
15 |
0 |
|
Updated residual_harmonic_mlp family best |
|
|
6 |
0 |
|
No family-best change |
Ranking Policy
Primary metric:
test_maeFirst tie-breaker:
test_rmseSecond tie-breaker:
val_maeThird tie-breaker:
trainable_parameter_countDirection:
minimize
Best Result Per Family
Family |
Best Run |
Model Type |
Val MAE [deg] |
Test MAE [deg] |
Test RMSE [deg] |
Params |
Artifact Size |
Training Cost |
Current Role |
|---|---|---|---|---|---|---|---|---|---|
|
|
|
0.002719 |
0.002885 |
0.003607 |
5 |
0.62 MB |
Unknown |
Current Global Winner |
|
|
|
0.003024 |
0.003152 |
0.003640 |
26,266 |
0.32 MB |
Medium |
Strongest Neural Family |
|
|
|
0.003044 |
0.003264 |
0.003679 |
109,953 |
1.28 MB |
Medium |
Current Plain MLP Anchor |
|
|
|
0.003097 |
0.003317 |
0.003793 |
27,265 |
0.33 MB |
Medium |
Implemented Benchmark |
|
|
|
0.017004 |
0.020782 |
0.022405 |
150 |
0.01 MB |
Low |
Implemented Benchmark |
Cross-Family Interpretation
Current global reference winner:
te_hist_gbr_tabularfrom familytree.Strongest current neural family:
residual_harmonic_mlp.Current plain-MLP comparison anchor:
te_feedforward_stride1_high_compute_long_remote.Predictive quality and deployment suitability must stay separate: the best leaderboard entry is not automatically the best TwinCAT/PLC candidate.
Large tree artifacts should be treated cautiously even when tree-based accuracy remains strong, because model weight and memory footprint can dominate deployment feasibility.
Paper Reference Benchmark
The repository benchmark paper is reference/RCIM_ML-compensation.pdf.
At the current repository state, the comparison is explicitly offline-only. A real paper-equivalent comparison still requires repository-owned online compensation tests.
Extracted Paper Targets
Paper dataset size:
1026operating-condition samples.Paper input axes:
input speed,applied torque,oil temperature.Offline prediction target: TE-curve mean percentage error at or below
4.7%on unseen validation scenarios.Online
robotcompensation target: at least83.6%TE RMS reduction.Online
cycloidalcompensation target: at least94.0%TE RMS reduction and91.7%TE max reduction.Paper compensation harmonics baseline:
0, 1, 39with additional checks on40, 78.
Paper Vs Repository
Comparison Item |
Paper Reference |
Repository Status |
Current Verdict |
|---|---|---|---|
Offline model-selection direction |
Boosting/tree-heavy deployed harmonic predictors |
Current winner |
aligned |
Strongest neural branch role |
Neural models are evaluated, but not the primary deployed winners |
Strongest repository neural family is |
aligned |
Track 1 canonical closure rule |
Paper Tables |
Full-matrix benchmark now includes the repaired |
not_yet_met |
Supporting harmonic-wise TE metric |
Mean percentage error over full TE curves |
Latest harmonic-wise validation reports |
supporting_only_not_yet_met |
Online robot-profile compensation |
TE RMS reduction |
No repository-owned online compensation result yet |
not_yet_comparable |
Online cycloidal-profile compensation |
TE RMS reduction |
No repository-owned online compensation result yet |
not_yet_comparable |
Table 9-style end-to-end benchmark |
PLC-integrated motion-profile compensation benchmark |
Missing in the repository at the current state |
not_yet_comparable |
Track 1 Canonical Status
Latest exact-paper repair campaign report:
doc/reports/campaign_results/2026-04-14-17-40-47_track1_svm_open_cell_repair_campaign_results_report.mdFull paper-matrix row package status:
20/20family-row runs completed, plus12/12targetedSVMrepair runs completedTable
2amplitudeMAEfull matrix:53green,37yellow,10red cellsTable
3amplitudeRMSEfull matrix:52green,35yellow,13red cellsTable
4phaseMAEfull matrix:52green,37yellow,1red cellTable
5phaseRMSEfull matrix:43green,41yellow,6red cellsStrongest current rows:
track1_rf_phase_full_matrix,track1_ert_amplitude_full_matrix,track1_hgbm_amplitude_full_matrix, plus the repaired mergedSVMrowTrack 1verdict: full-matrix replication surface exists andSVMis no longer a blocker row, but the paper rows are not yet fully reproduced
Latest Harmonic-Wise Validation Support
Latest harmonic-wise validation summary:
output/validation_checks/paper_reimplementation_rcim_harmonic_wise/2026-04-13-15-11-49__track1_hgbm_h01_wide_depth_2_campaign_run/validation_summary.yamlHarmonic-wise test mean percentage error:
8.707%Target Astatus from the latest harmonic-wise run:not_yet_met
Online Compensation Tracking Placeholder
Repository online compensation status:
not yet available.When online compensation tests are implemented, update this master summary with TE RMS, TE max, and reduction percentages for both robot and cycloidal motion profiles.
Until those tests exist, present the paper comparison as
offline-onlyrather than end-to-end equivalent.
Gap Summary
Track 1remains open primarily because the canonical Tables3-6are not yet fully matched.Offline benchmark scope remains
partially comparablerather than like-for-like.Partially aligned: the current repository winner is tree-based (
hist_gradient_boosting/ familytree), which is consistent with the paper’s boosting/tree-heavy deployed predictors.Neural models remain secondary in the repository (
residual_harmonic_mlp), which is also consistent with the paper not promoting a plain neural winner for deployment.End-to-end paper comparison remains
not yet comparableuntil repository-owned online compensation tests exist.
Family-By-Family Result Breakdowns
feedforward
Best run:
te_feedforward_stride1_high_compute_long_remoteBest test MAE:
0.003264Completed tracked runs:
20Known failed campaign attempts:
0
Rank |
Run |
Model Type |
Test MAE [deg] |
Test RMSE [deg] |
Val MAE [deg] |
Params |
Duration |
Artifact Size |
Model Complexity |
Training Heaviness |
Campaign |
|---|---|---|---|---|---|---|---|---|---|---|---|
1 |
|
|
0.003264 |
0.003679 |
0.003044 |
109,953 |
30m 09s |
1.28 MB |
High |
Medium |
|
2 |
|
|
0.003274 |
0.003873 |
0.003059 |
109,953 |
10m 24s |
1.28 MB |
High |
Low |
|
3 |
|
|
0.003278 |
0.003671 |
0.003019 |
109,953 |
29m 55s |
1.28 MB |
High |
Medium |
|
4 |
|
|
0.003301 |
0.003791 |
0.003109 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
5 |
|
|
0.003308 |
0.003779 |
0.003090 |
109,953 |
N/A |
1.28 MB |
High |
Unknown |
|
6 |
|
|
0.003319 |
0.003915 |
0.003198 |
109,953 |
N/A |
1.28 MB |
High |
Unknown |
|
7 |
|
|
0.003335 |
0.003767 |
0.003007 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
8 |
|
|
0.003358 |
0.003769 |
0.003104 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
9 |
|
|
0.003409 |
0.003948 |
0.003039 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
10 |
|
|
0.003413 |
0.004063 |
0.003040 |
109,953 |
N/A |
1.28 MB |
High |
Unknown |
|
11 |
|
|
0.003433 |
0.004123 |
0.003066 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
12 |
|
|
0.003472 |
0.004004 |
0.003104 |
109,953 |
N/A |
1.28 MB |
High |
Unknown |
|
13 |
|
|
0.003483 |
0.004050 |
0.003053 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
14 |
|
|
0.003504 |
0.003969 |
0.003148 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
15 |
|
|
0.003519 |
0.004046 |
0.003077 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
16 |
|
|
0.003535 |
0.004211 |
0.003618 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
17 |
|
|
0.003542 |
0.004228 |
0.003058 |
109,953 |
13m 24s |
1.28 MB |
High |
Low |
|
18 |
|
|
0.003580 |
0.004008 |
0.003178 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
19 |
|
|
0.003646 |
0.003990 |
0.003126 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
20 |
|
|
0.003671 |
0.004418 |
0.003706 |
26,241 |
N/A |
0.32 MB |
Medium |
Unknown |
|
harmonic_regression
Best run:
te_harmonic_order12_linear_conditioned_recoveryBest test MAE:
0.020782Completed tracked runs:
3Known failed campaign attempts:
3
Rank |
Run |
Model Type |
Test MAE [deg] |
Test RMSE [deg] |
Val MAE [deg] |
Params |
Duration |
Artifact Size |
Model Complexity |
Training Heaviness |
Campaign |
|---|---|---|---|---|---|---|---|---|---|---|---|
1 |
|
|
0.020782 |
0.022405 |
0.017004 |
150 |
9m 45s |
0.01 MB |
Very Low |
Low |
|
2 |
|
|
0.039404 |
0.042797 |
0.040524 |
25 |
10m 53s |
0.01 MB |
Very Low |
Low |
|
3 |
|
|
0.039406 |
0.042796 |
0.040529 |
13 |
9m 05s |
0.01 MB |
Very Low |
Low |
|
Known failed campaign attempts for this family:
te_harmonic_order06_static| campaignwave1_structured_baseline_campaign_2026_03_17_21_01_47| model typeharmonic_regression| error'hidden_size'te_harmonic_order12_static| campaignwave1_structured_baseline_campaign_2026_03_17_21_01_47| model typeharmonic_regression| error'hidden_size'te_harmonic_order12_linear_conditioned| campaignwave1_structured_baseline_campaign_2026_03_17_21_01_47| model typeharmonic_regression| error'hidden_size'
periodic_mlp
Best run:
te_periodic_mlp_h04_standardBest test MAE:
0.003317Completed tracked runs:
3Known failed campaign attempts:
0
Rank |
Run |
Model Type |
Test MAE [deg] |
Test RMSE [deg] |
Val MAE [deg] |
Params |
Duration |
Artifact Size |
Model Complexity |
Training Heaviness |
Campaign |
|---|---|---|---|---|---|---|---|---|---|---|---|
1 |
|
|
0.003317 |
0.003793 |
0.003097 |
27,265 |
16m 22s |
0.33 MB |
Medium |
Medium |
|
2 |
|
|
0.003395 |
0.003951 |
0.003086 |
28,289 |
16m 46s |
0.35 MB |
Medium |
Medium |
|
3 |
|
|
0.003590 |
0.004143 |
0.003089 |
47,745 |
17m 22s |
0.57 MB |
Medium |
Medium |
|
residual_harmonic_mlp
Best run:
te_residual_h12_deep_joint_wave1Best test MAE:
0.003152Completed tracked runs:
19Known failed campaign attempts:
2
Rank |
Run |
Model Type |
Test MAE [deg] |
Test RMSE [deg] |
Val MAE [deg] |
Params |
Duration |
Artifact Size |
Model Complexity |
Training Heaviness |
Campaign |
|---|---|---|---|---|---|---|---|---|---|---|---|
1 |
|
|
0.003152 |
0.003640 |
0.003024 |
26,266 |
28m 48s |
0.32 MB |
Medium |
Medium |
|
2 |
|
|
0.003230 |
0.003704 |
0.003001 |
4,890 |
21m 29s |
0.07 MB |
Low |
Medium |
|
3 |
|
|
0.003274 |
0.003747 |
0.003020 |
4,898 |
20m 09s |
0.07 MB |
Low |
Medium |
|
4 |
|
|
0.003278 |
0.003814 |
0.002924 |
17,946 |
22m 45s |
0.22 MB |
Medium |
Medium |
|
5 |
|
|
0.003302 |
0.003909 |
0.002935 |
4,890 |
18m 07s |
0.07 MB |
Low |
Medium |
|
6 |
|
|
0.003359 |
0.003852 |
0.003027 |
4,890 |
21m 04s |
0.07 MB |
Low |
Medium |
|
7 |
|
|
0.003360 |
0.003835 |
0.003089 |
4,634 |
12m 49s |
0.07 MB |
Low |
Low |
|
8 |
|
|
0.003365 |
0.003868 |
0.003018 |
26,266 |
13m 28s |
0.32 MB |
Medium |
Low |
|
9 |
|
|
0.003368 |
0.003898 |
0.003036 |
4,865 |
23m 21s |
0.07 MB |
Low |
Medium |
|
10 |
|
|
0.003376 |
0.003906 |
0.002884 |
17,946 |
31m 23s |
0.22 MB |
Medium |
Medium |
|
11 |
|
|
0.003384 |
0.003908 |
0.002973 |
26,266 |
15m 58s |
0.32 MB |
Medium |
Medium |
|
12 |
|
|
0.003384 |
0.003912 |
0.003007 |
4,865 |
18m 38s |
0.07 MB |
Low |
Medium |
|
13 |
|
|
0.003385 |
0.003862 |
0.003030 |
4,882 |
11m 22s |
0.07 MB |
Low |
Low |
|
14 |
|
|
0.003406 |
0.003863 |
0.002968 |
9,498 |
22m 14s |
0.13 MB |
Low |
Medium |
|
15 |
|
|
0.003410 |
0.003790 |
0.002962 |
4,890 |
26m 57s |
0.07 MB |
Low |
Medium |
|
16 |
|
|
0.003465 |
0.003944 |
0.002987 |
4,890 |
27m 44s |
0.07 MB |
Low |
Medium |
|
17 |
|
|
0.003466 |
0.003967 |
0.003016 |
4,890 |
16m 51s |
0.07 MB |
Low |
Medium |
|
18 |
|
|
0.003554 |
0.004061 |
0.003030 |
4,865 |
17m 29s |
0.07 MB |
Low |
Medium |
|
19 |
|
|
0.003557 |
0.004064 |
0.003090 |
4,890 |
11m 20s |
0.07 MB |
Low |
Low |
|
Known failed campaign attempts for this family:
te_residual_h12_small_frozen| campaignwave1_structured_baseline_campaign_2026_03_17_21_01_47| model typeresidual_harmonic_mlp| error'hidden_size'te_residual_h12_small_joint| campaignwave1_structured_baseline_campaign_2026_03_17_21_01_47| model typeresidual_harmonic_mlp| error'hidden_size'
tree
Best run:
te_hist_gbr_tabularBest test MAE:
0.002885Completed tracked runs:
5Known failed campaign attempts:
2
Rank |
Run |
Model Type |
Test MAE [deg] |
Test RMSE [deg] |
Val MAE [deg] |
Params |
Duration |
Artifact Size |
Model Complexity |
Training Heaviness |
Campaign |
|---|---|---|---|---|---|---|---|---|---|---|---|
1 |
|
|
0.002885 |
0.003607 |
0.002719 |
5 |
N/A |
0.62 MB |
Light Artifact |
Unknown |
|
2 |
|
|
0.002920 |
0.003644 |
0.002749 |
5 |
1m 55s |
0.91 MB |
Light Artifact |
Very Low |
|
3 |
|
|
0.003101 |
0.003781 |
0.002809 |
5 |
1m 46s |
0.84 MB |
Light Artifact |
Very Low |
|
4 |
|
|
0.003833 |
0.004809 |
0.003792 |
5 |
1h 16m 53s |
7.09 GB |
Extreme Artifact |
High |
|
5 |
|
|
0.003865 |
0.004861 |
0.003808 |
5 |
N/A |
85.40 GB |
Extreme Artifact |
Unknown |
|
Known failed campaign attempts for this family:
te_random_forest_remote_aggressive| campaignremote_training_validation_campaign_2026_04_03_17_54_21| model typerandom_forest| errorcould not allocate 536870912 byteste_random_forest_tabular| campaignwave1_structured_baseline_campaign_2026_03_17_21_01_47| model typerandom_forest| errorcould not allocate 134217728 bytes
Source Of Truth
Live backlog:
doc/running/te_model_live_backlog.mdActive campaign state:
doc/running/active_training_campaign.yamlProgram registry:
output/registries/program/current_best_solution.yamlFamily registries root:
output/registries/familiesTraining campaign root:
output/training_campaignsTraining run root:
output/training_runsPaper reference report:
doc/reports/analysis/RCIM Paper Reference Benchmark.md
This document is repository-generated. Regenerate it after new campaign results so the cross-family snapshot stays aligned with the canonical registries and campaign artifacts.