3 of the 102 libraries were not tested in the same version, or not with the same configuration and reference files, in the two runs; see Library Changes below.
76 libraries of the baseline run were not tested by the pull request run: AixLib_latest, AixLib_master, Annex60, Annex60_1.0.0, Buildings, Buildings_1.6, Buildings_10, Buildings_2.0.0, Buildings_2.1.0, Buildings_3.0.0, Buildings_5.0.1, Buildings_6.0.0, Buildings_7.0.0, Buildings_8, Buildings_8.0.0, Buildings_9, Buildings_maint.7.0.x, Buildings_maint.8.0.x, Buildings_master, ConPNlib, Dynawo_1.6.1, EHPTexamples_main, EHPTlib_main, FCSys, IBPSA_master, IdealizedContact, ModelicaTestOverdetermined_3.2.2, ModelicaTest_3.1, ModelicaTest_3.1_cpp, ModelicaTest_3.2.1, ModelicaTest_3.2.1_cpp, ModelicaTest_3.2.2, ModelicaTest_3.2.2_cpp, ModelicaTest_3.2.2_fmi, ModelicaTest_3.2.2_fmi-cpp, ModelicaTest_3.2.2_fmi_cpp, ModelicaTest_3.2.3_cpp, ModelicaTest_4.1.0-beta.om, ModelicaTest_trunk_cpp, Modelica_3.1, Modelica_3.1_cpp, Modelica_3.2.1, Modelica_3.2.1_cpp, Modelica_3.2.2, Modelica_3.2.2_-O1, Modelica_3.2.2_-O2, Modelica_3.2.2__O1, Modelica_3.2.2__O2, Modelica_3.2.2_cpp, Modelica_3.2.2_fmi, Modelica_3.2.2_fmi-cpp, Modelica_3.2.2_fmi_cpp, Modelica_3.2.3_cpp, Modelica_4.1.0-beta.om, Modelica_LinearSystems2, Modelica_LinearSystems2_dev, Modelica_Noise, Modelica_StateGraph2, Modelica_Synchronous, Modelica_Synchronous_cpp, Modelica_Synchronous_fmi, Modelica_Synchronous_fmi-cpp, Modelica_Synchronous_fmi_cpp, Modelica_trunk_cpp, ObjectStab, OpenIPSL_release, PowerSystems_cpp, PowerSystems_fmi, PowerSystems_fmi-cpp, PowerSystems_fmi_cpp, PowerSystems_master, SiemensPower, SiemensPower_OMCtest, SolarTherm_alberto-merge, ThermofluidStream_OM_adaptions, iPSL.
The baseline is the newest run of master, not the commit the pull request is
based on, so a difference can also come from something merged into master since
the pull request was branched.
The two runs
| Branch | Run | Compiler | Machine |
|---|
| Baseline | master | 2026-10-01 15:40:15 | v1.28.0-dev.1143+g02267014fb.cmake | ryzen-9950x |
| Pull request | pr/17033 | 2026-10-01 18:39:34 | v1.28.0-dev.1145+g3a9861bd11.cmake | ryzen-9950x |
Summary
| Models compared | 20031 |
| Number of Improvements | 5 |
| Number of Regressions | 3 |
| Number of Performance Improvements | 5 |
| Number of Performance Regressions | 0 |
| Models only in the pull request run | 0 |
| Models only in the baseline run | 0 |
Time
Time spent on the 20031 models both runs have. The last column counts only the 20023 that reached the same phase in both: a model that fails earlier stops paying for the phases it no longer reaches.
| Phase | master | pr/17033 | Change | Change, same phase |
|---|
| frontend | 1:51:12 | 1:51:58 | +0.7% | +0.7% |
| backend | 2:48:20 | 2:51:12 | +1.7% | +1.7% |
| simcode | 0:25:15 | 0:25:38 | +1.5% | +1.5% |
| templates | 1:15:39 | 1:16:51 | +1.6% | +1.6% |
| compile | 14:41:03 | 14:49:32 | +1.0% | +1.0% |
| simulate | 6:45:53 | 6:36:46 | -2.2% | -1.2% |
| verify | 0:13:24 | 0:13:28 | +0.5% | +0.4% |
| total | 1 day, 21:35:23 | 1 day, 21:44:44 | +0.3% | +0.5% |
Library Changes
| Library | Change |
|---|
| Dynawo_dev | Version 1.8.0-master (3eede8816a7fd28407fbae3edf7f88ca3a220800) in master, 1.8.0-master (c511e4e7b461067d5f72b0c1229dcd8fc12458f4) in pr/17033 |
| NeuralNetwork_main | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ThermofluidStream_dev | Version 1.4.0-main (06b887c2ae00d8ef7178c87cf919e835d403ffed) in master, 1.4.0-main (50a7ce5919ce360d8054773899683d1c2c27a8db) in pr/17033 |
Models Affected
Models Only in One of the Runs