102 of the 102 libraries were not tested in the same version, or not with the same configuration and reference files, in the two runs; see Library Changes below.
1 libraries of the pull request run have no counterpart in the baseline run: IndustrialControlSystems_dev.
78 libraries of the baseline run were not tested by the pull request run: AixLib_latest, AixLib_master, Annex60, Annex60_1.0.0, Buildings, Buildings_1.6, Buildings_10, Buildings_11, Buildings_2.0.0, Buildings_2.1.0, Buildings_3.0.0, Buildings_5.0.1, Buildings_6.0.0, Buildings_7.0.0, Buildings_8, Buildings_8.0.0, Buildings_9, Buildings_maint.7.0.x, Buildings_maint.8.0.x, Buildings_master, ConPNlib, Dynawo_1.6.1, EHPTexamples_main, EHPTlib_main, FCSys, IBPSA_master, IdealizedContact, LEPSE_main, ModelicaTestOverdetermined_3.2.2, ModelicaTest_3.1, ModelicaTest_3.1_cpp, ModelicaTest_3.2.1, ModelicaTest_3.2.1_cpp, ModelicaTest_3.2.2, ModelicaTest_3.2.2_cpp, ModelicaTest_3.2.2_fmi, ModelicaTest_3.2.2_fmi-cpp, ModelicaTest_3.2.2_fmi_cpp, ModelicaTest_3.2.3_cpp, ModelicaTest_4.1.0-beta.om, ModelicaTest_trunk_cpp, Modelica_3.1, Modelica_3.1_cpp, Modelica_3.2.1, Modelica_3.2.1_cpp, Modelica_3.2.2, Modelica_3.2.2_-O1, Modelica_3.2.2_-O2, Modelica_3.2.2__O1, Modelica_3.2.2__O2, Modelica_3.2.2_cpp, Modelica_3.2.2_fmi, Modelica_3.2.2_fmi-cpp, Modelica_3.2.2_fmi_cpp, Modelica_3.2.3_cpp, Modelica_4.1.0-beta.om, Modelica_LinearSystems2, Modelica_LinearSystems2_dev, Modelica_Noise, Modelica_StateGraph2, Modelica_Synchronous, Modelica_Synchronous_cpp, Modelica_Synchronous_fmi, Modelica_Synchronous_fmi-cpp, Modelica_Synchronous_fmi_cpp, Modelica_trunk_cpp, ObjectStab, OpenIPSL_release, PowerSystems_cpp, PowerSystems_fmi, PowerSystems_fmi-cpp, PowerSystems_fmi_cpp, PowerSystems_master, SiemensPower, SiemensPower_OMCtest, SolarTherm_alberto-merge, ThermofluidStream_OM_adaptions, iPSL.
The baseline is the newest run of master, not the commit the pull request is based on, so a difference can also come from something merged into master since the pull request was branched.
| Branch | Run | Compiler | Machine | |
|---|---|---|---|---|
| Baseline | master | 2026-11-17 17:46:31 | v1.28.0-dev.1969+g4ee6453c92.cmake | ryzen-9950x |
| Pull request | pr/18080 | 2026-11-17 23:43:45 | v1.28.0-dev.1975+g64fb75a456.cmake | ryzen-9950x |
| Models compared | 21615 |
| Number of Improvements | 235 |
| Number of Regressions | 422 |
| Number of Performance Improvements | 0 |
| Number of Performance Regressions | 3 |
| Models only in the pull request run | 0 |
| Models only in the baseline run | 0 |
Time spent on the 21615 models both runs have. The last column counts only the 20958 that reached the same phase in both: a model that fails earlier stops paying for the phases it no longer reaches.
| Phase | master | pr/18080 | Change | Change, same phase |
|---|---|---|---|---|
| frontend | 1:51:50 | 2:06:48 | +13.4% | +1.2% |
| backend | 2:08:07 | 2:01:23 | -5.3% | -0.9% |
| simcode | 0:30:52 | 0:29:09 | -5.5% | -0.7% |
| templates | 1:11:52 | 1:12:56 | +1.5% | -0.5% |
| compile | 15:27:29 | 15:38:13 | +1.2% | +0.1% |
| simulate | 7:43:19 | 7:29:42 | -2.9% | +0.2% |
| verify | 0:08:46 | 0:08:11 | -6.8% | -0.5% |
| total | 1 day, 22:19:52 | 1 day, 22:19:11 | -0.0% | -0.1% |
| Library | Change |
|---|---|
| AES | Configuration hash (OMC settings, the testing script or a reference file changed) |
| AdvancedNoise | Configuration hash (OMC settings, the testing script or a reference file changed) |
| AixLib | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BLDC | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BidiDCDC | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BikeTrailer | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BioChem | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Bodylight | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BoundaryInitBlocks | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BuildSysPro | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BuildingSystems | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Buildings_12 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Buildings_13 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Buildings_latest | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BusinessSimulation | Configuration hash (OMC settings, the testing script or a reference file changed) |
| BusinessSimulation_dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ChaoticCircuits | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Chemical | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Chemical_master | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ClaRa | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ClaRa_dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Credibility | Configuration hash (OMC settings, the testing script or a reference file changed) |
| DeltaRobot | Configuration hash (OMC settings, the testing script or a reference file changed) |
| DroneLibrary | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Dynawo | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Dynawo_dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| EHPTexamples | Configuration hash (OMC settings, the testing script or a reference file changed) |
| EHPTexamples_latest | Configuration hash (OMC settings, the testing script or a reference file changed) |
| EHPTlib | Configuration hash (OMC settings, the testing script or a reference file changed) |
| EHPTlib_latest | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ElectricBraking | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ElectricalEnergyStorage | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ExternData | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ExternalMedia | Configuration hash (OMC settings, the testing script or a reference file changed) |
| FastBuildings | Configuration hash (OMC settings, the testing script or a reference file changed) |
| FluxTubesExtension | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Greenhouses | Configuration hash (OMC settings, the testing script or a reference file changed) |
| HanserModelica | Configuration hash (OMC settings, the testing script or a reference file changed) |
| HelmholtzMedia | Configuration hash (OMC settings, the testing script or a reference file changed) |
| IBPSA_latest | Configuration hash (OMC settings, the testing script or a reference file changed) |
| IDEAS | Configuration hash (OMC settings, the testing script or a reference file changed) |
| IDEAS_dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| IndustrialControlSystems | Configuration hash (OMC settings, the testing script or a reference file changed) |
| KeyWordIO | Configuration hash (OMC settings, the testing script or a reference file changed) |
| LibRAS | Configuration hash (OMC settings, the testing script or a reference file changed) |
| MEV | Configuration hash (OMC settings, the testing script or a reference file changed) |
| MagLev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| MessagePack | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ModelicaByExample | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ModelicaTestOverdetermined | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ModelicaTest_3.2.3 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ModelicaTest_4.0.0 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ModelicaTest_4.1.0 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ModelicaTest_trunk | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Modelica_3.2.3 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Modelica_4.0.0 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Modelica_4.1.0 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Modelica_DeviceDrivers | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Modelica_trunk | Configuration hash (OMC settings, the testing script or a reference file changed) |
| NeuralNetwork_main | Configuration hash (OMC settings, the testing script or a reference file changed) |
| OMLET_main | Version main (a301823dd5c5b38e5d8de3acd0165a8920e80cec) in master, main (c5dbd871fbaf555bad6bd8eebca66dbc7707d13f) in pr/18080 |
| OpenHPL | Configuration hash (OMC settings, the testing script or a reference file changed) |
| OpenHydraulics | Configuration hash (OMC settings, the testing script or a reference file changed) |
| OpenIMDML_main | Configuration hash (OMC settings, the testing script or a reference file changed) |
| OpenIPSL | Configuration hash (OMC settings, the testing script or a reference file changed) |
| OpenIPSL_2.0.0 | Configuration hash (OMC settings, the testing script or a reference file changed) |
| OpenIPSL_dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PLL | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PNlib | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Pharmacolibrary | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PhotoVoltaics | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PhotoVoltaics_TGM | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Physiolibrary | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Physiomodel | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PlanarMechanics | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PowerGrids | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PowerGrids_dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PowerGrids_symb_jac | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PowerSysPro | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PowerSystems | Configuration hash (OMC settings, the testing script or a reference file changed) |
| PowerSystems_latest | Configuration hash (OMC settings, the testing script or a reference file changed) |
| SDF | Configuration hash (OMC settings, the testing script or a reference file changed) |
| SOFCPoliMi | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ScalableTestGrids_noopt | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ScalableTestSuite | Version 2.4.0-master (4ff4bdc98a4d1d843ce4e789406178f3240b4bcc) in master, 2.4.0-master (3f546f91bd7cc729ec138b7cfe91e5cd3debcfe4) in pr/18080 |
| ScalableTestSuite_noopt | Version 2.4.0-master (4ff4bdc98a4d1d843ce4e789406178f3240b4bcc) in master, 2.4.0-master (3f546f91bd7cc729ec138b7cfe91e5cd3debcfe4) in pr/18080 |
| SolarTherm | Configuration hash (OMC settings, the testing script or a reference file changed) |
| StewartPlatform | Configuration hash (OMC settings, the testing script or a reference file changed) |
| SystemDynamics | Configuration hash (OMC settings, the testing script or a reference file changed) |
| TAeZoSysPro | Configuration hash (OMC settings, the testing script or a reference file changed) |
| TAeZoSysPro_testsuite | Configuration hash (OMC settings, the testing script or a reference file changed) |
| TILMedia | Configuration hash (OMC settings, the testing script or a reference file changed) |
| TILMedia_AddOn_Tests | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ThermalSeparation | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ThermoPower | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ThermoPower_4.0.0-dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ThermoSysPro | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ThermofluidStream | Configuration hash (OMC settings, the testing script or a reference file changed) |
| ThermofluidStream_dev | Configuration hash (OMC settings, the testing script or a reference file changed) |
| TransiEnt | Configuration hash (OMC settings, the testing script or a reference file changed) |
| URDFModelica_main | Configuration hash (OMC settings, the testing script or a reference file changed) |
| VehicleInterfaces | Configuration hash (OMC settings, the testing script or a reference file changed) |
| Library | Model | Where |
|---|