3 of the 102 libraries were not tested in the same version, or not with the same configuration and reference files, in the two runs; see Library Changes below.
76 libraries of the baseline run were not tested by the pull request run: AixLib_latest, AixLib_master, Annex60, Annex60_1.0.0, Buildings, Buildings_1.6, Buildings_10, Buildings_2.0.0, Buildings_2.1.0, Buildings_3.0.0, Buildings_5.0.1, Buildings_6.0.0, Buildings_7.0.0, Buildings_8, Buildings_8.0.0, Buildings_9, Buildings_maint.7.0.x, Buildings_maint.8.0.x, Buildings_master, ConPNlib, Dynawo_1.6.1, EHPTexamples_main, EHPTlib_main, FCSys, IBPSA_master, IdealizedContact, ModelicaTestOverdetermined_3.2.2, ModelicaTest_3.1, ModelicaTest_3.1_cpp, ModelicaTest_3.2.1, ModelicaTest_3.2.1_cpp, ModelicaTest_3.2.2, ModelicaTest_3.2.2_cpp, ModelicaTest_3.2.2_fmi, ModelicaTest_3.2.2_fmi-cpp, ModelicaTest_3.2.2_fmi_cpp, ModelicaTest_3.2.3_cpp, ModelicaTest_4.1.0-beta.om, ModelicaTest_trunk_cpp, Modelica_3.1, Modelica_3.1_cpp, Modelica_3.2.1, Modelica_3.2.1_cpp, Modelica_3.2.2, Modelica_3.2.2_-O1, Modelica_3.2.2_-O2, Modelica_3.2.2__O1, Modelica_3.2.2__O2, Modelica_3.2.2_cpp, Modelica_3.2.2_fmi, Modelica_3.2.2_fmi-cpp, Modelica_3.2.2_fmi_cpp, Modelica_3.2.3_cpp, Modelica_4.1.0-beta.om, Modelica_LinearSystems2, Modelica_LinearSystems2_dev, Modelica_Noise, Modelica_StateGraph2, Modelica_Synchronous, Modelica_Synchronous_cpp, Modelica_Synchronous_fmi, Modelica_Synchronous_fmi-cpp, Modelica_Synchronous_fmi_cpp, Modelica_trunk_cpp, ObjectStab, OpenIPSL_release, PowerSystems_cpp, PowerSystems_fmi, PowerSystems_fmi-cpp, PowerSystems_fmi_cpp, PowerSystems_master, SiemensPower, SiemensPower_OMCtest, SolarTherm_alberto-merge, ThermofluidStream_OM_adaptions, iPSL.
The baseline is the newest run of master, not the commit the pull request is
based on, so a difference can also come from something merged into master since
the pull request was branched.
The two runs
| Branch | Run | Compiler | Machine |
| Baseline | master | 2026-09-30 21:48:18 | v1.28.0-dev.1112+g23ae8ddd3f.cmake | ryzen-9950x |
| Pull request | pr/17033 | 2026-10-01 03:14:58 | v1.28.0-dev.1114+g15b85f1d15.cmake | ryzen-9950x |
Summary
| Models compared | 19999 |
| Number of Improvements | 7 |
| Number of Regressions | 6 |
| Number of Performance Improvements | 5 |
| Number of Performance Regressions | 11 |
| Models only in the pull request run | 25 |
| Models only in the baseline run | 6 |
Time
Time spent on the 19999 models both runs have. The last column counts only the 19986 that reached the same phase in both: a model that fails earlier stops paying for the phases it no longer reaches.
| Phase | master | pr/17033 | Change | Change, same phase |
| frontend | 1:45:59 | 1:48:04 | +2.0% | +2.0% |
| backend | 2:48:34 | 2:53:16 | +2.8% | +2.7% |
| simcode | 0:25:34 | 0:25:49 | +1.0% | +1.0% |
| templates | 1:16:02 | 1:17:26 | +1.8% | +1.7% |
| compile | 14:59:12 | 15:53:13 | +6.0% | +1.5% |
| simulate | 7:02:50 | 6:58:55 | -0.9% | +0.0% |
| verify | 0:13:47 | 0:13:27 | -2.4% | -2.4% |
| total | 1 day, 22:28:57 | 1 day, 23:20:15 | +1.8% | +0.5% |
Library Changes
| Library | Change |
| Buildings_11 | Version 11.1.2-maint.11.x (c921eca95bf814e2e2186829525a712780808763) in master, 11.1.2-maint.11.x (ea53cca41d0951a90ab0357288a4b1bd3be17c30) in pr/17033 |
| Buildings_latest | Version 14.0.0-master (d153741d3efb0062c12643e73e6a2ad04541ec02) in master, 14.0.0-master (ce904e2cd096b3aaa6380bbd8f0d81167a4ee83b) in pr/17033 |
| OpenIPSL_dev | Version 3.2.0-dev (e42e6890aadd0db57cc34ccf84724268dc2c760a) in master, 3.2.0-dev (4a653ce7c41f6466fe0d11a5002a3d2d08e13419) in pr/17033 |
Models Affected
Models Only in One of the Runs
| Library | Model | Where |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Subsequences.Validation.AssertMinimumRuntime | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Subsequences.Validation.EquipmentAvailability | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Subsequences.Validation.EventSequencingMultiple | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Subsequences.Validation.EventSequencingSingle | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Subsequences.Validation.RoutingPrimaryPumpStatus | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Subsequences.Validation.SelectModeState | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Validation.AirToWaterReversibleHeatRecovery | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Validation.AirToWaterReversiblePolyvalent | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.MinimumFlow.Validation.ControllerHeatPumps | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.PolyvalentHeatPumps.Validation.AssertMinimumRuntime | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.PolyvalentHeatPumps.Validation.ExtractStagingMatrix | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.PolyvalentHeatPumps.Validation.ModeAlternation | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.Pumps.Primary.Validation.VariableSpeedWithHeatPumps | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.StagingRotation.BaseClasses.Validation.RemoveFromStagingOrder | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.StagingRotation.Validation.StageChangeCommandPolyvalent | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.Utilities.Validation.ConcatenateLogical | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.Utilities.Validation.ConcatenateParameterLogical | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.Utilities.Validation.ConcatenateSelectLogical | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.HeatPumps.Components.Validation.HeatPumpGroupAirToWaterPolyvalent | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.HeatPumps.Components.Validation.PumpsPrimaryDedicatedPolyvalent | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.HeatPumps.Components.Validation.ValvesIsolationPolyvalent | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.HeatPumps.Validation.AirToWaterPolyvalent | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.HeatPumps.Validation.AirToWaterReversibleHeatRecovery | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.HeatPumps.Validation.AirToWaterReversiblePolyvalent | only in pr/17033 |
| OpenIPSL_dev | OpenIPSL.Tests.Controls.PSAT.TG.TGTypeV_test | only in pr/17033 |
| Buildings_latest | Buildings.Templates.Plants.Controls.HeatPumps.Validation.AirToWater | only in master |
| Buildings_latest | Buildings.Templates.Plants.Controls.MinimumFlow.Validation.ControllerDualMode | only in master |
| Buildings_latest | Buildings.Templates.Plants.Controls.Pumps.Primary.Validation.VariableSpeed | only in master |
| Buildings_latest | Buildings.Templates.Plants.Controls.StagingRotation.Validation.EquipmentAvailability | only in master |
| Buildings_latest | Buildings.Templates.Plants.Controls.StagingRotation.Validation.EventSequencing | only in master |
| Buildings_latest | Buildings.Templates.Plants.HeatPumps.Validation.AirToWater | only in master |