OpenModelica pull request 18080 against wasm-jit

8 of the 102 libraries were not tested in the same version, or not with the same configuration and reference files, in the two runs; see Library Changes below.

2 libraries of the baseline run were not tested by the pull request run: Buildings_11, LEPSE_main.

The baseline is the newest run of wasm-jit, not the commit the pull request is based on, so a difference can also come from something merged into wasm-jit since the pull request was branched.

The two runs

BranchRunCompilerMachine
Baselinewasm-jit2026-11-17 04:26:53v1.28.0-dev.1958+g714b6e5f82.rustryzen-9950x
Pull requestpr/180802026-11-17 14:36:37v1.28.0-dev.1963+g7d8c657788.rustryzen-9950x

Summary

Models compared21615
Number of Improvements55
Number of Regressions14
Number of Performance Improvements4
Number of Performance Regressions8
Models only in the pull request run0
Models only in the baseline run0

Time

Time spent on the 21615 models both runs have. The last column counts only the 21546 that reached the same phase in both: a model that fails earlier stops paying for the phases it no longer reaches.

Phasewasm-jitpr/18080ChangeChange, same phase
frontend2:01:151:52:31-7.2%-7.4%
backend1:59:451:58:40-0.9%-0.9%
simcode0:27:130:26:50-1.4%-1.5%
templates0:16:010:16:43+4.4%+4.3%
compile1:50:181:51:28+1.1%+1.6%
simulate8:00:378:16:58+3.4%+1.8%
verify0:09:590:09:17-7.0%-4.5%
total22:29:4122:40:32+0.8%-0.3%

Library Changes

LibraryChange
Buildings_12Configuration hash (OMC settings, the testing script or a reference file changed)
Buildings_latestConfiguration hash (OMC settings, the testing script or a reference file changed)
Dynawo_devVersion 2.0.0-master (3c791ed5b7ce25861c672477a0b016a4f3a6813c) in wasm-jit, 2.0.0-master (7e91b3026b98ec23eaba0eaff7c7b28704119108) in pr/18080
EHPTlib_latestVersion 3.0.0-main (b94aef62d5070cdbb42792315f81a9ccecdb7ca6) in wasm-jit, 3.0.0-main (e98c267ffadeff0e36b48610e0f3b11bed11cb2c) in pr/18080
PowerGrids_devVersion 2.0.0-develop (95bfda0ea32f50ee76d8add666f3d84753a44379) in wasm-jit, 2.0.0-develop (1e30c19aec840120f39b8d31c8f4220f13e3ddd0) in pr/18080
ThermoPowerVersion 4.0.0-dev (d828d71e0897a6f9bab1cb4b16b21a190d79502c) in wasm-jit, 4.0.0-dev (f8c7b21af436bbe86918db3081de5bff44a61214) in pr/18080
ThermoPower_4.0.0-devVersion 4.0.0-dev (d828d71e0897a6f9bab1cb4b16b21a190d79502c) in wasm-jit, 4.0.0-dev (f8c7b21af436bbe86918db3081de5bff44a61214) in pr/18080
ThermoSysProVersion 4.2.0-master (a896ab75ce22162369e7fa4ce79927eeca44ad4a) in wasm-jit, 4.2.0-master (953deb07b1d154091e0af7f6b0fa817a319babd3) in pr/18080

Models Affected

LibraryModelChange
BuildingSystemsBuildingSystems.Applications.DistrictSimulation.DistrictBerlinKreuzberg (sim) (wasm-jit)FrontEnd performance 0:01:42 → 42.78
Buildings_12Buildings.Air.Systems.SingleZone.VAV.Examples.ChillerDXHeatingEconomizer (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Air.Systems.SingleZone.VAV.Examples.Guideline36 (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Air.Systems.SingleZone.VAV.Examples.OptimalStart.ConventionalSpring (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Air.Systems.SingleZone.VAV.Examples.OptimalStart.ConventionalSummer (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Air.Systems.SingleZone.VAV.Examples.OptimalStart.Guideline36Spring (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Air.Systems.SingleZone.VAV.Examples.OptimalStart.Guideline36Summer (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Controls.OBC.ASHRAE.G36.TerminalUnits.DualDuctColdDuctMin.Validation.Controller (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Controls.OBC.ASHRAE.G36.TerminalUnits.DualDuctMixConInletSensor.Validation.Controller (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Controls.Predictors.Examples.BESTEST (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Examples.DualFanDualDuct.ClosedLoop (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Examples.HydronicHeating.TwoRoomsWithStorage (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Examples.ScalableBenchmarks.BuildingVAV.Examples.OneFloor_OneZone (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Examples.ScalableBenchmarks.BuildingVAV.Examples.TwoFloor_TwoZone (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Examples.VAVReheat.ASHRAE2006 (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Examples.VAVReheat.Guideline36 (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.Examples.VAVReheat.Validation.TraceSubstance (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.Detailed.Examples.ElectroChromicWindow (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.Detailed.Examples.FFD.Tutorial.MixedConvection (sim) (wasm-jit)Simulate performance 1.14 → 0:04:24
Buildings_12Buildings.ThermalZones.Detailed.Validation.BESTEST.Cases6xx.Case650 (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.Detailed.Validation.BESTEST.Cases9xx.Case950 (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.Detailed.Validation.BESTEST.Cases9xx.Case950FF (sim) (wasm-jit)Verify → Simulate
Buildings_12Buildings.ThermalZones.Detailed.Validation.LBNL_71T.RoomB.ElectroChromicWindow (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.Detailed.Validation.TestConditionalConstructions.OnlyExteriorWallWithWindowInteriorShade (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.Detailed.Validation.TestConditionalConstructions.SampledModel.OnlyExteriorWallWithWindowInteriorShade (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.EnergyPlus_24_2_0.Examples.SmallOffice.ASHRAE2006Spring (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.EnergyPlus_24_2_0.Examples.SmallOffice.ASHRAE2006Summer (sim) (wasm-jit)Simulate → Verify
Buildings_12Buildings.ThermalZones.EnergyPlus_24_2_0.Examples.SmallOffice.ASHRAE2006Winter (sim) (wasm-jit)Simulate → Verify
Buildings_13Buildings.DHC.Plants.Combined.Examples.AllElectricCWStorage (sim) (wasm-jit)Simulate performance 8.20 → 22.49
Buildings_latestBuildings.Air.Systems.SingleZone.VAV.Examples.ChillerDXHeatingEconomizer (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Air.Systems.SingleZone.VAV.Examples.Guideline36 (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Air.Systems.SingleZone.VAV.Examples.OptimalStart.ConventionalSpring (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Air.Systems.SingleZone.VAV.Examples.OptimalStart.ConventionalSummer (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Air.Systems.SingleZone.VAV.Examples.OptimalStart.Guideline36Spring (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Controls.OBC.ASHRAE.G36.TerminalUnits.DualDuctColdDuctMin.Validation.Controller (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Controls.OBC.ASHRAE.G36.TerminalUnits.DualDuctMixConInletSensor.Validation.Controller (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Controls.Predictors.Examples.BESTEST (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.DHC.Examples.Combined.SeriesVariableFlowAgentControl (sim) (wasm-jit)Compile performance 21.66 → 8.60
Buildings_latestBuildings.Examples.DualFanDualDuct.ClosedLoop (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Examples.HydronicHeating.TwoRoomsWithStorage (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Examples.ScalableBenchmarks.BuildingVAV.Examples.OneFloor_OneZone (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Examples.ScalableBenchmarks.BuildingVAV.Examples.TwoFloor_TwoZone (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Examples.VAVReheat.ASHRAE2006 (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Examples.VAVReheat.Guideline36 (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Examples.VAVReheat.Validation.TraceSubstance (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Templates.Components.Validation.CoolersCoolingTower (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.Templates.Plants.Chillers.Components.Validation.ChillersToPrimaryPumpsSeries (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.Detailed.Examples.ElectroChromicWindow (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.Detailed.Validation.BESTEST.Cases6xx.Case650 (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.Detailed.Validation.BESTEST.Cases9xx.Case950 (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.Detailed.Validation.BESTEST.Cases9xx.Case950FF (sim) (wasm-jit)Verify → Simulate
Buildings_latestBuildings.ThermalZones.Detailed.Validation.LBNL_71T.RoomB.ElectroChromicWindow (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.Detailed.Validation.TestConditionalConstructions.OnlyExteriorWallWithWindowInteriorShade (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.Detailed.Validation.TestConditionalConstructions.SampledModel.OnlyExteriorWallWithWindowInteriorShade (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.EnergyPlus_24_2_0.Examples.SmallOffice.ASHRAE2006Spring (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.EnergyPlus_24_2_0.Examples.SmallOffice.ASHRAE2006Summer (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.EnergyPlus_24_2_0.Examples.SmallOffice.ASHRAE2006Winter (sim) (wasm-jit)Simulate → Verify
Buildings_latestBuildings.ThermalZones.EnergyPlus_24_2_0.Examples.SmallOffice.ASHRAE2006Winter_Autosizing (sim) (wasm-jit)Simulate → Verify
EHPTlib_latestEHPTlib.MapBased.TestingModels.TestICE.TestIceT01 (sim) (wasm-jit)Simulate → Failed
Modelica_4.0.0Modelica.Blocks.Examples.Rectifier12pulseFFT (sim) (wasm-jit)BackEnd performance 13.20 → 28.66
Modelica_4.0.0Modelica.Blocks.Examples.Rectifier6pulseFFT (sim) (wasm-jit)BackEnd performance 13.11 → 28.60
OpenIPSLOpenIPSL.Examples.DAEMode.N44_Base_Case_Systems.Nordic44_Base_Case_StateEvents2 (sim) (wasm-jit)Compile → Templates
OpenIPSLOpenIPSL.Examples.DAEMode.N44_Base_Case_Systems.Nordic44_Base_Case_StateEvents3 (sim) (wasm-jit)Templates → Simulate
OpenIPSL_devOpenIPSL.Examples.DAEMode.N44_Base_Case_Systems.Nordic44_Base_Case_StateEvents2 (sim) (wasm-jit)Compile → Templates
PowerGridsPowerGrids.Electrical.Test.TestTapChangerLogicMax (sim) (wasm-jit)Verify → Simulate
PowerGrids_devPowerGrids.Electrical.Test.TestPropControlledSynchronousMachine4WindingsPF (sim) (wasm-jit)Simulate → Compile
PowerGrids_devPowerGrids.Electrical.Test.TestTapChangerLogicMax (sim) (wasm-jit)Verify → Simulate
PowerGrids_devPowerGrids.Examples.IEEE14bus.IEEE14busGen2Disconnection (sim) (wasm-jit)Simulate → Templates
PowerGrids_devPowerGrids.Examples.IEEE14bus.IEEE14busLine1to5Opening (sim) (wasm-jit)Simulate → Templates
PowerGrids_devPowerGrids.Examples.IEEE14bus.IEEE14busLoad2Variation (sim) (wasm-jit)Simulate → Templates
PowerGrids_devPowerGrids.Examples.IEEE14bus.IEEE14busShort4 (sim) (wasm-jit)Simulate → Compile
PowerGrids_devPowerGrids.Examples.IEEE14bus.IEEE14busStaticNetwork (sim) (wasm-jit)Simulate → Templates
PowerGrids_devPowerGrids.Examples.IEEE14bus.IEEE14busStaticNetworkEPF (sim) (wasm-jit)Simulate performance 0.02 → 0:04:00
PowerGrids_symb_jacPowerGrids.Electrical.Test.TestTapChangerLogicMax (sim) (wasm-jit)Verify → Simulate
ScalableTestSuiteScalableTestSuite.Electrical.DistributionSystemDC.ScaledExperiments.DistributionSystemModelicaActiveLoads_N_80_M_80 (sim) (wasm-jit)FrontEnd performance 13.56 → 6.09
ScalableTestSuiteScalableTestSuite.Electrical.DistributionSystemDC.ScaledExperiments.DistributionSystemModelicaIndividual_N_80_M_80 (sim) (wasm-jit)FrontEnd performance 34.15 → 14.83
ScalableTestSuite_nooptScalableTestSuite.Electrical.DistributionSystemDC.ScaledExperiments.DistributionSystemModelica_N_112_M_112 (sim) (wasm-jit)Simulate performance 10.00 → 17.88
ThermoPowerThermoPower.Examples.CISE.Simulators.CISESim180504 (sim) (wasm-jit)Compile → Simulate
ThermoPower_4.0.0-devThermoPower.Examples.CISE.Simulators.CISESim180504 (sim) (wasm-jit)Compile → Simulate
ThermoSysProThermoSysPro.Examples.Book.PowerPlants.CombinedCyclePowerPlant.LoadVariation (sim) (wasm-jit)Simulate performance 0:01:19 → 0:03:29
ThermoSysProThermoSysPro.Fluid.Examples.Book.PowerPlants.CombinedCyclePowerPlant.LoadVariation (sim) (wasm-jit)Simulate performance 0:01:16 → 0:03:39

Models Only in One of the Runs

LibraryModelWhere