2 of the 95 libraries were not tested in the same version, or not with the same configuration and reference files, in the two runs; see Library Changes below.
77 libraries of the baseline run were not tested by the pull request run: AixLib_latest, AixLib_master, Annex60, Annex60_1.0.0, Buildings, Buildings_1.6, Buildings_10, Buildings_2.0.0, Buildings_2.1.0, Buildings_3.0.0, Buildings_5.0.1, Buildings_6.0.0, Buildings_7.0.0, Buildings_8, Buildings_8.0.0, Buildings_9, Buildings_maint.7.0.x, Buildings_maint.8.0.x, Buildings_master, ConPNlib, Dynawo_1.6.1, EHPTexamples_main, EHPTlib_main, FCSys, IBPSA_master, IdealizedContact, ModelicaTestOverdetermined_3.2.2, ModelicaTest_3.1, ModelicaTest_3.1_cpp, ModelicaTest_3.2.1, ModelicaTest_3.2.1_cpp, ModelicaTest_3.2.2, ModelicaTest_3.2.2_cpp, ModelicaTest_3.2.2_fmi, ModelicaTest_3.2.2_fmi-cpp, ModelicaTest_3.2.2_fmi_cpp, ModelicaTest_3.2.3_cpp, ModelicaTest_4.1.0-beta.om, ModelicaTest_trunk_cpp, Modelica_3.1, Modelica_3.1_cpp, Modelica_3.2.1, Modelica_3.2.1_cpp, Modelica_3.2.2, Modelica_3.2.2_-O1, Modelica_3.2.2_-O2, Modelica_3.2.2__O1, Modelica_3.2.2__O2, Modelica_3.2.2_cpp, Modelica_3.2.2_fmi, Modelica_3.2.2_fmi-cpp, Modelica_3.2.2_fmi_cpp, Modelica_3.2.3_cpp, Modelica_4.1.0-beta.om, Modelica_LinearSystems2, Modelica_LinearSystems2_dev, Modelica_Noise, Modelica_StateGraph2, Modelica_Synchronous, Modelica_Synchronous_cpp, Modelica_Synchronous_fmi, Modelica_Synchronous_fmi-cpp, Modelica_Synchronous_fmi_cpp, Modelica_trunk_cpp, ObjectStab, OpenHPL, OpenIPSL_release, PowerSystems_cpp, PowerSystems_fmi, PowerSystems_fmi-cpp, PowerSystems_fmi_cpp, PowerSystems_master, SiemensPower, SiemensPower_OMCtest, SolarTherm_alberto-merge, ThermofluidStream_OM_adaptions, iPSL.
The baseline is the newest run of master, not the commit the pull request is
based on, so a difference can also come from something merged into master since
the pull request was branched.
Time spent on the 19842 models both runs have. The last column counts only the 19759 that reached the same phase in both: a model that fails earlier stops paying for the phases it no longer reaches.