Running: ./testmodel.py --libraries=/home/hudson/saved_omc/libraries/.openmodelica/libraries/ --ompython_omhome=/usr ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4.conf.json
loadFile("/home/hudson/saved_omc/libraries/.openmodelica/libraries/ModelicaServices 4.0.0+maint.om/package.mo", uses=false)
loadFile("/home/hudson/saved_omc/libraries/.openmodelica/libraries/Complex 4.0.0+maint.om/package.mo", uses=false)
loadFile("/home/hudson/saved_omc/libraries/.openmodelica/libraries/Modelica 4.0.0+maint.om/package.mo", uses=false)
loadFile("/home/hudson/saved_omc/libraries/.openmodelica/libraries/ScalableTestSuite 2.2.0-master/package.mo", uses=false)
Using package ScalableTestSuite with version 2.2.0 (/home/hudson/saved_omc/libraries/.openmodelica/libraries/ScalableTestSuite 2.2.0-master/package.mo)
Using package Modelica with version 4.0.0 (/home/hudson/saved_omc/libraries/.openmodelica/libraries/Modelica 4.0.0+maint.om/package.mo)
Using package Complex with version 4.0.0 (/home/hudson/saved_omc/libraries/.openmodelica/libraries/Complex 4.0.0+maint.om/package.mo)
Using package ModelicaServices with version 4.0.0 (/home/hudson/saved_omc/libraries/.openmodelica/libraries/ModelicaServices 4.0.0+maint.om/package.mo)
Running command: "" <> buildModelFMU(ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4,fileNamePrefix="ScalableTestSuite_ScalableTestSuite_Power_ConceptualPowerSystem_ScaledExperiments_PowerSystemStepLoad_N_4_M_4",fmuType="me",version="2.0",platforms={"static"})
"" <> buildModelFMU(ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4,fileNamePrefix="ScalableTestSuite_ScalableTestSuite_Power_ConceptualPowerSystem_ScaledExperiments_PowerSystemStepLoad_N_4_M_4",fmuType="me",version="2.0",platforms={"static"})
Notification: Performance of loadFile(/home/hudson/saved_omc/libraries/.openmodelica/libraries/ModelicaServices 4.0.0+maint.om/package.mo): time 0.0009225/0.0009226, allocations: 88.39 kB / 16.31 MB, free: 6.449 MB / 14.72 MB
Notification: Performance of loadFile(/home/hudson/saved_omc/libraries/.openmodelica/libraries/Complex 4.0.0+maint.om/package.mo): time 0.0009441/0.0009441, allocations: 183.1 kB / 17.21 MB, free: 6.316 MB / 14.72 MB
Notification: Performance of loadFile(/home/hudson/saved_omc/libraries/.openmodelica/libraries/Modelica 4.0.0+maint.om/package.mo): time 1.283/1.283, allocations: 223.2 MB / 241.2 MB, free: 5.176 MB / 190.1 MB
Notification: Performance of loadFile(/home/hudson/saved_omc/libraries/.openmodelica/libraries/ScalableTestSuite 2.2.0-master/package.mo): time 0.7313/0.7313, allocations: 120.5 MB / 412.8 MB, free: 12.01 MB / 350.1 MB
Notification: Performance of FrontEnd - loaded program: time 0.0002917/0.0002918, allocations: 15.98 kB / 0.4944 GB, free: 10.95 MB / 366.1 MB
Notification: Performance of FrontEnd - Absyn->SCode: time 0.1351/0.1354, allocations: 82.85 MB / 0.5753 GB, free: 7.969 MB / 446.1 MB
Notification: Performance of NFInst.instantiate(ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4): time 0.001569/0.137, allocations: 1.476 MB / 0.5767 GB, free: 6.48 MB / 446.1 MB
Notification: Performance of NFInst.instExpressions: time 0.0007141/0.1378, allocations: 0.5345 MB / 0.5772 GB, free: 5.941 MB / 446.1 MB
Notification: Performance of NFInst.updateImplicitVariability: time 4.599e-05/0.1378, allocations: 0 / 0.5772 GB, free: 5.941 MB / 446.1 MB
Notification: Performance of NFTyping.typeComponents: time 9.015e-05/0.1379, allocations: 23.84 kB / 0.5773 GB, free: 5.918 MB / 446.1 MB
Notification: Performance of NFTyping.typeBindings: time 0.0001628/0.1381, allocations: 55.61 kB / 0.5773 GB, free: 5.863 MB / 446.1 MB
Notification: Performance of NFTyping.typeClassSections: time 0.0001752/0.1383, allocations: 63.91 kB / 0.5774 GB, free: 5.801 MB / 446.1 MB
Notification: Performance of NFFlatten.flatten: time 0.001123/0.1394, allocations: 1.234 MB / 0.5786 GB, free: 4.562 MB / 446.1 MB
Notification: Performance of NFFlatten.resolveConnections: time 0.0001049/0.1395, allocations: 85.75 kB / 0.5787 GB, free: 4.473 MB / 446.1 MB
Notification: Performance of NFEvalConstants.evaluate: time 0.0003377/0.1399, allocations: 414.9 kB / 0.579 GB, free: 4.066 MB / 446.1 MB
Notification: Performance of NFSimplifyModel.simplify: time 0.0005554/0.1404, allocations: 0.518 MB / 0.5796 GB, free: 3.547 MB / 446.1 MB
Notification: Performance of NFPackage.collectConstants: time 9.548e-05/0.1405, allocations: 48 kB / 0.5796 GB, free: 3.5 MB / 446.1 MB
Notification: Performance of NFFlatten.collectFunctions: time 0.0001082/0.1407, allocations: 48 kB / 0.5796 GB, free: 3.453 MB / 446.1 MB
Notification: Performance of NFScalarize.scalarize: time 0.0002177/0.1409, allocations: 275.1 kB / 0.5799 GB, free: 3.184 MB / 446.1 MB
Notification: Performance of NFVerifyModel.verify: time 0.0001265/0.141, allocations: 157.3 kB / 0.5801 GB, free: 3.023 MB / 446.1 MB
Notification: Performance of NFConvertDAE.convert: time 0.0005857/0.1416, allocations: 0.8536 MB / 0.5809 GB, free: 2.168 MB / 446.1 MB
Notification: Performance of FrontEnd - DAE generated: time 4.518e-06/0.1416, allocations: 0 / 0.5809 GB, free: 2.168 MB / 446.1 MB
Notification: Performance of FrontEnd: time 1.292e-06/0.1416, allocations: 0 / 0.5809 GB, free: 2.168 MB / 446.1 MB
Notification: Performance of Transformations before backend: time 8.656e-06/0.1416, allocations: 0 / 0.5809 GB, free: 2.168 MB / 446.1 MB
Notification: Model statistics after passing the front-end and creating the data structures used by the back-end:
 * Number of equations: 171
 * Number of variables: 171
Notification: Performance of Generate backend data structure: time 0.003268/0.1449, allocations: 1.541 MB / 0.5824 GB, free: 0.5742 MB / 446.1 MB
Notification: Performance of prepare preOptimizeDAE: time 3.871e-05/0.145, allocations: 8.031 kB / 0.5824 GB, free: 0.5664 MB / 446.1 MB
Notification: Performance of preOpt introduceOutputAliases (simulation): time 0.000349/0.1453, allocations: 118.5 kB / 0.5825 GB, free: 452 kB / 446.1 MB
Notification: Performance of preOpt normalInlineFunction (simulation): time 0.0001378/0.1455, allocations: 90.92 kB / 0.5826 GB, free: 360 kB / 446.1 MB
Notification: Performance of preOpt evaluateParameters (simulation): time 0.458/0.6035, allocations: 0.5293 MB / 0.5831 GB, free: 15.34 MB / 446.3 MB
Notification: Performance of preOpt simplifyIfEquations (simulation): time 8.475e-05/0.6036, allocations: 61.44 kB / 0.5832 GB, free: 15.34 MB / 446.3 MB
Notification: Performance of preOpt expandDerOperator (simulation): time 0.0004704/0.6041, allocations: 135.4 kB / 0.5833 GB, free: 15.34 MB / 446.3 MB
Notification: Performance of preOpt clockPartitioning (simulation): time 0.002153/0.6063, allocations: 1.148 MB / 0.5844 GB, free: 15.28 MB / 446.3 MB
Notification: Performance of preOpt findStateOrder (simulation): time 2.799e-05/0.6063, allocations: 10.27 kB / 0.5844 GB, free: 15.28 MB / 446.3 MB
Notification: Performance of preOpt replaceEdgeChange (simulation): time 8.041e-05/0.6064, allocations: 26.19 kB / 0.5845 GB, free: 15.28 MB / 446.3 MB
Notification: Performance of preOpt inlineArrayEqn (simulation): time 4.757e-05/0.6064, allocations: 26.89 kB / 0.5845 GB, free: 15.28 MB / 446.3 MB
Notification: Performance of preOpt removeEqualRHS (simulation): time 0.002113/0.6086, allocations: 1.231 MB / 0.5857 GB, free: 15.27 MB / 446.3 MB
Notification: Performance of preOpt removeSimpleEquations (simulation): time 0.007712/0.6163, allocations: 3.249 MB / 0.5889 GB, free: 14.45 MB / 446.3 MB
Notification: Performance of preOpt comSubExp (simulation): time 0.00338/0.6197, allocations: 1.824 MB / 0.5906 GB, free: 13.89 MB / 446.3 MB
Notification: Performance of preOpt resolveLoops (simulation): time 0.001398/0.6211, allocations: 0.8931 MB / 0.5915 GB, free: 13.62 MB / 446.3 MB
Notification: Performance of preOpt evalFunc (simulation): time 7.56e-05/0.6212, allocations: 14.83 kB / 0.5915 GB, free: 13.62 MB / 446.3 MB
Notification: Performance of preOpt encapsulateWhenConditions (simulation): time 2.631e-05/0.6212, allocations: 46.09 kB / 0.5916 GB, free: 13.57 MB / 446.3 MB
Notification: Performance of pre-optimization done (n=118): time 4.338e-06/0.6212, allocations: 1.359 kB / 0.5916 GB, free: 13.57 MB / 446.3 MB
Notification: Performance of matching and sorting (n=118): time 0.003599/0.6248, allocations: 2.254 MB / 0.5938 GB, free: 12.92 MB / 446.3 MB
Notification: Performance of inlineWhenForInitialization (initialization): time 3.392e-05/0.6249, allocations: 67.56 kB / 0.5938 GB, free: 12.86 MB / 446.3 MB
Notification: Performance of selectInitializationVariablesDAE (initialization): time 0.0005589/0.6254, allocations: 0.4955 MB / 0.5943 GB, free: 12.64 MB / 446.3 MB
Notification: Performance of collectPreVariables (initialization): time 7.685e-05/0.6255, allocations: 52.58 kB / 0.5944 GB, free: 12.59 MB / 446.3 MB
Notification: Performance of collectInitialEqns (initialization): time 0.0001549/0.6257, allocations: 263.2 kB / 0.5946 GB, free: 12.38 MB / 446.3 MB
Notification: Performance of collectInitialBindings (initialization): time 0.0002784/0.626, allocations: 459.6 kB / 0.5951 GB, free: 12.03 MB / 446.3 MB
Notification: Performance of simplifyInitialFunctions (initialization): time 7.959e-05/0.6261, allocations: 25.5 kB / 0.5951 GB, free: 12.01 MB / 446.3 MB
Notification: Performance of setup shared object (initialization): time 0.0001325/0.6262, allocations: 410.2 kB / 0.5955 GB, free: 11.66 MB / 446.3 MB
Notification: Performance of preBalanceInitialSystem (initialization): time 0.001437/0.6276, allocations: 0.8937 MB / 0.5964 GB, free: 11.43 MB / 446.3 MB
Notification: Performance of partitionIndependentBlocks (initialization): time 0.0014/0.629, allocations: 1.063 MB / 0.5974 GB, free: 11.05 MB / 446.3 MB
Notification: Performance of analyzeInitialSystem (initialization): time 0.001548/0.6306, allocations: 1.05 MB / 0.5984 GB, free: 10.64 MB / 446.3 MB
Notification: Performance of solveInitialSystemEqSystem (initialization): time 5.029e-06/0.6306, allocations: 5.25 kB / 0.5984 GB, free: 10.64 MB / 446.3 MB
Notification: Performance of matching and sorting (n=184) (initialization): time 0.002837/0.6335, allocations: 2.219 MB / 0.6006 GB, free: 9.57 MB / 446.3 MB
Notification: Performance of prepare postOptimizeDAE: time 1.999e-05/0.6335, allocations: 8.094 kB / 0.6006 GB, free: 9.57 MB / 446.3 MB
Notification: Performance of postOpt simplifyComplexFunction (initialization): time 2.914e-05/0.6335, allocations: 2.844 kB / 0.6006 GB, free: 9.57 MB / 446.3 MB
Notification: Performance of postOpt tearingSystem (initialization): time 6.257e-05/0.6336, allocations: 12.66 kB / 0.6006 GB, free: 9.57 MB / 446.3 MB
Notification: Performance of postOpt solveSimpleEquations (initialization): time 0.001996/0.6356, allocations: 484 kB / 0.6011 GB, free: 9.445 MB / 446.3 MB
Notification: Performance of postOpt calculateStrongComponentJacobians (initialization): time 2.193e-05/0.6356, allocations: 14.03 kB / 0.6011 GB, free: 9.441 MB / 446.3 MB
Notification: Performance of postOpt simplifyAllExpressions (initialization): time 0.0006511/0.6363, allocations: 191.3 kB / 0.6013 GB, free: 9.316 MB / 446.3 MB
Notification: Performance of postOpt collapseArrayExpressions (initialization): time 9.078e-05/0.6364, allocations: 48.45 kB / 0.6013 GB, free: 9.301 MB / 446.3 MB
Notification: Model statistics after passing the back-end for initialization:
 * Number of independent subsystems: 14
 * Number of states: 0 ()
 * Number of discrete variables: 0 ()
 * Number of discrete states: 0 ()
 * Number of clocked states: 0 ()
 * Top-level inputs: 0
Notification: Strong component statistics for initialization (184):
 * Single equations (assignments): 184
 * Array equations: 0
 * Algorithm blocks: 0
 * Record equations: 0
 * When equations: 0
 * If-equations: 0
 * Equation systems (linear and non-linear blocks): 0
 * Torn equation systems: 0
 * Mixed (continuous/discrete) equation systems: 0
Notification: Performance of prepare postOptimizeDAE: time 0.0003686/0.6368, allocations: 341.5 kB / 0.6016 GB, free: 9.059 MB / 446.3 MB
Notification: Performance of postOpt lateInlineFunction (simulation): time 0.0001104/0.6369, allocations: 68.84 kB / 0.6017 GB, free: 9.023 MB / 446.3 MB
Notification: Performance of postOpt wrapFunctionCalls (simulation): time 0.002609/0.6395, allocations: 1.884 MB / 0.6035 GB, free: 8 MB / 446.3 MB
Notification: Performance of postOpt inlineArrayEqn (simulation): time 1.361e-05/0.6395, allocations: 16.75 kB / 0.6036 GB, free: 8 MB / 446.3 MB
Notification: Performance of postOpt constantLinearSystem (simulation): time 5.631e-06/0.6395, allocations: 0 / 0.6036 GB, free: 8 MB / 446.3 MB
Notification: Performance of postOpt simplifysemiLinear (simulation): time 1.015e-05/0.6396, allocations: 3.984 kB / 0.6036 GB, free: 7.996 MB / 446.3 MB
Notification: Performance of postOpt removeSimpleEquations (simulation): time 0.001367/0.6409, allocations: 1.137 MB / 0.6047 GB, free: 7.266 MB / 446.3 MB
Notification: Performance of postOpt simplifyComplexFunction (simulation): time 3.336e-06/0.6409, allocations: 0 / 0.6047 GB, free: 7.266 MB / 446.3 MB
Notification: Performance of postOpt solveSimpleEquations (simulation): time 0.001976/0.6429, allocations: 445.1 kB / 0.6051 GB, free: 7.156 MB / 446.3 MB
Notification: Performance of postOpt tearingSystem (simulation): time 8.757e-06/0.6429, allocations: 11.53 kB / 0.6051 GB, free: 7.152 MB / 446.3 MB
Notification: Performance of postOpt inputDerivativesUsed (simulation): time 0.0001085/0.6431, allocations: 60.77 kB / 0.6052 GB, free: 7.117 MB / 446.3 MB
Notification: Performance of postOpt calculateStrongComponentJacobians (simulation): time 6.712e-06/0.6431, allocations: 7.609 kB / 0.6052 GB, free: 7.113 MB / 446.3 MB
Notification: Performance of postOpt calculateStateSetsJacobians (simulation): time 1.343e-06/0.6431, allocations: 5.047 kB / 0.6052 GB, free: 7.109 MB / 446.3 MB
Notification: Performance of postOpt symbolicJacobian (simulation): time 0.003272/0.6463, allocations: 2.697 MB / 0.6078 GB, free: 5.777 MB / 446.3 MB
Notification: Performance of postOpt removeConstants (simulation): time 0.0006037/0.647, allocations: 335.8 kB / 0.6081 GB, free: 5.555 MB / 446.3 MB
Notification: Performance of postOpt simplifyTimeIndepFuncCalls (simulation): time 0.0001499/0.6471, allocations: 54.23 kB / 0.6082 GB, free: 5.523 MB / 446.3 MB
Notification: Performance of postOpt simplifyAllExpressions (simulation): time 0.0005359/0.6477, allocations: 94.55 kB / 0.6083 GB, free: 5.473 MB / 446.3 MB
Notification: Performance of postOpt findZeroCrossings (simulation): time 0.0001172/0.6478, allocations: 79.42 kB / 0.6084 GB, free: 5.426 MB / 446.3 MB
Notification: Performance of postOpt collapseArrayExpressions (simulation): time 6.993e-05/0.6479, allocations: 38.36 kB / 0.6084 GB, free: 5.41 MB / 446.3 MB
Notification: Performance of sorting global known variables: time 0.0002925/0.6482, allocations: 346.5 kB / 0.6087 GB, free: 5.211 MB / 446.3 MB
Notification: Performance of sort global known variables: time 1.1e-07/0.6482, allocations: 0 / 0.6087 GB, free: 5.211 MB / 446.3 MB
Notification: Performance of remove unused functions: time 0.0006449/0.6488, allocations: 291.3 kB / 0.609 GB, free: 5.16 MB / 446.3 MB
Notification: Model statistics after passing the back-end for simulation:
 * Number of independent subsystems: 1
 * Number of states: 49 (P_sfc,generator[1].theta,generator[1].omega,generator[1].p,generator[1].q_ev,generator[1].y_t,generator[1].p_t_lp,generator[1].T_s[1],generator[1].T_s[2],generator[1].T_s[3],generator[1].T_s[4],generator[1].err_p_t_int,generator[1].err_p_int,generator[2].theta,generator[2].omega,generator[2].p,generator[2].q_ev,generator[2].y_t,generator[2].p_t_lp,generator[2].T_s[1],generator[2].T_s[2],generator[2].T_s[3],generator[2].T_s[4],generator[2].err_p_t_int,generator[2].err_p_int,generator[3].theta,generator[3].omega,generator[3].p,generator[3].q_ev,generator[3].y_t,generator[3].p_t_lp,generator[3].T_s[1],generator[3].T_s[2],generator[3].T_s[3],generator[3].T_s[4],generator[3].err_p_t_int,generator[3].err_p_int,generator[4].theta,generator[4].omega,generator[4].p,generator[4].q_ev,generator[4].y_t,generator[4].p_t_lp,generator[4].T_s[1],generator[4].T_s[2],generator[4].T_s[3],generator[4].T_s[4],generator[4].err_p_t_int,generator[4].err_p_int)
 * Number of discrete variables: 0 ()
 * Number of discrete states: 0 ()
 * Number of clocked states: 0 ()
 * Top-level inputs: 0
Notification: Strong component statistics for simulation (130):
 * Single equations (assignments): 130
 * Array equations: 0
 * Algorithm blocks: 0
 * Record equations: 0
 * When equations: 0
 * If-equations: 0
 * Equation systems (linear and non-linear blocks): 0
 * Torn equation systems: 0
 * Mixed (continuous/discrete) equation systems: 0
Notification: Performance of Backend phase and start with SimCode phase: time 0.003273/0.6521, allocations: 3.317 MB / 0.6122 GB, free: 3.242 MB / 446.3 MB
Notification: Performance of simCode: created initialization part: time 0.002181/0.6543, allocations: 1.88 MB / 0.6141 GB, free: 1.371 MB / 446.3 MB
Notification: Performance of simCode: created event and clocks part: time 2.344e-06/0.6543, allocations: 4.25 kB / 0.6141 GB, free: 1.367 MB / 446.3 MB
Notification: Performance of simCode: created simulation system equations: time 0.0008595/0.6552, allocations: 0.8583 MB / 0.6149 GB, free: 0.5078 MB / 446.3 MB
Notification: Performance of simCode: created of all other equations (e.g. parameter, nominal, assert, etc): time 0.0003973/0.6556, allocations: 61.95 kB / 0.615 GB, free: 456 kB / 446.3 MB
Notification: Performance of simCode: created linear, non-linear and system jacobian parts: time 0.01351/0.6691, allocations: 10.84 MB / 0.6256 GB, free: 5.441 MB / 462.3 MB
Notification: Performance of simCode: some other stuff during SimCode phase: time 0.0006039/0.6697, allocations: 1.128 MB / 0.6267 GB, free: 4.285 MB / 462.3 MB
Notification: Performance of simCode: alias equations: time 0.00112/0.6708, allocations: 0.5448 MB / 0.6272 GB, free: 3.734 MB / 462.3 MB
Notification: Performance of simCode: all other stuff during SimCode phase: time 0.000572/0.6714, allocations: 287.3 kB / 0.6275 GB, free: 3.453 MB / 462.3 MB
Notification: Performance of SimCode: time 1.532e-06/0.6715, allocations: 3.938 kB / 0.6275 GB, free: 3.449 MB / 462.3 MB
Notification: Performance of buildModelFMU: Generate the FMI files: time 0.02998/0.7014, allocations: 18.33 MB / 0.6454 GB, free: 1.375 MB / 478.3 MB
Notification: Performance of buildModelFMU: configured platform static using cached values: time 0.0001593/0.7016, allocations: 246.6 kB / 0.6456 GB, free: 1.129 MB / 478.3 MB
Notification: Performance of buildModelFMU: Generate platform static: time 2.057/2.759, allocations: 2.812 kB / 0.6456 GB, free: 1.129 MB / 478.3 MB
(rm -f ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4.pipe ; mkfifo ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4.pipe ; head -c 1048576 < ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4.pipe >> ../files/ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4.sim & /home/hudson/saved_omc/OMSimulator/install/linux/bin/OMSimulator -r=ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4_res.mat --tempDir=temp_ScalableTestSuite_ScalableTestSuite_Power_ConceptualPowerSystem_ScaledExperiments_PowerSystemStepLoad_N_4_M_4_fmu --startTime=0 --stopTime=200 --timeout=300 --tolerance=1e-07 ScalableTestSuite_ScalableTestSuite_Power_ConceptualPowerSystem_ScaledExperiments_PowerSystemStepLoad_N_4_M_4.fmu > ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4.pipe 2>&1)
Environment - environmentSimulation:
TODO: How the !@#!# did the simulation report success but simulation result ScalableTestSuite_ScalableTestSuite.Power.ConceptualPowerSystem.ScaledExperiments.PowerSystemStepLoad_N_4_M_4_res.mat does not exist to compare? outputFormat=mat