Skip to content

Latest commit

 

History

History
43 lines (35 loc) · 3.87 KB

testresults.md

File metadata and controls

43 lines (35 loc) · 3.87 KB
Raw

Test Results of Open-Source Modelica Libraries using OpenModelica

Test reports

  • Overview with library test results across OMC versions: These reports shows how libraries with full or partial support level (see here for more details) are handled by released versions of OpenModelica and by the development version on the master branch. Regressions are marked in orange, improvements in green.
    • Default settings: simulation with C runtime and default settings
    • daeMode: simulation with daeMode (compiler flag --daeMode)
    • C++: simulation with C++ runtime
    • FMI: simulation with FMI and C runtime
    • FMI C++: simulation with FMI and C++ runtime
  • Regression reports and history plots: regression reports are periodically generated, using the latest development version of OMC. Changes w.r.t. the previous report are shown. For each tested library, .svg plots are also provided, showing the trends of the results of each step over time.
    • Default settings: default omc settings, C runtime
    • daeMode: simulation with --daeMode
    • C++: simulation with C++ runtime
    • FMI: simulation with FMI, C runtime

How to read the test reports

The library testsuite job is run every night on the OSMC servers, testing open-source Modelica libraries covered by the Package Manager with various versions of OpenModelica, including the development version on the master branch. The simulations are run with the C-runtime, unless specified differently.

Within each library, all models with an experiment(StopTime) annotations are run. For each tested model, the results of the following steps are reported:

  • parsing
  • frontend: flattening the model
  • backend: structural analysis, index reduction, causalization, tearing, and all kind of symbolic manipulations and optimization to solve the model efficiently
  • simcode: intermediate stap towards simulation code generation
  • templates: generation of the actual C code
  • compilation: compilation of the C code into a simulation executable
  • simulation: the simulation is actually run to produce simulation results
  • verification: if reference results file are available, they are compared with the simulation results

Clicking on the model name shows the log of phases from parsing to compilation. Clicking on the (sim) link shows the log of the runtime simulation.

How to get your open-source library in the testsuite

If you are actively developing an open-source Modelica library using a GIT repository, you can easily get it included in the OpenModelica library testsuite. Please open a request on the OpenModelica issue tracker. Ideally, you should have two tests for it: one testing the latest official release, which can be used to check if changes to OMC cause regressions to the existing library, another one testing the development version, which also checks regressions caused by changes to the library code. You can then bookmark the page with the regression reports and the page with the test results obtained with your favourite settings.