Automated Model Validation

The problem: Our client had a library of validation tests that they had previously used.

Our analysis found that 82% of the tests had wholly quantitative pass/fail criteria.

The solution: We developed a scripted process meaning that for any model version we can run all the tests at the push of a button. This now returns a library of completed test results in less than an hour - a process which had taken two weeks of FTE resource the previous year.

The result: Small changes can now be made to the model and a whole validation suite is produced in the background.

Many board requests can now be answered by these stored tests, rather than having to manually produce runs, outputs, analyse results, and risk that the model runs are not configured correctly.