Customers

Case Study

Test Gap Analysis


Munich Re extends existing test processes.

Munich Re represents distinct solution expertise, consistent risk management, financial stability, and high customer focus. Munich Re's business model is based on a consolidated combination of primary insurance and re-insurance. Munich Re is active in all insurance sectors and is globally present with over 43,000 employees on all continents. Therefore, faultlessly working software is of essential importance to the company. To guarantee the quality of their applications, Munich Re relies on a combination of automated and manual test cases. The testing process is driven in a risk-based fashion. Untested changes that end up in production typically have a five times higher bug probability. Therefore, it is important to know, which code is actually being executed by a test and which parts of the code remain untested.

Mission


Using Test Gap analysis, untested changes are identified and visualized for a portfolio of SAP and .NET applications. To this end, changes made to the system since a reference point (e.g. the last release) as well as code execution information from testing environments are examined. This information is gathered using a minimally invasive profiler, in order to minimize the impact on the testing process. The analysis includes unit tests as well as manual tests. Analysis results are provided to test managers as dashboards. By taking into account the criticality of the untested code, the risk caused by the changes, and the available budget, test managers are able to precisely allocate remaining test resources.

Benefit


Munich Re gains transparency about which parts of the code are executed by tests and which changes remain untested. This makes it possible to specifically complement test cases already during the testing stage. Changed areas, which are potentially more error-prone, can be identified, and available test resources can be used more effectively. This provides test managers an objective assessment of the testing process. The extension of their existing test suites helps Munich Re to select test cases such that indentified gaps are closed with minimal effort.