Investigate merging property files from main and test modules

[AndreasVolkmann]

A common setup is to have a application.* in main and one in test, where test adds or overwrites values specified in main.

Currently, it seems only one is loaded.

Investigate the current behavior and see if we can enable a merging of both.
How would we determine the order?