Cleanup created files after CA test
Cleanup created files after CA test

Closes #1960

privacyidea/privacyidea,privacyidea/privacyidea,privacyidea/privacyidea,privacyidea/privacyidea,privacyidea/privacyidea,privacyidea/privacyidea