Only call _setup_cli_logging in __init__
Only call _setup_cli_logging in __init__

Supersedes #4719

nicoddemus/pytest,The-Compiler/pytest,The-Compiler/pytest,RonnyPfannschmidt/pytest,tomviner/pytest,tomviner/pytest,Akasurde/pytest,markshao/pytest,pytest-dev/pytest,alfredodeza/pytest,nicoddemus/pytest