Fix pytest to not always pass tests
Fix pytest to not always pass tests

Summary: how lovely you are, python.

Reviewed By: philipjameson

shipit-source-id: 5496645d1987ac43d3ec49f0328a6e5eab698fff

JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck,JoelMarcey/buck