How do I say "It didn't help that.." In english, we often use the transition "it didn't help that" to indicate that something bad had happened, and that there was another factor that potentially made it even worse. 

Ex. He was already very sick from the fever, so it didn't help that he refused to drink soup. 

Could I say, 
他已经因为发烧了感到很弱。 更坏他不让别人给他汤喝？
“It didn't help that..” could be translated to "更糟的是" （Literally means worse is）

他已经发烧发到很虚弱了，更糟的是不肯喝汤。