 The IRS is the most powerful collection agency on earth. And if you owe back taxes, the news isn't good. The IRS has raised the interest rate it charges on unpaid taxes in recent years. This hits hard if you're behind on your taxes. Most people don't know it, but the IRS adds interest charges to your tax debts daily.