Parliament finally responded to the protests by repealing the Townshend taxes in 1770 , except for the tea duty , which Prime Minister Lord North kept to assert " the right of taxing the Americans " .