...government passes tax laws with loop-holes.
Government cuts HMRC inspectors.
Government follows advice from accountants and bankers on tax (those with the biggest incentive to avoid it).
Government engages in fiddles to avoid revealing true costs (i.e. PFI)
Government allows "non-doms" to get away with little or no tax (when they aren't really non-dom)
Government...it's long list...
What the government is annoyed at here is that the information is public. People only used to suspect that the major high-street chains and other paid little-to-no tax; but now we know. Up until they information was public, the government were very happy for their rich cronies to get away with paying nothing, whilst the lower-middle and working class get gouged for just about every penny.
These companies are wrong for not paying their due, but the government is even more wrong for trying to be all high-and-might about it. It was the Tories and Labour who created this mess in the first place.