The EPA had an annual budget in 2015 of $8B. So let's say they overpaid 2x for the furniture, and we fix that. Now we've saved ~.6% of their overall budget. Nowhere near enough to run the country on 1% taxes.
Articles like that are the definition of outrage inducing bike shedding.
The problem is that 'dumb stuff' is different for everyone when it comes to country level expenditures.