I would err very much on the side of accountability. Privacy is for private citizens. Those who want their privacy should reciprocate by keeping out of everyone else’s business, and that means not being in the government.
But no double standards. If his tax returns are public, then so should be the tax returns of all elected officials whatsoever. All of them, or none of them.