Taiwan just (slightly) relaxed Dual Citizenship Rules

Do you mean if I overstayed or got caught working illegally? Yes.
Can I simply re-enter as a citizen? Yes.
Do I need to give anyone the finger? Only if I want to be charged with an offence.

NIA said I can enter as a foreigner and be given a new Tax ID number.