Losing APRC due to DUI?

So if you give up your nationality to become Taiwanese you could still get deported if not a citizen? But if you are not a national of any other country wouldn’t the country they deported you to just send you back to Taiwan?
If you have a Taiwanese passport can you reside in another country for a few years but stay Taiwanese ?