I think @anon24369109 does that regularly. It allows him to shop tax free in Taiwan - but he cannot perform certain tasks while he is not “officially” in the country as a Taiwanese.
Seems to be perfectly legal - Taiwan doesn’t seem to have a requirement to enter on a TW passport.