How to get a Hong Kong Visa in Taiwan

If you hold a passport from a country that doesn’t have a visa waiver with Hong Kong, how can you apply for a visa in Taiwan? I’ve asked some travel agencies, but they either don’t do it or they don’t want to do it.