I don’t get much joy from Taiwan electronics chain stores. I now do my electronics shopping at independent shops based on experience. No experience in Kaohsiung, but maybe in the electronics computer neighborhood.
If you happen to visit Tainan, Rainbow maybe has the largest selection of low to mid-level in-ear, not over-ear but many, headphones in Taiwan. Also many of the upper level in-ear.