Visa for traveling around greater Taiwan

Care to share any details or pitfalls for a Taiwanese citizen traveling around the greater Taipei area? How do I get a visa from say China (or the compatriots passport or whatever) or HK or Malaysia, which offices do I go to? and how much is the average cost for going to those places?