Regardless of right-of-way laws in Taiwan, it is generally assumed that the pedestrian will be courteous and give the right-of-way to the driver, in order not to cause a traffic backup. That’s why drivers don’t usually stop for pedestrians.
The driver gave you the finger because you weren’t courteous. Next time, just let the driver go first. It is much easier for you to stop walking than for a vehicle to brake.