On the other side of town beyond 101 theres an outside pool.
Follow Xinyi all the way until it becomes Fude street and the pool is in Yucheng Park. It’s also a 5min walk from Houshanpi MRT.
If you get the latest Taipei Metro Tourist map Yucheng park is marked on it.
It cost 60 NT and for a public pool is pretty good.