If you go to Tamsui anyway and you dislike Taipei downtown, why not spend most of your time up there?
@marco surely can give you some recommendations for that beside the obvious places such as the fort, the fisherman wharf, the ferry across the river, the old-street area, etc.
For places to eat, check