You cannot cancel. They have to report any cancellation to the respective authorities, which would not go well for you. At least that’s my understanding.
I honestly forget the name. I closed my office four years ago! But 591.com.tw has lots of places like that. Just search the area you want, like Taipei, and put the price at like below 3000. You’ll find a bunch.