You can take public transit after quarantine (after 14 days) during the 7 days of self-management, but it is recommended to avoid unnecessary travel or public gatherings.
One thing to note, you cannot enter a hospital in the 7 days of self health management (they will scan your NHI card at the entrance).