winter wear in taiwan

[rainbowballoon]

Hi people. Do u all have any suggestions on what i should wear or bring when i go to taiwan in the first 2 weeks of december? heard it's going to be a little cold, is thermal underwear needed?
I'll be in taipei, danshui, taizhong and will also visit some night markets.:Dthanks.