Is it ok for me to attend a woman's gym?

I was a regular gym goer a while back and it was a men's and women's gym. Then when I reverted I stopped going. Is it ok for me to go to a woman's gym and not have to cover up my arms and neck? I feel so unfit!