I have a Cultural Identity Crisis? Can you advise me please?

Do whatever you want. You are an individual and have a right to make decisions about yourself and your values. You don't have to be put in a box and be defined by your heritage. You certainly don't have to allow yourself to be verbally abused by those with different sensibilities than your own. Tell them to back off and wear whatever you want.