I too think is the getting noticed factor. For me, when finally starting wearing appopriate sized clothing - I got alot of comments. I am not used to good comments or compliments so it was hard for me to accept. I just felt plain uncomfortable with the attention.

Could this be the case with you too?