I'm scared to go back to work...am i in the wrong?

If you are that uncomfortable at your job, then it is time to start looking for a new one. But make sure you have another job before resigning from this one.