Is it possible to go back to a place where you had a bad magic mushroom trip?

Basically, what happened, I tried magic mushrooms at a friends place, not that many I wasn't hallucinating or anything, but I had a freak out and fell asleep under a chair, I went back the next week with the same people and started getting scared, so I fell asleep again. I really want to go back to his house because he is my best friend, even if it is not the same people there.