Of course there are times when I miss my thin body. I think every gainer has those moments when they feel very vulnerable and want to return to a simpler time. The social angst that can be felt by being the fat guy can be too much to handle for some people. But you always have to remember that you are doing this because it is something that you want, that you desire. Whether or not others agree with your choices, it is your body and your life.
What kind of relationships are you implying?