The only time when what others think matter is when you seek validation for your own self. But you need no validation when you have confidence in yourself.
There are 7.5 billion people in the world and you let the opinion of one stop all your energy? Do not do that.
Love your decision and make an effort to try and understand why you made it. You will surely become unstoppable once you have a sound reason.