Whatever negative things people think and say about you is enough to bring you down provided you belief that it carries a weight that can push you hard. Don't agree to accept what critics say; be prepared to silence them by doing what they think you can't do!
Do not give them a candle to light the way, teach them how to make fire instead. That is the meaning of enlightenment.