People just seem to love making others feel bad. Is it that uncool to be forgiving and understanding? Do people always have a secret agenda behind their seemingly innocent actions? Whatever happened to good old fashioned trust? It's a sad and difficult world we live in.
Let others say as they want. Whatever makes them happy. You can never please every single one. Just keep trying to please as many as you can. And hope one day, they'll please too.