You can be the juiciest, ripest peach in the world, and there’s still going to be people who hate peaches.. — Dita Von Teese
Think of yourself as a market niche.
There will be a lot of people who like that niche and there will be individuals who don’t. And no matter what you do, you won’t be able to make the entire market like you. So, just give up the need to be liked by others.
This is completely natural and there’s no need to justify yourself.
The only thing you can do is to remain authentic, improve and provide value every day, and know that the growing number of “haters” means that you’re doing remarkable things.