Don't get angry because you're insulted. I was insulted by other pastors on National Tv for 7 years but I was too busy forging ahead and getting bigger.
Someone asked if we should settle the fight; I said there was no fight. If one boxer enters the ring and there is no opponent, he will go home.
Of a truth, some people insult you just because they want you to react for them to have something to hold against you. Just ignore, if they have conscience they will realize and repent.