It's too late. I even use it. This isn't one of the phrases that makes me crazy, though I have some, and I understand that the phrases that make us crazy are just these random irritants and you never know what it's going to be next. Something else will soon bug the hell out of me, though this doesn't, and I'll be equally powerless to stop it. After all, a lot of our daily speech was a new coinage that drove somebody crazy once.