Why do people keep calling conversion "reverting" to Islam?

You can only revert to something which you were at one time. I've never been a Muslim, or a member of any religion, at any point in my life, so how could it be a reversion?