I understand your frustration. One way to fix it, which may take a while, depending on how many recent contacts there are, is to tap on and view each of the contacts in the recently added section one at a time and they will be removed the next time you open the contacts app.
