I too have been concerned with this, especially over a long period of time and large number of members. I've been testing deleting users from back end, and deleting from front-end (user deletes his own profile).

The results are not as I expected. There are a lot of ghosts left behind.