Clean up the Permban List