Dual host ip after changing ip range

Whenever I change the IP range of one of my networks, all hosts receive a a new IP, but in the dashboard I see both the new and old host IPs. Left it for a few weeks, but the old IPs never go away.

How do I get rid of the old IPs in the dashboard?