The people who are added to the contacts list with labels will show under contacts until they accept your invitation. 


The people who accept your invitation becomes your customer which means they will then move to your Customers list instead of contacts. 


Label counts will decrease as soon as people start to accept your invitation and become your customers.