You are able to remove contacts within the Admin System. But please ensure that you leave at least one person with administration access. Otherwise you will have no way of viewing important payment information, or accessing the other useful aspects of the system like reports and marketing materials.