Go to the Store menu, under 'Sales' click on Customers link. 'Customers' page appears. Find the customer account you wish to delete using Filter Customers options and click on at the end of its row. Confirm you wish to delete this account in a pop-up window.
When you delete a customer account you actually erase it from customers database. However, all details about a customer still exist in orders database in each of their orders.