For well established reason, a customer with any transactions / activities cannot be deleted.
Customer may be made inactive.
Go to customer account, Settings.

Scroll down the screen and click on Make Customer inactive.