Scroll down in the Layouts ribbon group to see the custom layouts.
You can only delete custom layouts.
Select the custom layout that you want to delete.
Click Delete in the ribbon.