I'm not sure if it's a bug, but Column Layouts cannot be deleted using (only) the keyboard.
The only way to delete a layout is by selecting it and pressing delete.
Tested on the playground.