Can I leave the labels empty while editing in the Labels Editor?

No, the field values should not be empty in the Custom Label column.
To know more about Labels Editor, click here.