Is it possible to remove the Modified Time field from the list view if it is set as the default sorting column when creating a list?

No, the Modified Time field cannot be removed from the list view if it is set as the default sorting column. To remove it, you must first change the default sorting column to another field.