Excel for Mac seems to use "Page Layout" view by default. This can be switched to the more sane Normal view by selecting View -> Normal from the menu.
You can change the default view in Excel -> Preferences -> View -> Preferred view for new sheets.
Still trying to figure out if there is a way to force all document openings to this setting as well.