>Hill climbing obviously gets stuck easily in 2 or 3 dimensions. So our intuition ain't reliable.

Also our intuition about overfitting from lower-dimensional representations seems to be less of an issue at high dimensions.