Which is Warmer: Outside or Ocean?

The other day it was 17 degrees outside, and the ocean water temperature was a balmy 35 on the Northeast coast.

Now, one might wonder, what happens if I go swimming? Will the water actually feel warmer than the outside temperature. And, if so, how long could I go swimming for, before I would have to come out of the water, warm up in the cold air, bask in the winter sun, and then finally use a towel? This all, of course, assuming there's no wind chill factor, which would possibly eliminate the step of basking in the winter sun.

Hmmm.