Much scholarship suggests that the poem is told from the point of view of an old seafarer, who is reminiscing and evaluating his life as he has lived it.
Then the speaker again shifts, this time not in tone, but in subject matter.