The correct use of the term "TLS session"
Yes, that looks like a correct usage of the word session.

Of course the session keys are only valid for the record layer. But the session keys are tied to the session, not the other way around. And usually the TLS session is of course tied to a TCP/IP session, but that doesn't need to be the case.