Order by related field title
You probably have to loop through all the speaker (ordered by lastName) that are related to the talks (the speaker entry is the targetElement). Then use one craft.entries (ElementCriteriaModel) for each loop to get the talk entry.

See this Q/A for a comparable problem.