Adding Display Suite fields to Search API results
I missed it earlier, but it turns out that Search API just exposed the Excerpt field to view modes.

Updating Search API to 8.x-1.x-dev and a cache rebuild gave me the functionality I need.