We mainly concern with the two following structures of the embedding space.

Semantic similarity structure: Semantically similar entities are close to each other in the embedding space, and vice versa. Semantic direction structure: There exist semantic directions in the embedding space, by which only one semantic aspect changes while all other aspects stay the same. It can be identified by a vector difference, such as the subtraction between two embedding vectors. 
 Question: What are the uncanny semantic structures of the embedding space?
Semantic similarity structure Semantic direction structure