What is the exact definition of a dictionary in the concept of linear algebra and computer science?
Yes, as it says, a "dictionary" is just the word they're using for a matrix with entries of a particular type that's used for a particular purpose. They're drfining the term "dictionary" in the text you quote.