Voice Activation: Send Email: Recipient Name not working
It needs to be a Google contact. Your voice request is sent to Google's servers to be parsed and it looks for the information in your Google Contacts. The server can't query your phone.

See this Google Help thread.