Using difference modifier on two objects doesn't always work
For the boolean operation to work properly you need to fix the mesh first.


Select the text object
Go into edit mode, Tab
Select all, A
Remove the doubles, W -> Remove Doubles
Fix the normals, Ctrl N


Once you do this the boolean operation will work properly