Cannot execute boolean operation with imported SVG
You could try and deal with this in another way.  

I selected an upwards facing face and used shift+g->normals to select all the other faces that are facing upwards and deleted them.

Now if you select edges and press f, the faces can be filled in quickly enough.  

By doing this, you can build up the large box without having to use the boolean modifier.