Can you set async defer when using {% includeJsFile %}?
As of Craft 3 (Tested using RC5) you can do it like this: 

{% do view.registerJsFile("path/to/script.js", {"async":"async", "defer":"defer"}) %}


Source: Documentation for Yii's view.registerJsFile()