Glue gun glue as usb port filler
Hot melt glue should be fine as it has low electrical conductivity and does not generally absorb moisture which would be a problem. It will be difficult to make a nice finish.

Wikipedia's Hot-melt adhesive may be worth a read.