is it available to pay for my multiple inputs at one time?
Within a bitcoin transaction, there is no specification for 'which address (input) is paying the fee'. 

The fee is simply calculated by subtracting the sum of all outputs, from the sum of all inputs. The inputs are consumed entirely, and the newly formed UTXOs specify the exact amount paying each address. Whatever is left over is the fee that miners can claim.