cuvid - slow performance when used 4 devices
NVidia boards has a limit number of concurrent encoding tasks, according number of encode engine chips on board. Look at specifications of boards you are using.
Even if you have a board with unrestricted number of sessions to it, you will have a speed degradation, because of some task pipelining on host side.