Is it okay to use these kind of batteries with this holder (pictures inside)
It depends on the current you want to draw. Although the cells fit mechanically, those tagged cells, intended to be soldered, are capable of much higher current output than the spring terminals in the battery holder are intended to handle.

If your application is below the fraction of one amp for which the holder is intended, then fine.

If your application is capable of drawing the several amps that those batteries can source, you will probably have problems with the quality and consistency of those spring connections.