Matching input buffer size to opus frame size
I ended up solving the problem. Because the input buffer was smaller than 1 frame, I was able to write the input to a circular buffer, wait until I have enough data, then do the processing. The result was the written to a second circular buffer, that would be read every block.