video audio demo proble

#1
by amyburden - opened

Thanks so much for introducing the demo. The video looks great. But I met some problem when trying the code. I am aware that you make changes to the emit function. the emit function seems block because the output image only shows first frame. I am aware that in the history you use wait_for_item.

Can you try again? I can't reproduce that

Can you try again? I can't reproduce that

I made some modifications to your original code. I am not familiar with async programming. I skipped the Gemini part and tried to test the receive and send parts. I find the camera has long latency. After print some information and I find the receive function is called far more than the emit function. I try to use await asyncio.sleep(0.1) to make handler to deal with emit with high priority. But the problem remains. Can I have some suggestions from your side.

Hi, I figured out the problem was caused by the customized webrtc UI code part. Now it can work. I got another question. First, fastrtc seems a wrapper of webrtc, so why does using fastrtc stream break down the flow? Secondly, my video output have a very low fps and the queue for receiving increase very fast. From log, it seems that the times that video receive was called is more frequent. Do you have any suggestions or insight about why it happens this way? Since the output video is identical to the input, is there a way the video on UI uses the local cache instead of using the receive and emit process? In other words, the video on UI skip the turn server and play the camera data directly.

I found the problem. I use self.fps as my class property, which is reserved for subclass. it makes my output very weird/.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment