Hi, I know that mediasoup is based on SFU architecture. Is it possible to make face processing (for example - emotion recogizing) on the server side? Example scenario: 5 people are connected in one “room” and they send streams to NodeJS server (which uses API from media soup). Then, that server g…

Yes. Consume those streams in mediasoup by using directTransport.consume(), you get the raw RTP packets, then you parse them (you can use GitHub - versatica/rtp.js: RTP stack written in TypeScript ), you modify or do whatever, and call directTransport.produce() and producer.send() to send them to the…

So before starting modifying packets, I would like to make whole traffic go through node.js where I could have access to these RTPPackets. Am I thinking correctly that to achieve something like this I need to have data flow like on this simplified chart?! Untitled Diagram (1)|629x141 And to achiev…

I’m also considering this, using nodejs(rtp.js) for server-side video stream transform may be not a good idea, since these CPU-intensive work better be done in C++, Also if do flexible pipeline deployment, maybe deploy the transform nodes as sidecar in service mesh style? This would not introduce e…

Hi after even more research, I learned few things and I wrote code, which in my head should work, but I can only get access to packets in directTransport, but after sending them back I cannot retrieve them. So, I want to write to you in detail what I did, and I would be really grateful if you could…

I don’t know why you are using mediasoup Router rtpCapabilities in the Consumer. This is clearly explained in the docs. Those must be the capabilities of the consuming device. If you don’t know how to generate them, that’s a different topic, but you cannot just tell to mediasoup “this consuming devi…

Ok, that make sense, I thought that when I am using directTransport perhaps something like this could be possible. But when I am doing this consumer.on('rtp', (rtpPacket) => { producer.send(rtpPacket) // console.log(rtpPacket) }) I can console.log rtpPacket …

Now imagine that you are sending RTP to the consuming endpoint, but it does not understand it because the payload types or SSRC or whatever you signaled to it doesn’t match the values in the RTP packets.

I will write another question here because I think this is still related. I am in the moment when my directTransport is consuming rtpPackets and sending them back. But I want more, I want to get rtpacket and then have two producers to send them, so I make two producers like this const produ…

May you enable mediasoup debug logs instead of pasting your Socket.io logs/traces? BTW you cannot producer same RTP parameters twice in same transport. How do you expect that the transport can identify RTP packets later?

Is it possible to make some "backend" jobs on the server side??

mediasoup libraries

mbogusz998 (Michał) October 6, 2021, 7:51am 9

Okay so after all, my problems were solved when I used this answer Producer send rtp packet - #3 by hdoru

Topic		Replies	Views
is there an "easy" way to "consume" media on the server? mediasoup libraries	4	351	May 20, 2024
Processing video server-side, inside a router? mediasoup libraries	7	1135	August 30, 2023
Producer send rtp packet mediasoup libraries	4	697	January 11, 2021
How to forward stream from one mediasoup v3 server to another? mediasoup libraries	38	6056	August 28, 2020
Forward Mediasoup RTP Transport to AWS Elemental Media Live Integration	6	1984	May 13, 2020

Is it possible to make some "backend" jobs on the server side??

Related topics