Mediasoup Server

Hello, I been using mediasoup to implement a media server for Livestreaming events using webRTC; from my observation: the system works fine for small number of consumers but as the number of comsumers increases; the delay increases as a result connection to the fist clients gets disconnected and new comming consumers can’t get the live streams.
I calculate the number of routers needed per workers

number of routers needed = (number of consumers / 400)  / number of Workers 

I created the routers based on this number “number of routers needed” then store it on array; and I assign the first router to the producer and the rest routers to the consumers. and I use pipeToRouter to route streams from the producer router to consumer router;
is there any way to fix this kind of problems? thanks