Using Chromium in a Docker container to connect to mediasoup in another container fails (with mediasoup >=3.5.8)

I managed to reprduce the issue with mediasoup demo and docker.
I created a fork for you to play with at https://github.com/erlichmen/mediasoup-demo with minimum changes.
The repo has two branches 3.5.7 and 3.6.21.

Take each branch inside server run docker/build.sh and then “docker-compose up” to run it.
Modify the MEDIASOUP_ANNOUNCED_IP inside docker-compose.yml to your computer IP. before running it.

After running the server run the app and point to http://localhost:3001, notice that on branch 3.5.7 webrtc internals show a complted ice canindate flow while on branch 3.6.21 it fails.