ERROR:Worker worker process died unexpectedly

I’m getting this randomly in my production server:

2019-09-15T19:00:47.102Z mediasoup:ERROR:worker[pid:6089] (stderr) *** Error in `/var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker': corrupted size vs. prev_size: 0x0000000001bbda00 ***
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) ======= Backtrace: =========
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /lib/x86_64-linux-gnu/libc.so.6(+0x777e5)[0x7f5130a187e5]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /lib/x86_64-linux-gnu/libc.so.6(+0x7e9dc)[0x7f5130a1f9dc]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /lib/x86_64-linux-gnu/libc.so.6(+0x81cde)[0x7f5130a22cde]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /lib/x86_64-linux-gnu/libc.so.6(__libc_malloc+0x54)[0x7f5130a25184]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /usr/lib/x86_64-linux-gnu/libstdc++.so.6(_Znwm+0x15)[0x7f513154e5f5]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x64b271]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x64b40a]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x64b036]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x62dccc]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x6b7045]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x6b7d56]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x6ad777]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x5d8226]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x5d7580]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x75311a]
2019-09-15T19:00:47.103Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x752e30]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x75536a]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x74569d]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x5b0350]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x5bc545]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x73d44a]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f51309c1830]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker[0x40bf39]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) ======= Memory map: ========
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 00400000-009da000 r-xp 00000000 08:03 17174312                           /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 00bda000-00c12000 r--p 005da000 08:03 17174312                           /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 00c12000-00c19000 rw-p 00612000 08:03 17174312                           /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 00c19000-01107000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 01a16000-0cef1000 rw-p 00000000 00:00 0                                  [heap]
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5128000000-7f5128021000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5128021000-7f512c000000 ---p 00000000 00:00 0 
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f512fd9f000-7f51301a0000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51301a0000-7f51301a1000 ---p 00000000 00:00 0 
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51301a1000-7f51309a1000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51309a1000-7f5130b61000 r-xp 00000000 08:03 4592185                    /lib/x86_64-linux-gnu/libc-2.23.so
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130b61000-7f5130d61000 ---p 001c0000 08:03 4592185                    /lib/x86_64-linux-gnu/libc-2.23.so
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130d61000-7f5130d65000 r--p 001c0000 08:03 4592185                    /lib/x86_64-linux-gnu/libc-2.23.so
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130d65000-7f5130d67000 rw-p 001c4000 08:03 4592185                    /lib/x86_64-linux-gnu/libc-2.23.so
2019-09-15T19:00:47.104Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130d67000-7f5130d6b000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130d6b000-7f5130d83000 r-xp 00000000 08:03 4592172                    /lib/x86_64-linux-gnu/libpthread-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130d83000-7f5130f82000 ---p 00018000 08:03 4592172                    /lib/x86_64-linux-gnu/libpthread-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130f82000-7f5130f83000 r--p 00017000 08:03 4592172                    /lib/x86_64-linux-gnu/libpthread-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130f83000-7f5130f84000 rw-p 00018000 08:03 4592172                    /lib/x86_64-linux-gnu/libpthread-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130f84000-7f5130f88000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130f88000-7f5130f9f000 r-xp 00000000 08:03 4587707                    /lib/x86_64-linux-gnu/libgcc_s.so.1
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5130f9f000-7f513119e000 ---p 00017000 08:03 4587707                    /lib/x86_64-linux-gnu/libgcc_s.so.1
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f513119e000-7f513119f000 r--p 00016000 08:03 4587707                    /lib/x86_64-linux-gnu/libgcc_s.so.1
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f513119f000-7f51311a0000 rw-p 00017000 08:03 4587707                    /lib/x86_64-linux-gnu/libgcc_s.so.1
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51311a0000-7f51312a8000 r-xp 00000000 08:03 4592188                    /lib/x86_64-linux-gnu/libm-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51312a8000-7f51314a7000 ---p 00108000 08:03 4592188                    /lib/x86_64-linux-gnu/libm-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51314a7000-7f51314a8000 r--p 00107000 08:03 4592188                    /lib/x86_64-linux-gnu/libm-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51314a8000-7f51314a9000 rw-p 00108000 08:03 4592188                    /lib/x86_64-linux-gnu/libm-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f51314a9000-7f513167b000 r-xp 00000000 08:03 9568391                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.26
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f513167b000-7f513187b000 ---p 001d2000 08:03 9568391                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.26
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f513187b000-7f5131886000 r--p 001d2000 08:03 9568391                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.26
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131886000-7f5131889000 rw-p 001dd000 08:03 9568391                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.26
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131889000-7f513188c000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f513188c000-7f5131893000 r-xp 00000000 08:03 4592168                    /lib/x86_64-linux-gnu/librt-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131893000-7f5131a92000 ---p 00007000 08:03 4592168                    /lib/x86_64-linux-gnu/librt-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131a92000-7f5131a93000 r--p 00006000 08:03 4592168                    /lib/x86_64-linux-gnu/librt-2.23.so
2019-09-15T19:00:47.105Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131a93000-7f5131a94000 rw-p 00007000 08:03 4592168                    /lib/x86_64-linux-gnu/librt-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131a94000-7f5131a97000 r-xp 00000000 08:03 4592170                    /lib/x86_64-linux-gnu/libdl-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131a97000-7f5131c96000 ---p 00003000 08:03 4592170                    /lib/x86_64-linux-gnu/libdl-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131c96000-7f5131c97000 r--p 00002000 08:03 4592170                    /lib/x86_64-linux-gnu/libdl-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131c97000-7f5131c98000 rw-p 00003000 08:03 4592170                    /lib/x86_64-linux-gnu/libdl-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131c98000-7f5131cbe000 r-xp 00000000 08:03 4592171                    /lib/x86_64-linux-gnu/ld-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131e8d000-7f5131eb6000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131ebc000-7f5131ebd000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131ebd000-7f5131ebe000 r--p 00025000 08:03 4592171                    /lib/x86_64-linux-gnu/ld-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131ebe000-7f5131ebf000 rw-p 00026000 08:03 4592171                    /lib/x86_64-linux-gnu/ld-2.23.so
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7f5131ebf000-7f5131ec0000 rw-p 00000000 00:00 0 
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7ffd4e20d000-7ffd4e22e000 rw-p 00000000 00:00 0                          [stack]
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7ffd4e274000-7ffd4e277000 r--p 00000000 00:00 0                          [vvar]
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) 7ffd4e277000-7ffd4e279000 r-xp 00000000 00:00 0                          [vdso]
2019-09-15T19:00:47.106Z mediasoup:ERROR:worker[pid:6089] (stderr) ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
2019-09-15T19:00:47.121Z mediasoup:Channel[pid:6089] Channel ended by the worker process
2019-09-15T19:00:47.121Z mediasoup:Worker close()
2019-09-15T19:00:47.121Z mediasoup:Channel[pid:6089] close()
2019-09-15T19:00:47.122Z mediasoup:Router workerClosed()
2019-09-15T19:00:47.122Z mediasoup:Transport routerClosed()
2019-09-15T19:00:47.122Z mediasoup:Consumer transportClosed()
2019-09-15T19:00:47.400Z mediasoup:ERROR:Worker worker process died unexpectedly [pid:6089, code:null, signal:SIGABRT]

Can you check the core dump?

In order to make mediasoup create a core dump when crashing, as root (or via sudo) run:

$ mkdir /tmp/cores
$ chmod 777 /tmp/cores
$ echo "/tmp/cores/core.%e.sig%s.%p" > /proc/sys/kernel/core_pattern
$ ulimit -c unlimited

In addition to what @jmillan said, you must run those steps before running mediasoup and in the same terminal. The logs above provide zero useful info for us.

The “corrupted size vs. prev_size” error usually means an attempt to access memory that has not been allocated, which indeed would be a bug somewhere in the code, so definitely we need a proper coredump to diagnose it.

It must be:

ulimit -c unlimited

However it doesn’t work when is set via npm or pm2 script. Any idea?

No idea honestly. ulimit -c unlimited must be called just before running the process in the same terminal session, no matter how you run the process.

Apparently pm2 starts a separat shell for running apps so any command that is executed before in the terminal has no effect.

No idea. You can set the limit within your Node app (before creating any mediasoup worker) using the posix module.

It worked and I could create core dumps. :ok_hand:

Now I have two core dump files in size of 36 and 94 MB. How can I provide the debug information?

Here’s the output of running gdb --core=core-dump-file:

[New LWP 21709]
[New LWP 21714]
Core was generated by '../node_modules/mediasoup/worker/out/Release/mediasoup-work'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f8575755428 in ?? ()
[Current thread is 1 (LWP 21709)]

Hi,

Try to get some info from the core dump:

gdb path/to/mediasoup/binary path/to/the/core

then:

bt full

Hi

There is no attachment option so I paste the whole output here.

BTW I’m using mediasoup v3.2.5.

$ gdb /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker /tmp/cores/core.mediasoup-worke.sig6.21709
GNU gdb (Ubuntu 8.2-0ubuntu1~16.04.1) 8.2
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker...done.

warning: core file may not match specified executable file.
[New LWP 21709]
[New LWP 21714]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-work'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f8575755428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
54      ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
[Current thread is 1 (Thread 0x7f8576c2e740 (LWP 21709))]

(gdb) bt full
#0  0x00007f8575755428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pd = <optimized out>
        pid = 21709
        selftid = 21709
#1  0x00007f857575702a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x6c2f756e672d7875, sa_sigaction = 0x6c2f756e672d7875}, sa_mask = {__val = {
              3615882721498522217, 4063996231707471411, 3472334898414892853, 3906649718116527408, 8223625903104012641,
              3472328295963438455, 4195155967701168179, 3544958757364577072, 2314885530818457655, 2314885530818453536,
              7795484802351636512, 3917909816998060649, 3276497845987585332, 7233459864884047463, 8299627453906824556,
              3906649718116518511}}, sa_flags = 808923489, sa_restorer = 0x9b}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f85757977ea in __libc_message (do_abort=do_abort@entry=2, fmt=fmt@entry=0x7f85758b0ed8 "*** Error in `%s': %s: 0x%s ***\n")
    at ../sysdeps/posix/libc_fatal.c:175
        ap = <error reading variable ap (Attempt to dereference a generic pointer.)>
        fd = 2
        on_2 = <optimized out>
        list = <optimized out>
        nlist = <optimized out>
        cp = <optimized out>
        written = <optimized out>
#3  0x00007f85757a037a in malloc_printerr (ar_ptr=<optimized out>, ptr=<optimized out>,
    str=0x7f85758b0f50 "free(): invalid next size (fast)", action=3) at malloc.c:5006
        buf = "00000000031db320"
        cp = <optimized out>
        ar_ptr = <optimized out>
        ptr = <optimized out>
        str = 0x7f85758b0f50 "free(): invalid next size (fast)"
        action = 3
        buf = <optimized out>
        cp = <optimized out>
#4  _int_free (av=<optimized out>, p=<optimized out>, have_lock=0) at malloc.c:3867
        size = <optimized out>
        fb = <optimized out>
        nextchunk = <optimized out>
        nextsize = <optimized out>
        nextinuse = <optimized out>
        prevsize = <optimized out>
        bck = <optimized out>
        fwd = <optimized out>
        errstr = <optimized out>
        locked = <optimized out>
        ignore = <optimized out>
        idx = <optimized out>
        old = <optimized out>
--Type <RET> for more, q to quit, c to continue without paging--c
        old2 = <optimized out>
        old_idx = <optimized out>
        ignore1 = <optimized out>
        ignore2 = <optimized out>
        ignore3 = <optimized out>
        ignore = <optimized out>
        __atg1_result = <optimized out>
        ret = <optimized out>
        ignore1 = <optimized out>
        ignore2 = <optimized out>
        ignore3 = <optimized out>
        heap = <optimized out>
        ignore = <optimized out>
#5  0x00007f85757a453c in __GI___libc_free (mem=<optimized out>) at malloc.c:2968
        ar_ptr = <optimized out>
        p = <optimized out>
        hook = <optimized out>
#6  0x00000000004450b5 in dtls1_hm_fragment_free (frag=0x3872250) at ../deps/openssl/openssl/ssl/statem/statem_dtls.c:103
No locals.
#7  0x000000000040ce69 in dtls1_clear_sent_buffer (s=s@entry=0x37ebda0) at ../deps/openssl/openssl/ssl/d1_lib.c:133
        item = 0x2ecf310
        frag = <optimized out>
#8  0x000000000040cec8 in dtls1_clear_queues (s=0x37ebda0) at ../deps/openssl/openssl/ssl/d1_lib.c:111
No locals.
#9  dtls1_free (s=0x37ebda0) at ../deps/openssl/openssl/ssl/d1_lib.c:145
No locals.
#10 0x000000000042b3fa in SSL_free (s=0x37ebda0) at ../deps/openssl/openssl/ssl/ssl_lib.c:1204
        i = <optimized out>
        s = 0x37ebda0
        i = <optimized out>
#11 0x000000000060d83c in RTC::DtlsTransport::~DtlsTransport (this=0x383af70, __in_chrg=<optimized out>) at ../src/RTC/DtlsTransport.cpp:657
No locals.
#12 0x000000000060d8de in RTC::DtlsTransport::~DtlsTransport (this=0x383af70, __in_chrg=<optimized out>) at ../src/RTC/DtlsTransport.cpp:666
No locals.
#13 0x00000000006afbaa in RTC::WebRtcTransport::~WebRtcTransport (this=0x2e88320, __in_chrg=<optimized out>) at ../src/RTC/WebRtcTransport.cpp:266
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        udpSocket = <optimized out>
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        tcpServer = <optimized out>
#14 0x00000000006afe62 in RTC::WebRtcTransport::~WebRtcTransport (this=0x2e88320, __in_chrg=<optimized out>) at ../src/RTC/WebRtcTransport.cpp:294
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        udpSocket = <optimized out>
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        tcpServer = <optimized out>
#15 0x000000000064d26a in RTC::Router::HandleRequest (this=0x78be940, request=0x2eba600) at ../src/RTC/Router.cpp:283
        transport = 0x2e88320
#16 0x00000000005be6c5 in Worker::OnChannelRequest (this=0x7fff471f8400, request=0x2eba600) at ../src/Worker.cpp:188
        router = 0x78be940
#17 0x00000000005e0321 in Channel::UnixStreamSocket::UserOnUnixStreamRead (this=0x2e52ff0) at ../src/Channel/UnixStreamSocket.cpp:265
        jsonRequest = {m_type = nlohmann::detail::value_t::object, m_value = {object = 0x3ce4a60, array = 0x3ce4a60, string = 0x3ce4a60, boolean = 96, number_integer = 63851104, number_unsigned = 63851104, number_float = 3.1546636935436601e-316}}
        request = 0x2eba600
        readLen = 159
        jsonStart = 0x7f8574ca1f9e "{\"id\":3459,\"method\":\"transport.close\",\"internal\":{\"routerId\":\"86348f81-ec1c-4ea7-8bad-165b4df7db06\",\"transportId\":\"cd723450-7195-49d4-a167-e0c669137137\"}},"
        jsonLen = 154
        nsRet = 0
        __FUNCTION__ = "UserOnUnixStreamRead"
#18 0x00000000005d8cf4 in UnixStreamSocket::OnUvRead (this=0x2e52ff0, nread=159) at ../src/handles/UnixStreamSocket.cpp:265
        __FUNCTION__ = "OnUvRead"
#19 0x00000000005d82cb in onRead (handle=0x2e53040, nread=159, buf=0x7fff471f4fc0) at ../src/handles/UnixStreamSocket.cpp:35
        socket = 0x2e52ff0
#20 0x000000000074fda6 in uv__read (stream=0x2e53040) at ../deps/libuv/src/unix/stream.c:1234
        buflen = 2605183
        buf = {base = 0x7f8574ca1f9a "154:{\"id\":3459,\"method\":\"transport.close\",\"internal\":{\"routerId\":\"86348f81-ec1c-4ea7-8bad-165b4df7db06\",\"transportId\":\"cd723450-7195-49d4-a167-e0c669137137\"}},", len = 2605183}
        nread = 159
        msg = {msg_name = 0x7fff471f5040, msg_namelen = 1193234544, msg_iov = 0x7fff471f5030, msg_iovlen = 6124928, msg_control = 0x7fff471f5030, msg_controllen = 6124847, msg_flags = 0}
        cmsg_space = "\000\000\000\000\000\000\000\000\200\066\353\003", '\000' <repeats 12 times>, "PO.\003\000\000\000\000`Q\037G\377\177\000\000k0u", '\000' <repeats 13 times>, "\200\066\353\003\000\000\000\000pP\037G\377\177\000\000\000\000\000\000\037\000\000\000\300P\037G\377\177\000\000\377\377\377\377\377\377\377\377\200(\303\000\000\000\000\000\000\000\001\000\000\000\000\000\300P\037G\377\177\000\000\200\000\000\000\000\000\000\000pP\037G\377\177\000\000\001", '\000' <repeats 31 times>, "\220\332\363\003\000\000\000\000\002\000\374\257\002\261\064\254\000\000\000\000\000\000\000\000t/]\000\000\000\000\000"...
        count = 31
        err = 0
        is_ipc = 0
        __PRETTY_FUNCTION__ = "uv__read"
#21 0x0000000000750085 in uv__stream_io (loop=0x2e52c00, w=0x2e530c8, events=1) at ../deps/libuv/src/unix/stream.c:1301
        stream = 0x2e53040
        __PRETTY_FUNCTION__ = "uv__stream_io"
#22 0x000000000075536a in uv__io_poll (loop=0x2e52c00, timeout=13) at ../deps/libuv/src/unix/linux-core.c:384
        max_safe_timeout = 1789569
        events = {{events = 1, data = {ptr = 0x3, fd = 3, u32 = 3, u64 = 3}}, {events = 1, data = {ptr = 0x42, fd = 66, u32 = 66, u64 = 66}}, {events = 1, data = {ptr = 0x5e, fd = 94, u32 = 94, u64 = 94}}, {events = 1, data = {ptr = 0x78, fd = 120, u32 = 120, u64 = 120}}, {events = 1, data = {ptr = 0x76, fd = 118, u32 = 118, u64 = 118}}, {events = 1, data = {ptr = 0x55, fd = 85, u32 = 85, u64 = 85}}, {events = 1, data = {ptr = 0x39, fd = 57, u32 = 57, u64 = 57}}, {events = 1, data = {ptr = 0x52, fd = 82, u32 = 82, u64 = 82}}, {events = 1, data = {ptr = 0x2b, fd = 43, u32 = 43, u64 = 43}}, {events = 1, data = {ptr = 0x1a, fd = 26, u32 = 26, u64 = 26}}, {events = 1, data = {ptr = 0x35, fd = 53, u32 = 53, u64 = 53}}, {events = 1, data = {ptr = 0x17, fd = 23, u32 = 23, u64 = 23}}, {events = 1, data = {ptr = 0x1c, fd = 28, u32 = 28, u64 = 28}}, {events = 1, data = {ptr = 0x39, fd = 57, u32 = 57, u64 = 57}}, {events = 1, data = {ptr = 0x25, fd = 37, u32 = 37, u64 = 37}}, {events = 1, data = {ptr = 0x11, fd = 17, u32 = 17, u64 = 17}}, {events = 1, data = {ptr = 0x27, fd = 39, u32 = 39, u64 = 39}}, {events = 1, data = {ptr = 0xd, fd = 13, u32 = 13, u64 = 13}}, {events = 1, data = {ptr = 0x1b, fd = 27, u32 = 27, u64 = 27}}, {events = 1, data = {ptr = 0x4d, fd = 77, u32 = 77, u64 = 77}}, {events = 1, data = {ptr = 0x23, fd = 35, u32 = 35, u64 = 35}}, {events = 1, data = {ptr = 0x41, fd = 65, u32 = 65, u64 = 65}}, {events = 1, data = {ptr = 0x49, fd = 73, u32 = 73, u64 = 73}}, {events = 1, data = {ptr = 0xd, fd = 13, u32 = 13, u64 = 13}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 650 times>, {events = 48707984, data = {ptr = 0x2e7460800000000, fd = 0, u32 = 0, u64 = 209212907869700096}}, {events = 0, data = {ptr = 0x497bc5 <BN_CTX_get+85>, fd = 4815813, u32 = 4815813, u64 = 4815813}}, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x8, fd = 8, u32 = 8, u64 = 8}}, {events = 48711152, data = {ptr = 0x2e7399000000000, fd = 0, u32 = 0, u64 = 209199198334091264}}, {events = 0, data = {ptr = 0x4a7df7 <bn_sqr_fixed_top+103>, fd = 4881911, u32 = 4881911, u64 = 4881911}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 16, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 14 times>, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x2e745f0, fd = 48711152, u32 = 48711152, u64 = 48711152}}, {events = 48712152, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x4a13df <bn_from_montgomery_word+735>, fd = 4854751, u32 = 4854751, u64 = 4854751}}, {events = 4294967295, data = {ptr = 0x2e749e0ffffffff, fd = -1, u32 = 4294967295, u64 = 209217138412486655}}, {events = 0, data = {ptr = 0x2e74590, fd = 48711056, u32 = 48711056, u64 = 48711056}}, {events = 8, data = {ptr = 0x2e745f000000000, fd = 0, u32 = 0, u64 = 209212804790484992}}, {events = 0, data = {ptr = 0x2e73990, fd = 48707984, u32 = 48707984, u64 = 48707984}}, {events = 48711152, data = {ptr = 0x471f7dd000000000, fd = 0, u32 = 0, u64 = 5124953233277583360}}, {events = 32767, data = {ptr = 0x2e74590, fd = 48711056, u32 = 48711056, u64 = 48711056}}, {events = 48712528, data = {ptr = 0x471f7dd000000000, fd = 0, u32 = 0, u64 = 5124953233277583360}}, {events = 32767, data = {ptr = 0x4a16d4 <bn_from_mont_fixed_top+84>, fd = 4855508, u32 = 4855508, u64 = 4855508}}, {events = 48711056, data = {ptr = 0x471f7e4000000000, fd = 0, u32 = 0, u64 = 5124953714313920512}}, {events = 32767, data = {ptr = 0x7fff471f7dd0, fd = 1193246160, u32 = 1193246160, u64 = 140734386634192}}, {events = 48707984, data = {ptr = 0x471f7df000000000, fd = 0, u32 = 0, u64 = 5124953370716536832}}, {events = 32767, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 1193246272, data = {ptr = 0x471f7dd000007fff, fd = 32767, u32 = 32767, u64 = 5124953233277616127}}, {events = 32767, data = {ptr = 0x2e73990, fd = 48707984, u32 = 48707984, u64 = 48707984}}, {events = 4820873, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x76a20e1400000000, fd = 0, u32 = 0, u64 = 8548410521764757504}}, {events = 32645, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 76 times>, {events = 0, data = {ptr = 0x471f7d9000000000, fd = 0, u32 = 0, u64 = 5124952958399676416}}, {events = 32767, data = {ptr = 0x7fff471f7d80, fd = 1193246080, u32 = 1193246080, u64 = 140734386634112}}, {events = 8739141, data = {ptr = 0x471f7eb800000000, fd = 0, u32 = 0, u64 = 5124954229709996032}}, {events = 32767, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 1970723117, data = {ptr = 0x7f85, fd = 32645, u32 = 32645, u64 = 32645}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 117, data = {ptr = 0x471f78f800000000, fd = 0, u32 = 0, u64 = 5124947907518136320}}, {events = 32767, data = {ptr = 0x7fff471f78e8, fd = 1193244904, u32 = 1193244904, u64 = 140734386632936}}, {events = 0, data = {ptr = 0x7f85, fd = 32645, u32 = 32645, u64 = 32645}}, {events = 0, data = {ptr = 0x7fff471f7900, fd = 1193244928, u32 = 1193244928, u64 = 140734386632960}}, {events = 0, data = {ptr = 0x76230d803ffa4000, fd = 1073364992, u32 = 1073364992, u64 = 8512662565140709376}}, {events = 32645, data = {ptr = 0x7fff471f7e10, fd = 1193246224, u32 = 1193246224, u64 = 140734386634256}}, {events = 1193246208, data = {ptr = 0x85594500007fff, fd = 32767, u32 = 32767, u64 = 37534324790165503}}, {events = 0, data = {ptr = 0x7fff471f7f38, fd = 1193246520, u32 = 1193246520, u64 = 140734386634552}}, {events = 0, data = {ptr = 0x7576d92d00000000, fd = 0, u32 = 0, u64 = 8464191336986181632}}, {events = 32645, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x471f7d7500000000, fd = 0, u32 = 0, u64 = 5124952842435559424}}, {events = 0, data = {ptr = 0x7fff471f7978, fd = 1193245048, u32 = 1193245048, u64 = 140734386633080}}, {events = 1193245032, data = {ptr = 0x7fff, fd = 32767, u32 = 32767, u64 = 32767}}, {events = 1, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 1193245056, data = {ptr = 0x7fff, fd = 32767, u32 = 32767, u64 = 32767}}, {events = 1073381376, data = {ptr = 0xb00000000, fd = 0, u32 = 0, u64 = 47244640256}}, {events = 0, data = {ptr = 0x85592000000000, fd = 0, u32 = 0, u64 = 37534165876342784}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x471f79903ffa8000, fd = 1073381376, u32 = 1073381376, u64 = 5124948561426546688}}, {events = 32767, data = {ptr = 0x7fff00000000, fd = 0, u32 = 0, u64 = 140733193388032}}, {events = 10, data = {ptr = 0x300000000, fd = 0, u32 = 0, u64 = 12884901888}}, {events = 0, data = {ptr = 0x7fff471f7dc5, fd = 1193246149, u32 = 1193246149, u64 = 140734386634181}}, {events = 3, data = {ptr = 0x85594800000000, fd = 0, u32 = 0, u64 = 37534337675034624}}, {events = 0, data = {ptr = 0x100000000, fd = 0, u32 = 0, u64 = 4294967296}}, {events = 1193245152, data = {ptr = 0x7fff, fd = 32767, u32 = 32767, u64 = 32767}}, {events = 0, data = {ptr = 0xffffffffffffffff, fd = -1, u32 = 4294967295, u64 = 18446744073709551615}}, {events = 0, data = {ptr = 0x471f80400000000b, fd = 11, u32 = 11, u64 = 5124955913337176075}}, {events = 32767, data = {ptr = 0x855949, fd = 8739145, u32 = 8739145, u64 = 8739145}}, {events = 27, data = {ptr = 0x471f805000000000, fd = 0, u32 = 0, u64 = 5124955982056652800}}, {events = 32767, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 1983275535, data = {ptr = 0x471f7d7000007f85, fd = 32645, u32 = 32645, u64 = 5124952820960755589}}, {events = 32767, data = {ptr = 0x1b, fd = 27, u32 = 27, u64 = 27}}, {events = 192, data = {ptr = 0x1000000000, fd = 0, u32 = 0, u64 = 68719476736}}, {events = 48, data = {ptr = 0x7fff471f8010, fd = 1193246736, u32 = 1193246736, u64 = 140734386634768}}, {events = 1193246544, data = {ptr = 0x471f7a3000007fff, fd = 32767, u32 = 32767, u64 = 5124949247547965439}}, {events = 0, data = {ptr = 0x7fff471f8040, fd = 1193246784, u32 = 1193246784, u64 = 140734386634816}}, {events = 3101722081, data = {ptr = 0x471f7a1fffff8000, fd = -32768, u32 = 4294934528, u64 = 5124949178828423168}}, {events = 32767, data = {ptr = 0x2, fd = 2, u32 = 2, u64 = 2}}, {events = 9, data = {ptr = 0x32, fd = 50, u32 = 50, u64 = 50}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 91, data = {ptr = 0x6e, fd = 110, u32 = 110, u64 = 110}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 119, data = {ptr = 0x471f7d700000007c, fd = 124, u32 = 124, u64 = 5124952820960723068}}, {events = 32767, data = {ptr = 0x7fff471f8040, fd = 1193246784, u32 = 1193246784, u64 = 140734386634816}}, {events = 56, data = {ptr = 0x471f805000000000, fd = 0, u32 = 0, u64 = 5124955982056652800}}, {events = 32767, data = {ptr = 0x100, fd = 256, u32 = 256, u64 = 256}}, {events = 8761888, data = {ptr = 0x471f7a7000000000, fd = 0, u32 = 0, u64 = 5124949522425839616}}, {events = 32767, data = {ptr = 0x5ea403 <std::array<unsigned char, 400ul>::operator[](unsigned long) const+35>, fd = 6202371, u32 = 6202371, u64 = 6202371}}, {events = 256, data = {ptr = 0x7636777c00000000, fd = 0, u32 = 0, u64 = 8518127119677521920}}, {events = 32645, data = {ptr = 0x7fff471f7ab0, fd = 1193245360, u32 = 1193245360, u64 = 140734386633392}}, {events = 52867760, data = {ptr = 0x5f8b8800000000, fd = 0, u32 = 0, u64 = 26893539019325440}}, {events = 0, data = {ptr = 0x5f8bb7 <nlohmann::detail::output_string_adapter<char, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >::write_characters(char const*, unsigned long)+47>, fd = 6261687, u32 = 6261687, u64 = 6261687}}, {events = 1193245360, data = {ptr = 0x2400007fff, fd = 32767, u32 = 32767, u64 = 154618855423}}, {events = 0, data = {ptr = 0x7fff471f7dba, fd = 1193246138, u32 = 1193246138, u64 = 140734386634170}}, {events = 52867760, data = {ptr = 0x471f7bd000000000, fd = 0, u32 = 0, u64 = 5124951034254327808}}, {events = 32767, data = {ptr = 0x5e576e <nlohmann::detail::serializer<nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> >::dump_escaped(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool)+2680>, fd = 6182766, u32 = 6182766, u64 = 6182766}}, {events = 120, data = {ptr = 0xff6d020000000000, fd = 0, u32 = 0, u64 = 18405369451156340736}}, {events = 3544971520, data = {ptr = 0x34611f0, fd = 54923760, u32 = 54923760, u64 = 54923760}}, {events = 1193246048, data = {ptr = 0x471f7b5000007fff, fd = 32767, u32 = 32767, u64 = 5124950484498546687}}, {events = 32767, data = {ptr = 0x62621f0040, fd = 1646198848, u32 = 1646198848, u64 = 422552993856}}, {events = 36, data = {ptr = 0x2400000000, fd = 0, u32 = 0, u64 = 154618822656}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 36, data = {ptr = 0x471f7b5000000000, fd = 0, u32 = 0, u64 = 5124950484498513920}}, {events = 0, data = {ptr = 0x326b2b0, fd = 52867760, u32 = 52867760, u64 = 52867760}}, {events = 6261640, data = {ptr = 0x2000000000, fd = 0, u32 = 0, u64 = 137438953472}}, {events = 0, data = {ptr = 0x7fff471f7bd0, fd = 1193245648, u32 = 1193245648, u64 = 140734386633680}}, {events = 4243216, data = {ptr = 0x471f859000000000, fd = 0, u32 = 0, u64 = 5124961754492698624}}, {events = 32767, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x757a453c00000000, fd = 0, u32 = 0, u64 = 8465154573596622848}}, {events = 32645, data = {ptr = 0x326b350, fd = 52867920, u32 = 52867920, u64 = 52867920}}, {events = 1193246048, data = {ptr = 0x3e7f85000007f00, fd = 32512, u32 = 32512, u64 = 281466524215049984}}, {events = 0, data = {ptr = 0x3163190, fd = 51786128, u32 = 51786128, u64 = 51786128}}, {events = 1193245728, data = {ptr = 0x40bf1000007fff, fd = 32767, u32 = 32767, u64 = 18224473949896703}}, {events = 0, data = {ptr = 0x7fff471f8590, fd = 1193248144, u32 = 1193248144, u64 = 140734386636176}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7f85757a453c <__GI___libc_free+76>, fd = 1970947388, u32 = 1970947388, u64 = 140211178325308}}, {events = 1193248144, data = {ptr = 0xff6d020000007fff, fd = 32767, u32 = 32767, u64 = 18405369451156373503}}, {events = 3544971588, data = {ptr = 0x7fff471f7be0, fd = 1193245664, u32 = 1193245664, u64 = 140734386633696}}, {events = 6023265, data = {ptr = 0x471f7c0000000000, fd = 0, u32 = 0, u64 = 5124951240412758016}}, {events = 32767, data = {ptr = 0x3163190, fd = 51786128, u32 = 51786128, u64 = 51786128}}, {events = 1193245728, data = {ptr = 0x414cb100007fff, fd = 32767, u32 = 32767, u64 = 18380196579147775}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 6059318, data = {ptr = 0x471f7c2000000000, fd = 0, u32 = 0, u64 = 5124951377851711488}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 1193246848, data = {ptr = 0x3ceef1000007fff, fd = 32767, u32 = 32767, u64 = 274419479314726911}}, {events = 0, data = {ptr = 0x7fff471f7c50, fd = 1193245776, u32 = 1193245776, u64 = 140734386633808}}, {events = 6056161, data = {ptr = 0x316313000000000, fd = 0, u32 = 0, u64 = 222419313829609472}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 51786000, data = {ptr = 0x3ceef1000000000, fd = 0, u32 = 0, u64 = 274419479314694144}}, {events = 0, data = {ptr = 0x7fff471f7c70, fd = 1193245808, u32 = 1193245808, u64 = 140734386633840}}, {events = 6052907, data = {ptr = 0x316311000000000, fd = 0, u32 = 0, u64 = 222419176390656000}}, {events = 0, data = {ptr = 0x3163190, fd = 51786128, u32 = 51786128, u64 = 51786128}}, {events = 1193245968, data = {ptr = 0x40bf1000007fff, fd = 32767, u32 = 32767, u64 = 18224473949896703}}, {events = 0, data = {ptr = 0x7fff471f8590, fd = 1193248144, u32 = 1193248144, u64 = 140734386636176}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7f85757a453c <__GI___libc_free+76>, fd = 1970947388, u32 = 1970947388, u64 = 140211178325308}}, {events = 1193245888, data = {ptr = 0x5c528200007fff, fd = 32767, u32 = 32767, u64 = 25986416156639231}}, {events = 0, data = {ptr = 0x7fff471f7ce0, fd = 1193245920, u32 = 1193245920, u64 = 140734386633952}}, {events = 63893264, data = {ptr = 0x471f7ce000000000, fd = 0, u32 = 0, u64 = 5124952202485432320}}, {events = 32767, data = {ptr = 0x3163190, fd = 51786128, u32 = 51786128, u64 = 51786128}}, {events = 49035464, data = {ptr = 0x2e52c0000000000, fd = 0, u32 = 0, u64 = 208621336254218240}}, {events = 0, data = {ptr = 0x7fff471f7d10, fd = 1193245968, u32 = 1193245968, u64 = 140734386634000}}, {events = 7662758, data = {ptr = 0x471f7ef000000000, fd = 0, u32 = 0, u64 = 5124954470228164608}}, {events = 32767, data = {ptr = 0x7fff471f7ef0, fd = 1193246448, u32 = 1193246448, u64 = 140734386634480}}, {events = 1193246608, data = {ptr = 0x2ec384000007fff, fd = 32767, u32 = 32767, u64 = 210605130108665855}}, {events = 0, data = {ptr = 0x7fff471f7e10, fd = 1193246224, u32 = 1193246224, u64 = 140734386634256}}, {events = 7663749, data = {ptr = 0x2eb214800000000, fd = 0, u32 = 0, u64 = 210298400724221952}}, {events = 0, data = {ptr = 0x2ec3840, fd = 49035328, u32 = 49035328, u64 = 49035328}}, {events = 17433576, data = {ptr = 0x200000000, fd = 0, u32 = 0, u64 = 8589934592}}, {events = 4127455512, data = {ptr = 0x9066487800000400, fd = 1024, u32 = 1024, u64 = 10405083669319386112}}...}
        pe = 0x7fff471f52a0
        e = {events = 1, data = {ptr = 0x88, fd = 136, u32 = 136, u64 = 136}}
        real_timeout = 13
        q = 0x2ec38e0
        w = 0x2e530c8
        sigset = {__val = {0 <repeats 16 times>}}
        psigset = 0x0
        base = 7663737776
        have_signals = 0
        nevents = 0
        count = 48
        nfds = 1
        fd = 3
        op = 3
        i = 0
        __PRETTY_FUNCTION__ = "uv__io_poll"
#23 0x000000000074569d in uv_run (loop=0x2e52c00, mode=UV_RUN_DEFAULT) at ../deps/libuv/src/unix/core.c:368
        timeout = 13
        r = 1
        ran_pending = 1
#24 0x00000000005b0350 in DepLibUV::RunLoop () at ../src/DepLibUV.cpp:52
        __FUNCTION__ = "RunLoop"
#25 0x00000000005bc545 in Worker::Worker (this=0x7fff471f8400, channel=0x2e52ff0) at ../src/Worker.cpp:31
No locals.
#26 0x000000000073d44a in main (argc=10, argv=0x7fff471f8598) at ../src/main.cpp:116
        worker = {<Channel::UnixStreamSocket::Listener> = {_vptr.Listener = 0xc0df60 <vtable for Worker+16>}, <SignalsHandler::Listener> = {_vptr.Listener = 0xc0df98 <vtable for Worker+72>}, channel = 0x2e52ff0, signalsHandler = 0x2e80270, closed = false, mapRouters = std::unordered_map with 1 element = {["86348f81-ec1c-4ea7-8bad-165b4df7db06"] = 0x78be940}}
        __FUNCTION__ = "main"
        version = "3.2.5"
        channel = 0x2e52ff0
(gdb)

Here’s the second core dump:

$ gdb /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker /tmp/cores/core.mediasoup-worke.sig6.21695
GNU gdb (Ubuntu 8.2-0ubuntu1~16.04.1) 8.2
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker...done.

warning: core file may not match specified executable file.
[New LWP 21695]
[New LWP 21698]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-work'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fcb2c9b6428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
54      ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
[Current thread is 1 (Thread 0x7fcb2de8f740 (LWP 21695))]

(gdb) bt full
#0  0x00007fcb2c9b6428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pd = <optimized out>
        pid = 21695
        selftid = 21695
#1  0x00007fcb2c9b802a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3fc1178e8227e47c, sa_sigaction = 0x3fc1178e8227e47c}, sa_mask = {__val = {0,
              4604418534313441280, 0, 4346226778788972177, 0, 140721423189968, 61244160, 140721423189840, 63064064, 61244168,
              140721423189968, 61244168, 4007105022670783488, 9, 140721423190304, 140721423190304}}, sa_flags = 0,
          sa_restorer = 0x7ffc42710920}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00000000005d190f in Utils::IP::GetAddressInfo (addr=0x2fa2768, family=@0x7ffc4271083c: 2, ip="82.99.219.114",
    port=@0x7ffc4271083a: 10251) at src/Utils/IP.rl:110
        ipBuffer = "\210\bqB\000\177\000\000\210\bqB\374\177\000\000\000\000\000\000\000\000\000\000 '\372\002\000\000\000\000\020\bqB\374\177\000\000\201\234a\000\000\000"
        err = 0
        __FUNCTION__ = "GetAddressInfo"
#3  0x00000000006ad36c in RTC::TransportTuple::FillJson (this=0x2fa2730, jsonObject=...) at ../src/RTC/TransportTuple.cpp:32
        family = 2
        ip = "82.99.219.114"
        port = 10251
#4  0x00000000006b80ce in RTC::WebRtcTransport::OnIceServerSelectedTuple (this=0x39fb370, tuple=0x2fa2730)
    at ../src/RTC/WebRtcTransport.cpp:1462
        __FUNCTION__ = "OnIceServerSelectedTuple"
        data = {m_type = nlohmann::detail::value_t::object, m_value = {object = 0x2d47280, array = 0x2d47280, string = 0x2d47280,
            boolean = 128, number_integer = 47477376, number_unsigned = 47477376, number_float = 2.3456940436287698e-316}}
#5  0x0000000000619e96 in RTC::IceServer::SetSelectedTuple (this=0x3432d90, storedTuple=0x2fa2730) at ../src/RTC/IceServer.cpp:518
No locals.
#6  0x00000000006193f0 in RTC::IceServer::HandleTuple (this=0x3432d90, tuple=0x7ffc42710b40, hasUseCandidate=false)
    at ../src/RTC/IceServer.cpp:372
        storedTuple = 0x2fa2730
        __FUNCTION__ = "HandleTuple"
#7  0x0000000000618af0 in RTC::IceServer::ProcessStunPacket (this=0x3432d90, packet=0x340ceb0, tuple=0x7ffc42710b40)
    at ../src/RTC/IceServer.cpp:203
        response = 0x2f90220
        __FUNCTION__ = "ProcessStunPacket"
#8  0x00000000006b7163 in RTC::WebRtcTransport::OnStunDataReceived (this=0x39fb370, tuple=0x7ffc42710b40,
    data=0x10b3b60 <RTC::ReadBuffer> "", len=108) at ../src/RTC/WebRtcTransport.cpp:1078
        packet = 0x340ceb0
#9  0x00000000006b7074 in RTC::WebRtcTransport::OnPacketReceived (this=0x39fb370, tuple=0x7ffc42710b40,
    data=0x10b3b60 <RTC::ReadBuffer> "", len=108) at ../src/RTC/WebRtcTransport.cpp:1040
No locals.
#10 0x00000000006b7ee6 in RTC::WebRtcTransport::OnTcpConnectionPacketReceived (this=0x39fb370, connection=0x2fa2720,
    data=0x10b3b60 <RTC::ReadBuffer> "", len=108) at ../src/RTC/WebRtcTransport.cpp:1427
        tuple = {udpSocket = 0x0, udpRemoteAddr = 0x0, tcpConnection = 0x2fa2720, localAnnouncedIp = "", udpRemoteAddrStorage = {
--Type <RET> for more, q to quit, c to continue without paging--c
            ss_family = 3008, __ss_padding = "qB\374\177\000\000\240\fqB\374\177\000\000e}k\000\000\000\000\000`\fqB\374\177\000\000\020\016qB\374\177\000\000p\000\000\000\000\000\000\000\200(\303\000\000\000\000\000\300\070\346\002\000\000\000\000\020\353\325\002\000\000\000\000\300\070\346\002\000\000\000\000\020\016qB\374\177\000\000\000\000\000\000\000\000\000\000\350\vqB\374\177", '\000' <repeats 11 times>, "+C\003\000\000\000", __ss_align = 140721423191104}, protocol = RTC::TransportTuple::Protocol::TCP}
#11 0x000000000069d35a in RTC::TcpConnection::UserOnTcpConnectionRead (this=0x2fa2720) at ../src/RTC/TcpConnection.cpp:85
        packet = 0x379d253 ""
        dataLen = 110
        packetLen = 108
#12 0x00000000005d4057 in TcpConnection::OnUvRead (this=0x2fa2720, nread=110) at ../src/handles/TcpConnection.cpp:410
No locals.
#13 0x00000000005d2f0f in onRead (handle=0x3a1bcb0, nread=110, buf=0x7ffc42710d10) at ../src/handles/TcpConnection.cpp:31
        connection = 0x2fa2720
#14 0x000000000074fda6 in uv__read (stream=0x3a1bcb0) at ../deps/libuv/src/unix/stream.c:1234
        buflen = 30159
        buf = {base = 0x379d251 "", len = 30159}
        nread = 110
        msg = {msg_name = 0x7ffc42710d90, msg_namelen = 1114705344, msg_iov = 0x7ffc42710d80, msg_iovlen = 6124928, msg_control = 0x7ffc42710d80, msg_controllen = 6124847, msg_flags = 0}
        cmsg_space = "\000\000\000\000\000\000\000\000P6Y\003", '\000' <repeats 12 times>, "\300\070\346\002\000\000\000\000\260\016qB\374\177\000\000k0u\000\000\000\000\000\360\rqB\374\177\000\000P6Y\003\000\000\000\000p\342\322\002\000\000\000\000\000\000\000\000\037\000\000\000\020\016qB\374\177\000\000\377\377\377\377\377\377\377\377\200(\303\000\000\000\000\000\000\000\001\000\000\000\000\000\020\016qB\374\177\000\000\200\000\000\000\000\000\000\000\300\rqB\374\177\000\000\001", '\000' <repeats 31 times>, "\370+C\003\000\000\000\000\002\000\350v\002\261\064\254\000\000\000\000\000\000\000\000t/]\000\000\000\000\000"...
        count = 31
        err = 0
        is_ipc = 0
        __PRETTY_FUNCTION__ = "uv__read"
#15 0x0000000000750085 in uv__stream_io (loop=0x2d00c00, w=0x3a1bd38, events=25) at ../deps/libuv/src/unix/stream.c:1301
        stream = 0x3a1bcb0
        __PRETTY_FUNCTION__ = "uv__stream_io"
#16 0x000000000075536a in uv__io_poll (loop=0x2d00c00, timeout=12) at ../deps/libuv/src/unix/linux-core.c:384
        max_safe_timeout = 1789569
        events = {{events = 25, data = {ptr = 0xa5, fd = 165, u32 = 165, u64 = 165}}, {events = 1, data = {ptr = 0x17, fd = 23, u32 = 23, u64 = 23}}, {events = 1, data = {ptr = 0x1d, fd = 29, u32 = 29, u64 = 29}}, {events = 1, data = {ptr = 0x6d, fd = 109, u32 = 109, u64 = 109}}, {events = 1, data = {ptr = 0x3, fd = 3, u32 = 3, u64 = 3}}, {events = 1, data = {ptr = 0x1d, fd = 29, u32 = 29, u64 = 29}}, {events = 1, data = {ptr = 0x30, fd = 48, u32 = 48, u64 = 48}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 667 times>, {events = 47323536, data = {ptr = 0x2d2260800000000, fd = 0, u32 = 0, u64 = 203266748986687488}}, {events = 0, data = {ptr = 0x497bc5 <BN_CTX_get+85>, fd = 4815813, u32 = 4815813, u64 = 4815813}}, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x8, fd = 8, u32 = 8, u64 = 8}}, {events = 47326704, data = {ptr = 0x2d2199000000000, fd = 0, u32 = 0, u64 = 203253039451078656}}, {events = 0, data = {ptr = 0x4a7df7 <bn_sqr_fixed_top+103>, fd = 4881911, u32 = 4881911, u64 = 4881911}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 16, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 14 times>, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x2d225f0, fd = 47326704, u32 = 47326704, u64 = 47326704}}, {events = 47327704, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x4a13df <bn_from_montgomery_word+735>, fd = 4854751, u32 = 4854751, u64 = 4854751}}, {events = 4294967295, data = {ptr = 0x2d229e0ffffffff, fd = -1, u32 = 4294967295, u64 = 203270979529474047}}, {events = 0, data = {ptr = 0x2d22590, fd = 47326608, u32 = 47326608, u64 = 47326608}}, {events = 8, data = {ptr = 0x2d225f000000000, fd = 0, u32 = 0, u64 = 203266645907472384}}, {events = 0, data = {ptr = 0x2d21990, fd = 47323536, u32 = 47323536, u64 = 47323536}}, {events = 47326704, data = {ptr = 0x42713b2000000000, fd = 0, u32 = 0, u64 = 4787672887496540160}}, {events = 32764, data = {ptr = 0x2d22590, fd = 47326608, u32 = 47326608, u64 = 47326608}}, {events = 47328080, data = {ptr = 0x42713b2000000000, fd = 0, u32 = 0, u64 = 4787672887496540160}}, {events = 32764, data = {ptr = 0x4a16d4 <bn_from_mont_fixed_top+84>, fd = 4855508, u32 = 4855508, u64 = 4855508}}, {events = 47326608, data = {ptr = 0x42713b9000000000, fd = 0, u32 = 0, u64 = 4787673368532877312}}, {events = 32764, data = {ptr = 0x7ffc42713b20, fd = 1114716960, u32 = 1114716960, u64 = 140721423203104}}, {events = 47323536, data = {ptr = 0x42713b4000000000, fd = 0, u32 = 0, u64 = 4787673024935493632}}, {events = 32764, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 1114717072, data = {ptr = 0x42713b2000007ffc, fd = 32764, u32 = 32764, u64 = 4787672887496572924}}, {events = 32764, data = {ptr = 0x2d21990, fd = 47323536, u32 = 47323536, u64 = 47323536}}, {events = 4820873, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 79 times>, {events = 0, data = {ptr = 0x42713ae000000000, fd = 0, u32 = 0, u64 = 4787672612618633216}}, {events = 32764, data = {ptr = 0x7ffc42713ad0, fd = 1114716880, u32 = 1114716880, u64 = 140721423203024}}, {events = 8739141, data = {ptr = 0x42713c0800000000, fd = 0, u32 = 0, u64 = 4787673883928952832}}, {events = 32764, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 748480813, data = {ptr = 0x7fcb, fd = 32715, u32 = 32715, u64 = 32715}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 117, data = {ptr = 0x4271364800000000, fd = 0, u32 = 0, u64 = 4787667561737093120}}, {events = 32764, data = {ptr = 0x7ffc42713638, fd = 1114715704, u32 = 1114715704, u64 = 140721423201848}}, {events = 0, data = {ptr = 0x7fcb, fd = 32715, u32 = 32715, u64 = 32715}}, {events = 0, data = {ptr = 0x7ffc42713650, fd = 1114715728, u32 = 1114715728, u64 = 140721423201872}}, {events = 0, data = {ptr = 0x2d491d803ffa4000, fd = 1073364992, u32 = 1073364992, u64 = 3263171841673019392}}, {events = 32715, data = {ptr = 0x7ffc42713b60, fd = 1114717024, u32 = 1114717024, u64 = 140721423203168}}, {events = 1114717008, data = {ptr = 0x85594500007ffc, fd = 32764, u32 = 32764, u64 = 37534324790165500}}, {events = 0, data = {ptr = 0x7ffc42713c88, fd = 1114717320, u32 = 1114717320, u64 = 140721423203464}}, {events = 0, data = {ptr = 0x2c9ce92d00000000, fd = 0, u32 = 0, u64 = 3214700613518491648}}, {events = 32715, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x42713a7500000000, fd = 0, u32 = 0, u64 = 4787672153057132544}}, {events = 0, data = {ptr = 0x7ffc427136c8, fd = 1114715848, u32 = 1114715848, u64 = 140721423201992}}, {events = 1114715832, data = {ptr = 0x7ffc, fd = 32764, u32 = 32764, u64 = 32764}}, {events = 1, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 1114715856, data = {ptr = 0x7ffc, fd = 32764, u32 = 32764, u64 = 32764}}, {events = 1073397760, data = {ptr = 0xb00000000, fd = 0, u32 = 0, u64 = 47244640256}}, {events = 0, data = {ptr = 0x85592000000000, fd = 0, u32 = 0, u64 = 37534165876342784}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x427136e03ffac000, fd = 1073397760, u32 = 1073397760, u64 = 4787668215645519872}}, {events = 32764, data = {ptr = 0x7ffc00000000, fd = 0, u32 = 0, u64 = 140720308486144}}, {events = 10, data = {ptr = 0x300000000, fd = 0, u32 = 0, u64 = 12884901888}}, {events = 0, data = {ptr = 0x7ffc42713b15, fd = 1114716949, u32 = 1114716949, u64 = 140721423203093}}, {events = 3, data = {ptr = 0x85594800000000, fd = 0, u32 = 0, u64 = 37534337675034624}}, {events = 0, data = {ptr = 0x100000000, fd = 0, u32 = 0, u64 = 4294967296}}, {events = 1114715952, data = {ptr = 0x7ffc, fd = 32764, u32 = 32764, u64 = 32764}}, {events = 0, data = {ptr = 0xffffffffffffffff, fd = -1, u32 = 4294967295, u64 = 18446744073709551615}}, {events = 0, data = {ptr = 0x42713d900000000b, fd = 11, u32 = 11, u64 = 4787675567556132875}}, {events = 32764, data = {ptr = 0x855949, fd = 8739145, u32 = 8739145, u64 = 8739145}}, {events = 27, data = {ptr = 0x42713da000000000, fd = 0, u32 = 0, u64 = 4787675636275609600}}, {events = 32764, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 761033231, data = {ptr = 0x42713ac000007fcb, fd = 32715, u32 = 32715, u64 = 4787672475179712459}}, {events = 32764, data = {ptr = 0x1b, fd = 27, u32 = 27, u64 = 27}}, {events = 9, data = {ptr = 0x1000000000, fd = 0, u32 = 0, u64 = 68719476736}}, {events = 48, data = {ptr = 0x7ffc42713d60, fd = 1114717536, u32 = 1114717536, u64 = 140721423203680}}, {events = 1114717344, data = {ptr = 0x4271378000007ffc, fd = 32764, u32 = 32764, u64 = 4787668901766922236}}, {events = 0, data = {ptr = 0x7ffc42713d90, fd = 1114717584, u32 = 1114717584, u64 = 140721423203728}}, {events = 10, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 761038763, data = {ptr = 0x4271376000007fcb, fd = 32715, u32 = 32715, u64 = 4787668764327968715}}, {events = 32764, data = {ptr = 0x3a2e270, fd = 61006448, u32 = 61006448, u64 = 61006448}}, {events = 6261640, data = {ptr = 0x5f8bb700000000, fd = 0, u32 = 0, u64 = 26893740882788352}}, {events = 0, data = {ptr = 0x7ffc42713780, fd = 1114716032, u32 = 1114716032, u64 = 140721423202176}}, {events = 10, data = {ptr = 0x42713ac000000000, fd = 0, u32 = 0, u64 = 4787672475179679744}}, {events = 32764, data = {ptr = 0x7ffc42713d90, fd = 1114717584, u32 = 1114717584, u64 = 140721423203728}}, {events = 57, data = {ptr = 0x42713da000000000, fd = 0, u32 = 0, u64 = 4787675636275609600}}, {events = 32764, data = {ptr = 0x100, fd = 256, u32 = 256, u64 = 256}}, {events = 8761888, data = {ptr = 0x427137c000000000, fd = 0, u32 = 0, u64 = 4787669176644796416}}, {events = 32764, data = {ptr = 0x5ea403 <std::array<unsigned char, 400ul>::operator[](unsigned long) const+35>, fd = 6202371, u32 = 6202371, u64 = 6202371}}, {events = 256, data = {ptr = 0x2d5c877c00000000, fd = 0, u32 = 0, u64 = 3268636396209831936}}, {events = 32715, data = {ptr = 0x7ffc42713800, fd = 1114716160, u32 = 1114716160, u64 = 140721423202304}}, {events = 61006448, data = {ptr = 0x5f8b8800000000, fd = 0, u32 = 0, u64 = 26893539019325440}}, {events = 0, data = {ptr = 0x5f8bb7 <nlohmann::detail::output_string_adapter<char, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >::write_characters(char const*, unsigned long)+47>, fd = 6261687, u32 = 6261687, u64 = 6261687}}, {events = 1114716160, data = {ptr = 0x2400007ffc, fd = 32764, u32 = 32764, u64 = 154618855420}}, {events = 0, data = {ptr = 0x7ffc42713b0a, fd = 1114716938, u32 = 1114716938, u64 = 140721423203082}}, {events = 61006448, data = {ptr = 0x4271392000000000, fd = 0, u32 = 0, u64 = 4787670688473284608}}, {events = 32764, data = {ptr = 0x5e576e <nlohmann::detail::serializer<nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> >::dump_escaped(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool)+2680>, fd = 6182766, u32 = 6182766, u64 = 6182766}}, {events = 120, data = {ptr = 0x9df9c40000000000, fd = 0, u32 = 0, u64 = 11383345037434683392}}, {events = 932976640, data = {ptr = 0x2f9a670, fd = 49915504, u32 = 49915504, u64 = 49915504}}, {events = 1114716848, data = {ptr = 0x427138a000007ffc, fd = 32764, u32 = 32764, u64 = 4787670138717503484}}, {events = 32764, data = {ptr = 0x3333710090, fd = 863043728, u32 = 863043728, u64 = 219906375824}}, {events = 36, data = {ptr = 0x2400000000, fd = 0, u32 = 0, u64 = 154618822656}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 36, data = {ptr = 0x427138a000000000, fd = 0, u32 = 0, u64 = 4787670138717470720}}, {events = 0, data = {ptr = 0x3a2e270, fd = 61006448, u32 = 61006448, u64 = 61006448}}, {events = 6261640, data = {ptr = 0x2000000000, fd = 0, u32 = 0, u64 = 137438953472}}, {events = 0, data = {ptr = 0x7ffc42713920, fd = 1114716448, u32 = 1114716448, u64 = 140721423202592}}, {events = 4243216, data = {ptr = 0x427142e000000000, fd = 0, u32 = 0, u64 = 4787681408711655424}}, {events = 32764, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x2ca0553c00000000, fd = 0, u32 = 0, u64 = 3215663850128932864}}, {events = 32715, data = {ptr = 0x3b4f360, fd = 62190432, u32 = 62190432, u64 = 62190432}}, {events = 1114716848, data = {ptr = 0x34dda9000007f00, fd = 32512, u32 = 32512, u64 = 238086667330682624}}, {events = 0, data = {ptr = 0x30c93e0, fd = 51155936, u32 = 51155936, u64 = 51155936}}, {events = 1114716528, data = {ptr = 0x40bf1000007ffc, fd = 32764, u32 = 32764, u64 = 18224473949896700}}, {events = 0, data = {ptr = 0x7ffc427142e0, fd = 1114718944, u32 = 1114718944, u64 = 140721423205088}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7fcb2ca0553c <__GI___libc_free+76>, fd = 748705084, u32 = 748705084, u64 = 140510603793724}}, {events = 1114718944, data = {ptr = 0x9df9c40000007ffc, fd = 32764, u32 = 32764, u64 = 11383345037434716156}}, {events = 932976841, data = {ptr = 0x7ffc42713930, fd = 1114716464, u32 = 1114716464, u64 = 140721423202608}}, {events = 6023265, data = {ptr = 0x4271395000000000, fd = 0, u32 = 0, u64 = 4787670894631714816}}, {events = 32764, data = {ptr = 0x30c93e0, fd = 51155936, u32 = 51155936, u64 = 51155936}}, {events = 1114716528, data = {ptr = 0x414cb100007ffc, fd = 32764, u32 = 32764, u64 = 18380196579147772}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 6059318, data = {ptr = 0x4271397000000000, fd = 0, u32 = 0, u64 = 4787671032070668288}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 1114717648, data = {ptr = 0x30e6cf000007ffc, fd = 32764, u32 = 32764, u64 = 220233209835716604}}, {events = 0, data = {ptr = 0x7ffc427139a0, fd = 1114716576, u32 = 1114716576, u64 = 140721423202720}}, {events = 6056161, data = {ptr = 0x311c27000000000, fd = 0, u32 = 0, u64 = 221171643009990656}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 51495504, data = {ptr = 0x30e6cf000000000, fd = 0, u32 = 0, u64 = 220233209835683840}}, {events = 0, data = {ptr = 0x7ffc427139c0, fd = 1114716608, u32 = 1114716608, u64 = 140721423202752}}, {events = 6052907, data = {ptr = 0x311c25000000000, fd = 0, u32 = 0, u64 = 221171505571037184}}, {events = 0, data = {ptr = 0x30c93e0, fd = 51155936, u32 = 51155936, u64 = 51155936}}, {events = 1114716768, data = {ptr = 0x40bf1000007ffc, fd = 32764, u32 = 32764, u64 = 18224473949896700}}, {events = 0, data = {ptr = 0x7ffc427142e0, fd = 1114718944, u32 = 1114718944, u64 = 140721423205088}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7fcb2ca0553c <__GI___libc_free+76>, fd = 748705084, u32 = 748705084, u64 = 140510603793724}}, {events = 1114716688, data = {ptr = 0x5c528200007ffc, fd = 32764, u32 = 32764, u64 = 25986416156639228}}, {events = 0, data = {ptr = 0x7ffc42713a30, fd = 1114716720, u32 = 1114716720, u64 = 140721423202864}}, {events = 51277040, data = {ptr = 0x42713a3000000000, fd = 0, u32 = 0, u64 = 4787671856704389120}}, {events = 32764, data = {ptr = 0x30c93e0, fd = 51155936, u32 = 51155936, u64 = 51155936}}, {events = 60931384, data = {ptr = 0x2d00c0000000000, fd = 0, u32 = 0, u64 = 202675177371205632}}, {events = 0, data = {ptr = 0x7ffc42713a60, fd = 1114716768, u32 = 1114716768, u64 = 140721423202912}}, {events = 7662758, data = {ptr = 0x42713c4000000000, fd = 0, u32 = 0, u64 = 4787674124447121408}}, {events = 32764, data = {ptr = 0x7ffc42713c40, fd = 1114717248, u32 = 1114717248, u64 = 140721423203392}}, {events = 1114717408, data = {ptr = 0x3a1bcb000007ffc, fd = 32764, u32 = 32764, u64 = 261697717464498172}}, {events = 0, data = {ptr = 0x7ffc42713b60, fd = 1114717024, u32 = 1114717024, u64 = 140721423203168}}, {events = 7663749, data = {ptr = 0x3bf9eb800000000, fd = 0, u32 = 0, u64 = 270109015776690176}}, {events = 0, data = {ptr = 0x3a1bcb0, fd = 60931248, u32 = 60931248, u64 = 60931248}}, {events = 17433576, data = {ptr = 0x200000000, fd = 0, u32 = 0, u64 = 8589934592}}, {events = 3504458642, data = {ptr = 0x80137b9300000400, fd = 1024, u32 = 1024, u64 = 9228855932702688256}}, {events = 92, data = {ptr = 0x42713c9800000000, fd = 0, u32 = 0, u64 = 4787674502404243456}}, {events = 32764, data = {ptr = 0x7ffc42713c40, fd = 1114717248, u32 = 1114717248, u64 = 140721423203392}}, {events = 1114717376, data = {ptr = 0x3a2de4000007ffc, fd = 32764, u32 = 32764, u64 = 262016094800216060}}, {events = 0, data = {ptr = 0x3a2dd60, fd = 61005152, u32 = 61005152, u64 = 61005152}}, {events = 61005424, data = {ptr = 0x42713af000000000, fd = 0, u32 = 0, u64 = 4787672681338109952}}, {events = 6, data = {ptr = 0x10a0428 <RTC::EncryptBuffer+72>, fd = 17433640, u32 = 17433640, u64 = 17433640}}, {events = 4580016, data = {ptr = 0x3a2de7000000000, fd = 0, u32 = 0, u64 = 262016300958613504}}, {events = 0, data = {ptr = 0x10a0428 <RTC::EncryptBuffer+72>, fd = 17433640, u32 = 17433640, u64 = 17433640}}, {events = 62890528, data = {ptr = 0x3bfa18000000000, fd = 0, u32 = 0, u64 = 270112073793404928}}, {events = 0, data = {ptr = 0x3bf9eb8, fd = 62889656, u32 = 62889656, u64 = 62889656}}, {events = 0, data = {ptr = 0x3bf9ea800000004, fd = 4, u32 = 4, u64 = 270108947057213444}}, {events = 0, data = {ptr = 0x3bf9eb8, fd = 62889656, u32 = 62889656, u64 = 62889656}}, {events = 17433608, data = {ptr = 0x10a040800000000, fd = 0, u32 = 0, u64 = 74876776211283968}}, {events = 0, data = {ptr = 0xc41cc690a1ca4e1b, fd = -1580577253, u32 = 2714390043, u64 = 14131388055273754139}}, {events = 3537975587, data = {ptr = 0xbe09e7984afce028, fd = 1258086440, u32 = 1258086440, u64 = 13693730783275835432}}, {events = 1923332656, data = {ptr = 0xf3f288a757f5f158, fd = 1475735896, u32 = 1475735896, u64 = 17578262547897119064}}, {events = 62890956, data = {ptr = 0x8fe0c35200000000, fd = 0, u32 = 0, u64 = 10367501099161616384}}, {events = 2054372287, data = {ptr = 0x1c31ce3f5d5f3057, fd = 1566519383, u32 = 1566519383, u64 = 2031631678465585239}}, {events = 1792102450, data = {ptr = 0x93ed58a4c64cca1f, fd = -968046049, u32 = 3326921247, u64 = 10659273357780634143}}, {events = 2110474092, data = {ptr = 0x20b8b3551fae1039, fd = 531501113, u32 = 531501113, u64 = 2357831583113547833}}...}
        pe = 0x7ffc42710ff0
        e = {events = 1, data = {ptr = 0x8d, fd = 141, u32 = 141, u64 = 141}}
        real_timeout = 12
        q = 0x311aaa0
        w = 0x3a1bd38
        sigset = {__val = {0 <repeats 16 times>}}
        psigset = 0x0
        base = 7664149866
        have_signals = 0
        nevents = 0
        count = 48
        nfds = 1
        fd = 165
        op = 3
        i = 0
        __PRETTY_FUNCTION__ = "uv__io_poll"
#17 0x000000000074569d in uv_run (loop=0x2d00c00, mode=UV_RUN_DEFAULT) at ../deps/libuv/src/unix/core.c:368
        timeout = 12
        r = 1
        ran_pending = 1
#18 0x00000000005b0350 in DepLibUV::RunLoop () at ../src/DepLibUV.cpp:52
        __FUNCTION__ = "RunLoop"
#19 0x00000000005bc545 in Worker::Worker (this=0x7ffc42714150, channel=0x2d00ff0) at ../src/Worker.cpp:31
No locals.
#20 0x000000000073d44a in main (argc=10, argv=0x7ffc427142e8) at ../src/main.cpp:116
        worker = {<Channel::UnixStreamSocket::Listener> = {_vptr.Listener = 0xc0df60 <vtable for Worker+16>}, <SignalsHandler::Listener> = {_vptr.Listener = 0xc0df98 <vtable for Worker+72>}, channel = 0x2d00ff0, signalsHandler = 0x2d2e270, closed = false, mapRouters = std::unordered_map with 2 elements = {["9e6f7c16-30ba-4c9a-ab18-4786cd0ca480"] = 0x34bbf60, ["7ec9af60-1b3a-4e09-b9b3-79259e1916c3"] = 0x2d78d60}}
        __FUNCTION__ = "main"
        version = "3.2.5"
        channel = 0x2d00ff0
(gdb)

@mkh, are you sure you are using the proper libuv vesion? Does this happen in a brand new mediasoup installation?

How can I check that?

No, it’s been updated and built several times. What’s the difference?

The first core dump points to SSL_free(this->ssl); in DtlsTransport destructor, which worries me much.

The second one points to Utils::IP::GetAddressInfo():

#1  0x00007fcb2c9b802a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3fc1178e8227e47c, sa_sigaction = 0x3fc1178e8227e47c}, sa_mask = {__val = {0,
              4604418534313441280, 0, 4346226778788972177, 0, 140721423189968, 61244160, 140721423189840, 63064064, 61244168,
              140721423189968, 61244168, 4007105022670783488, 9, 140721423190304, 140721423190304}}, sa_flags = 0,
          sa_restorer = 0x7ffc42710920}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00000000005d190f in Utils::IP::GetAddressInfo (addr=0x2fa2768, family=@0x7ffc4271083c: 2, ip="82.99.219.114",
    port=@0x7ffc4271083a: 10251) at src/Utils/IP.rl:110
        ipBuffer = "\210\bqB\000\177\000\000\210\bqB\374\177\000\000\000\000\000\000\000\000\000\000 '\372\002\000\000\000\000\020\bqB\374\177\000\000\201\234a\000\000\000"
        err = 0
        __FUNCTION__ = "GetAddressInfo"
#3  0x00000000006ad36c in RTC::TransportTuple::FillJson (this=0x2fa2730, jsonObject=...) at ../src/RTC/TransportTuple.cpp:32
        family = 2
        ip = "82.99.219.114"
        port = 10251
#4  0x00000000006b80ce in RTC::WebRtcTransport::OnIceServerSelectedTuple (this=0x39fb370, tuple=0x2fa2730)
    at ../src/RTC/WebRtcTransport.cpp:1462
        __FUNCTION__ = "OnIceServerSelectedTuple"
        data = {m_type = nlohmann::detail::value_t::object, m_value = {object = 0x2d47280, array = 0x2d47280, string = 0x2d47280,
            boolean = 128, number_integer = 47477376, number_unsigned = 47477376, number_float = 2.3456940436287698e-316}}
#5  0x0000000000619e96 in RTC::IceServer::SetSelectedTuple (this=0x3432d90, storedTuple=0x2fa2730) at ../src/RTC/IceServer.cpp:518
No locals.
#6  0x00000000006193f0 in RTC::IceServer::HandleTuple (this=0x3432d90, tuple=0x7ffc42710b40, hasUseCandidate=false)
    at ../src/RTC/IceServer.cpp:372
        storedTuple = 0x2fa2730
        __FUNCTION__ = "HandleTuple"

In fact, the second one crashes here in src/Utils/IP.rl:

MS_ABORT("unknown network family: %d", static_cast<int>(addr->sa_family));

And here’s the third one that happened a few hours ago:

$ gdb /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker /tmp/cores/core.mediasoup-worke.sig6.21715
GNU gdb (Ubuntu 8.2-0ubuntu1~16.04.1) 8.2
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker...done.

warning: core file may not match specified executable file.
[New LWP 21715]
[New LWP 21720]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-work'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6324dd4428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
54      ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
[Current thread is 1 (Thread 0x7f63262ad740 (LWP 21715))]
(gdb) bt full
#0  0x00007f6324dd4428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pd = <optimized out>
        pid = 21715
        selftid = 21715
#1  0x00007f6324dd602a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {9770211683681599426, 1740610284492676589,
              140730062674624, 50549082493, 140063818883072, 9101392, 1400, 9101976, 0, 0, 140063797294396, 140063798391376,
              140063798405024, 9223372036854775808, 140063798391376, 9101392}}, sa_flags = 640393216, sa_restorer = 0x8ae050}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f6324dccbd7 in __assert_fail_base (fmt=<optimized out>,
    assertion=assertion@entry=0x8ae050 "(stream->type == UV_TCP || stream->type == UV_NAMED_PIPE || stream->type == UV_TTY) && \"uv_write (unix) does not yet support other types of streams\"", file=file@entry=0x8adca0 "../deps/libuv/src/unix/stream.c", line=line@entry=1400,
    function=function@entry=0x8ae298 <__PRETTY_FUNCTION__.9016> "uv_write2") at assert.c:92
        str = 0x66fd020 "P\321o\006"
        total = 4096
#3  0x00007f6324dccc82 in __GI___assert_fail (
    assertion=0x8ae050 "(stream->type == UV_TCP || stream->type == UV_NAMED_PIPE || stream->type == UV_TTY) && \"uv_write (unix) does not yet support other types of streams\"", file=0x8adca0 "../deps/libuv/src/unix/stream.c", line=1400,
    function=0x8ae298 <__PRETTY_FUNCTION__.9016> "uv_write2") at assert.c:101
No locals.
#4  0x0000000000750416 in uv_write2 (req=0x7ffe45651ce0, stream=0x66fcbe0, bufs=0x7ffe45651e20, nbufs=2, send_handle=0x0,
    cb=0x7506da <uv_try_write_cb>) at ../deps/libuv/src/unix/stream.c:1397
        empty_queue = 0
        __PRETTY_FUNCTION__ = "uv_write2"
#5  0x00000000007506d8 in uv_write (req=0x7ffe45651ce0, handle=0x66fcbe0, bufs=0x7ffe45651e20, nbufs=2, cb=0x7506da <uv_try_write_cb>)
    at ../deps/libuv/src/unix/stream.c:1492
No locals.
#6  0x0000000000750790 in uv_try_write (stream=0x66fcbe0, bufs=0x7ffe45651e20, nbufs=2) at ../deps/libuv/src/unix/stream.c:1517
        r = -627946092
        has_pollout = 0
        written = 1287401128648419853
        req_size = 3566393180782151824
        req = {data = 0xca084f8ce600d62d, type = 30704928, reserved = {0x0, 0x29, 0x1d48520, 0xccbf85acd39a2700, 0x9fc2c0d3, 0x9fc2c0d3},
          cb = 0x7ffe45651d90, send_handle = 0x36a7f0, handle = 0x3d9, queue = {0x76d2d9 <srtp_hmac_compute+127>,
            0x10a07c9 <RTC::EncryptBuffer+1001>}, write_index = 10, bufs = 0x7ffe45651e20, nbufs = 67871152, error = 0, bufsml = {{
              base = 0xa00000014 <error: Cannot access memory at address 0xa00000014>, len = 67871152}, {
              base = 0xab348eec67427353 <error: Cannot access memory at address 0xab348eec67427353>, len = 10928203473184844109}, {
              base = 0x8c0c9005 <error: Cannot access memory at address 0x8c0c9005>, len = 14753657881619998464}, {
              base = 0x3f345651e50 <error: Cannot access memory at address 0x3f345651e50>, len = 17433568}}}
        __PRETTY_FUNCTION__ = "uv_try_write"
#7  0x00000000005d3b89 in TcpConnection::Write (this=0x66fcaa0, data1=0x7ffe45651e86 <incomplete sequence \363>, len1=2,
    data2=0x10a03e0 <RTC::EncryptBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len2=1011)
    at ../src/handles/TcpConnection.cpp:271
        totalLen = 1013
--Type <RET> for more, q to quit, c to continue without paging--c
        buffers = {{base = 0x7ffe45651e86 <incomplete sequence \363>, len = 2}, {base = 0x10a03e0 <RTC::EncryptBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len = 1011}}
        written = 17434569
        err = 0
        pendingLen = 17433580
        writeData = 0x10a03e0 <RTC::EncryptBuffer>
        buffer = {base = 0x750ea80 "0\315\002\006", len = 17434569}
        __FUNCTION__ = "Write"
#8  0x000000000069d50b in RTC::TcpConnection::Send (this=0x66fcaa0, data=0x10a03e0 <RTC::EncryptBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len=1011) at ../src/RTC/TcpConnection.cpp:169
        frameLen = <incomplete sequence \363>
#9  0x000000000062deac in RTC::TransportTuple::Send (this=0x5fbc830, data=0x10a03e0 <RTC::EncryptBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len=1011) at ../include/RTC/TransportTuple.hpp:113
No locals.
#10 0x00000000006b3a51 in RTC::WebRtcTransport::SendRtpPacket (this=0x606d330, packet=0x6704e60, consumer=0x38be350, retransmitted=false, probation=false) at ../src/RTC/WebRtcTransport.cpp:828
        seq = 574
        data = 0x10a03e0 <RTC::EncryptBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>
        len = 1011
#11 0x00000000006a5e9b in RTC::Transport::OnConsumerSendRtpPacket (this=0x606d330, consumer=0x38be350, packet=0x6704e60) at ../src/RTC/Transport.cpp:1392
No locals.
#12 0x000000000068b0f2 in RTC::SimpleConsumer::SendRtpPacket (this=0x38be350, packet=0x6704e60) at ../src/RTC/SimpleConsumer.cpp:205
        payloadType = 101 'e'
        isSyncPacket = false
        __FUNCTION__ = "SendRtpPacket"
        seq = 574
        origSsrc = 645288018
        origSeq = 2370
#13 0x0000000000650a17 in RTC::Router::OnTransportProducerRtpPacketReceived (this=0x1d64ac0, producer=0x74e9c30, packet=0x6704e60) at ../src/RTC/Router.cpp:636
        consumer = 0x38be350
        __for_range = std::unordered_set with 31 elements = {[0] = 0x4f03f50, [1] = 0x5fccad0, [2] = 0x7397050, [3] = 0x5d53210, [4] = 0x5daa830, [5] = 0x5d31000, [6] = 0x38a85a0, [7] = 0x29d4d80, [8] = 0x2bc2a00, [9] = 0x5e1ab60, [10] = 0x7f932f0, [11] = 0x1cbd360, [12] = 0x2ba0df0, [13] = 0x5ffac60, [14] = 0x3c2c140, [15] = 0x2950d90, [16] = 0x2655d50, [17] = 0x5d6d550, [18] = 0x749ef70, [19] = 0x2610d70, [20] = 0x499caf0, [21] = 0x5fad570, [22] = 0x6a2d1e0, [23] = 0x6025310, [24] = 0x66e3670, [25] = 0x38be350, [26] = 0x60335a0, [27] = 0x29cb530, [28] = 0x7f52510, [29] = 0x6069fa0, [30] = 0x7dac080}
        __for_begin = {<std::__detail::_Node_iterator_base<RTC::Consumer*, false>> = {_M_cur = 0x2928090}, <No data fields>}
        __for_end = {<std::__detail::_Node_iterator_base<RTC::Consumer*, false>> = {_M_cur = 0x0}, <No data fields>}
        consumers = std::unordered_set with 31 elements = {[0] = 0x4f03f50, [1] = 0x5fccad0, [2] = 0x7397050, [3] = 0x5d53210, [4] = 0x5daa830, [5] = 0x5d31000, [6] = 0x38a85a0, [7] = 0x29d4d80, [8] = 0x2bc2a00, [9] = 0x5e1ab60, [10] = 0x7f932f0, [11] = 0x1cbd360, [12] = 0x2ba0df0, [13] = 0x5ffac60, [14] = 0x3c2c140, [15] = 0x2950d90, [16] = 0x2655d50, [17] = 0x5d6d550, [18] = 0x749ef70, [19] = 0x2610d70, [20] = 0x499caf0, [21] = 0x5fad570, [22] = 0x6a2d1e0, [23] = 0x6025310, [24] = 0x66e3670, [25] = 0x38be350, [26] = 0x60335a0, [27] = 0x29cb530, [28] = 0x7f52510, [29] = 0x6069fa0, [30] = 0x7dac080}
        it = {<std::__detail::_Node_iterator_base<std::pair<RTC::Producer* const, std::unordered_set<RTC::RtpObserver*, std::hash<RTC::RtpObserver*>, std::equal_to<RTC::RtpObserver*>, std::allocator<RTC::RtpObserver*> > >, false>> = {_M_cur = 0x7ffe45652060}, <No data fields>}
#14 0x00000000006a5dd6 in RTC::Transport::OnProducerRtpPacketReceived (this=0x32e0cc0, producer=0x74e9c30, packet=0x6704e60) at ../src/RTC/Transport.cpp:1369
No locals.
#15 0x000000000063db16 in RTC::Producer::ReceiveRtpPacket (this=0x74e9c30, packet=0x6704e60) at ../src/RTC/Producer.cpp:546
        numRtpStreamsBefore = 1
        rtpStream = 0x3c09740
        __FUNCTION__ = "ReceiveRtpPacket"
#16 0x00000000006b7952 in RTC::WebRtcTransport::OnRtpDataReceived (this=0x32e0cc0, tuple=0x7ffe456521b0, data=0xc32880 <ReadBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len=1005) at ../src/RTC/WebRtcTransport.cpp:1222
        __FUNCTION__ = "OnRtpDataReceived"
        packet = 0x6704e60
        producer = 0x74e9c30
#17 0x00000000006b70d9 in RTC::WebRtcTransport::OnPacketReceived (this=0x32e0cc0, tuple=0x7ffe456521b0, data=0xc32880 <ReadBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len=1015) at ../src/RTC/WebRtcTransport.cpp:1050
No locals.
#18 0x00000000006b7d56 in RTC::WebRtcTransport::OnUdpSocketPacketReceived (this=0x32e0cc0, socket=0x32e5040, data=0xc32880 <ReadBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len=1015, remoteAddr=0x7ffe45652400) at ../src/RTC/WebRtcTransport.cpp:1407
        tuple = {udpSocket = 0x32e5040, udpRemoteAddr = 0x7ffe45652400, tcpConnection = 0x0, localAnnouncedIp = "", udpRemoteAddrStorage = {ss_family = 2, __ss_padding = "\000\000\000\000\000\000\320XeE\376\177\000\000\000'\232Ӭ\205\277\314\000\000\000\000\000\000\000\000p\022\311\001\000\000\000\000P\"eE\376\177\000\000Z\323i\000\000\000\000\000\200\021\212\002\000\000\000\000\260\332\311\001\000\000\000\000`\"eE\376\177\000\000J\000\000\000\000\000\000\000L\000\000\000\000\000\000\000\222\204c\002\000\000\000\000\200\"eE\376\177\000\000W@]\000\000\000\000", __ss_align = 140730062676640}, protocol = RTC::TransportTuple::Protocol::UDP}
#19 0x00000000006ad777 in RTC::UdpSocket::UserOnUdpDatagramReceived (this=0x32e5040, data=0xc32880 <ReadBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len=1015, addr=0x7ffe45652400) at ../src/RTC/UdpSocket.cpp:39
        __FUNCTION__ = "UserOnUdpDatagramReceived"
#20 0x00000000005d8226 in UdpSocket::OnUvRecv (this=0x32e5040, nread=1015, buf=0x7ffe456523b0, addr=0x7ffe45652400, flags=0) at ../src/handles/UdpSocket.cpp:313
        __FUNCTION__ = "OnUvRecv"
#21 0x00000000005d7580 in onRecv (handle=0x32e5120, nread=1015, buf=0x7ffe456523b0, addr=0x7ffe45652400, flags=0) at ../src/handles/UdpSocket.cpp:35
        socket = 0x32e5040
#22 0x000000000075311a in uv__udp_recvmsg (handle=0x32e5120) at ../deps/libuv/src/unix/udp.c:206
        addr = 0x7ffe45652400
        peer = {ss_family = 2, __ss_padding = "Ѡ[\272\326\032\000\000\000\000\000\000\000\000t/]\000\000\000\000\000P$eE\376\177\000\000*\214pE\376\177\000\000\240$eE\376\177\000\000\260\256\325\002\001\000\000\000\001\000\000\000\000\000\000\000\020\277@\000\000\000\000\000\320XeE\376\177\000\000\240$eE\376\177\000\000vH\353$c\177\000\000`$eE\000\000\000\000p\022\311\001\000\000\000\000\300$eE\376\177\000", __ss_align = 7689632}
        h = {msg_name = 0x7ffe45652400, msg_namelen = 16, msg_iov = 0x7ffe456523b0, msg_iovlen = 1, msg_control = 0x0, msg_controllen = 0, msg_flags = 0}
        nread = 1015
        buf = {base = 0xc32880 <ReadBuffer> "\220e\002>\003 k<\027\207\210\376\276", <incomplete sequence \336>, len = 65536}
        flags = 0
        count = 30
        __PRETTY_FUNCTION__ = "uv__udp_recvmsg"
#23 0x0000000000752e30 in uv__udp_io (loop=0x1c63c00, w=0x32e51a0, revents=1) at ../deps/libuv/src/unix/udp.c:143
        handle = 0x32e5120
        __PRETTY_FUNCTION__ = "uv__udp_io"
#24 0x000000000075536a in uv__io_poll (loop=0x1c63c00, timeout=8) at ../deps/libuv/src/unix/linux-core.c:384
        max_safe_timeout = 1789569
        events = {{events = 1, data = {ptr = 0x31, fd = 49, u32 = 49, u64 = 49}}, {events = 1, data = {ptr = 0xf, fd = 15, u32 = 15, u64 = 15}}, {events = 1, data = {ptr = 0x4a, fd = 74, u32 = 74, u64 = 74}}, {events = 1, data = {ptr = 0x41, fd = 65, u32 = 65, u64 = 65}}, {events = 1, data = {ptr = 0x23, fd = 35, u32 = 35, u64 = 35}}, {events = 1, data = {ptr = 0x28, fd = 40, u32 = 40, u64 = 40}}, {events = 1, data = {ptr = 0x25, fd = 37, u32 = 37, u64 = 37}}, {events = 1, data = {ptr = 0x2b, fd = 43, u32 = 43, u64 = 43}}, {events = 1, data = {ptr = 0x1d, fd = 29, u32 = 29, u64 = 29}}, {events = 1, data = {ptr = 0x46, fd = 70, u32 = 70, u64 = 70}}, {events = 1, data = {ptr = 0x37, fd = 55, u32 = 55, u64 = 55}}, {events = 1, data = {ptr = 0x2e, fd = 46, u32 = 46, u64 = 46}}, {events = 1, data = {ptr = 0x51, fd = 81, u32 = 81, u64 = 81}}, {events = 1, data = {ptr = 0x4a, fd = 74, u32 = 74, u64 = 74}}, {events = 1, data = {ptr = 0x3e, fd = 62, u32 = 62, u64 = 62}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 659 times>, {events = 29903248, data = {ptr = 0x1c8560800000000, fd = 0, u32 = 0, u64 = 128447181739786240}}, {events = 0, data = {ptr = 0x497bc5 <BN_CTX_get+85>, fd = 4815813, u32 = 4815813, u64 = 4815813}}, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x8, fd = 8, u32 = 8, u64 = 8}}, {events = 29906416, data = {ptr = 0x1c8499000000000, fd = 0, u32 = 0, u64 = 128433472204177408}}, {events = 0, data = {ptr = 0x4a7df7 <bn_sqr_fixed_top+103>, fd = 4881911, u32 = 4881911, u64 = 4881911}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 16, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 14 times>, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x1c855f0, fd = 29906416, u32 = 29906416, u64 = 29906416}}, {events = 29907416, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x4a13df <bn_from_montgomery_word+735>, fd = 4854751, u32 = 4854751, u64 = 4854751}}, {events = 4294967295, data = {ptr = 0x1c859e0ffffffff, fd = -1, u32 = 4294967295, u64 = 128451412282572799}}, {events = 0, data = {ptr = 0x1c85590, fd = 29906320, u32 = 29906320, u64 = 29906320}}, {events = 8, data = {ptr = 0x1c855f000000000, fd = 0, u32 = 0, u64 = 128447078660571136}}, {events = 0, data = {ptr = 0x1c84990, fd = 29903248, u32 = 29903248, u64 = 29903248}}, {events = 29906416, data = {ptr = 0x4565511000000000, fd = 0, u32 = 0, u64 = 5000492090426130432}}, {events = 32766, data = {ptr = 0x1c85590, fd = 29906320, u32 = 29906320, u64 = 29906320}}, {events = 29907792, data = {ptr = 0x4565511000000000, fd = 0, u32 = 0, u64 = 5000492090426130432}}, {events = 32766, data = {ptr = 0x4a16d4 <bn_from_mont_fixed_top+84>, fd = 4855508, u32 = 4855508, u64 = 4855508}}, {events = 29906320, data = {ptr = 0x4565518000000000, fd = 0, u32 = 0, u64 = 5000492571462467584}}, {events = 32766, data = {ptr = 0x7ffe45655110, fd = 1164267792, u32 = 1164267792, u64 = 140730062688528}}, {events = 29903248, data = {ptr = 0x4565513000000000, fd = 0, u32 = 0, u64 = 5000492227865083904}}, {events = 32766, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 1164267904, data = {ptr = 0x4565511000007ffe, fd = 32766, u32 = 32766, u64 = 5000492090426163198}}, {events = 32766, data = {ptr = 0x1c84990, fd = 29903248, u32 = 29903248, u64 = 29903248}}, {events = 4820873, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x2609fe1400000000, fd = 0, u32 = 0, u64 = 2741001210084458496}}, {events = 32611, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 76 times>, {events = 0, data = {ptr = 0x456550d000000000, fd = 0, u32 = 0, u64 = 5000491815548223488}}, {events = 32766, data = {ptr = 0x7ffe456550c0, fd = 1164267712, u32 = 1164267712, u64 = 140730062688448}}, {events = 8739141, data = {ptr = 0x456551f800000000, fd = 0, u32 = 0, u64 = 5000493086858543104}}, {events = 32766, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 618580269, data = {ptr = 0x7f63, fd = 32611, u32 = 32611, u64 = 32611}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 117, data = {ptr = 0x45654c3800000000, fd = 0, u32 = 0, u64 = 5000486764666683392}}, {events = 32766, data = {ptr = 0x7ffe45654c28, fd = 1164266536, u32 = 1164266536, u64 = 140730062687272}}, {events = 0, data = {ptr = 0x7f63, fd = 32611, u32 = 32611, u64 = 32611}}, {events = 0, data = {ptr = 0x7ffe45654c40, fd = 1164266560, u32 = 1164266560, u64 = 140730062687296}}, {events = 0, data = {ptr = 0x258afd803ffa4000, fd = 1073364992, u32 = 1073364992, u64 = 2705253253460410368}}, {events = 32611, data = {ptr = 0x7ffe45655150, fd = 1164267856, u32 = 1164267856, u64 = 140730062688592}}, {events = 1164267840, data = {ptr = 0x85594500007ffe, fd = 32766, u32 = 32766, u64 = 37534324790165502}}, {events = 0, data = {ptr = 0x7ffe45655278, fd = 1164268152, u32 = 1164268152, u64 = 140730062688888}}, {events = 0, data = {ptr = 0x24dec92d00000000, fd = 0, u32 = 0, u64 = 2656782025305882624}}, {events = 32611, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x4565507500000000, fd = 0, u32 = 0, u64 = 5000491424706199552}}, {events = 0, data = {ptr = 0x7ffe45654cb8, fd = 1164266680, u32 = 1164266680, u64 = 140730062687416}}, {events = 1164266664, data = {ptr = 0x7ffe, fd = 32766, u32 = 32766, u64 = 32766}}, {events = 1, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 1164266688, data = {ptr = 0x7ffe, fd = 32766, u32 = 32766, u64 = 32766}}, {events = 1073397760, data = {ptr = 0xb00000000, fd = 0, u32 = 0, u64 = 47244640256}}, {events = 0, data = {ptr = 0x85592000000000, fd = 0, u32 = 0, u64 = 37534165876342784}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x45654cd03ffac000, fd = 1073397760, u32 = 1073397760, u64 = 5000487418575110144}}, {events = 32766, data = {ptr = 0x7ffe00000000, fd = 0, u32 = 0, u64 = 140728898420736}}, {events = 10, data = {ptr = 0x300000000, fd = 0, u32 = 0, u64 = 12884901888}}, {events = 0, data = {ptr = 0x7ffe45655105, fd = 1164267781, u32 = 1164267781, u64 = 140730062688517}}, {events = 3, data = {ptr = 0x85594800000000, fd = 0, u32 = 0, u64 = 37534337675034624}}, {events = 0, data = {ptr = 0x100000000, fd = 0, u32 = 0, u64 = 4294967296}}, {events = 1164266784, data = {ptr = 0x7ffe, fd = 32766, u32 = 32766, u64 = 32766}}, {events = 0, data = {ptr = 0xffffffffffffffff, fd = -1, u32 = 4294967295, u64 = 18446744073709551615}}, {events = 0, data = {ptr = 0x456553800000000b, fd = 11, u32 = 11, u64 = 5000494770485723147}}, {events = 32766, data = {ptr = 0x855949, fd = 8739145, u32 = 8739145, u64 = 8739145}}, {events = 27, data = {ptr = 0x4565539000000000, fd = 0, u32 = 0, u64 = 5000494839205199872}}, {events = 32766, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 631132687, data = {ptr = 0x456550b000007f63, fd = 32611, u32 = 32611, u64 = 5000491678109302627}}, {events = 32766, data = {ptr = 0x1b, fd = 27, u32 = 27, u64 = 27}}, {events = 9, data = {ptr = 0x1000000000, fd = 0, u32 = 0, u64 = 68719476736}}, {events = 48, data = {ptr = 0x7ffe45655350, fd = 1164268368, u32 = 1164268368, u64 = 140730062689104}}, {events = 1164268176, data = {ptr = 0x45654d7000007ffe, fd = 32766, u32 = 32766, u64 = 5000488104696512510}}, {events = 0, data = {ptr = 0x7ffe45655380, fd = 1164268416, u32 = 1164268416, u64 = 140730062689152}}, {events = 10, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 631138219, data = {ptr = 0x45654d5000007f63, fd = 32611, u32 = 32611, u64 = 5000487967257558883}}, {events = 32766, data = {ptr = 0x498d7b0, fd = 77125552, u32 = 77125552, u64 = 77125552}}, {events = 6261640, data = {ptr = 0x5f8bb700000000, fd = 0, u32 = 0, u64 = 26893740882788352}}, {events = 0, data = {ptr = 0x7ffe45654d70, fd = 1164266864, u32 = 1164266864, u64 = 140730062687600}}, {events = 10, data = {ptr = 0x456550b000000000, fd = 0, u32 = 0, u64 = 5000491678109270016}}, {events = 32766, data = {ptr = 0x7ffe45655380, fd = 1164268416, u32 = 1164268416, u64 = 140730062689152}}, {events = 57, data = {ptr = 0x4565539000000000, fd = 0, u32 = 0, u64 = 5000494839205199872}}, {events = 32766, data = {ptr = 0x100, fd = 256, u32 = 256, u64 = 256}}, {events = 8761888, data = {ptr = 0x45654db000000000, fd = 0, u32 = 0, u64 = 5000488379574386688}}, {events = 32766, data = {ptr = 0x5ea403 <std::array<unsigned char, 400ul>::operator[](unsigned long) const+35>, fd = 6202371, u32 = 6202371, u64 = 6202371}}, {events = 256, data = {ptr = 0x259e677c00000000, fd = 0, u32 = 0, u64 = 2710717807997222912}}, {events = 32611, data = {ptr = 0x7ffe45654df0, fd = 1164266992, u32 = 1164266992, u64 = 140730062687728}}, {events = 77125552, data = {ptr = 0x5f8b8800000000, fd = 0, u32 = 0, u64 = 26893539019325440}}, {events = 0, data = {ptr = 0x5f8bb7 <nlohmann::detail::output_string_adapter<char, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >::write_characters(char const*, unsigned long)+47>, fd = 6261687, u32 = 6261687, u64 = 6261687}}, {events = 1164266992, data = {ptr = 0x2400007ffe, fd = 32766, u32 = 32766, u64 = 154618855422}}, {events = 0, data = {ptr = 0x7ffe456550fa, fd = 1164267770, u32 = 1164267770, u64 = 140730062688506}}, {events = 77125552, data = {ptr = 0x45654f1000000000, fd = 0, u32 = 0, u64 = 5000489891402874880}}, {events = 32766, data = {ptr = 0x5e576e <nlohmann::detail::serializer<nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> >::dump_escaped(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool)+2680>, fd = 6182766, u32 = 6182766, u64 = 6182766}}, {events = 120, data = {ptr = 0xd39a270000000000, fd = 0, u32 = 0, u64 = 15247542369369718784}}, {events = 3435103488, data = {ptr = 0x2884b90, fd = 42486672, u32 = 42486672, u64 = 42486672}}, {events = 1164267680, data = {ptr = 0x45654e9000007ffe, fd = 32766, u32 = 32766, u64 = 5000489341647093758}}, {events = 32766, data = {ptr = 0x6363650080, fd = 1667563648, u32 = 1667563648, u64 = 426869325952}}, {events = 36, data = {ptr = 0x2400000000, fd = 0, u32 = 0, u64 = 154618822656}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 36, data = {ptr = 0x45654e9000000000, fd = 0, u32 = 0, u64 = 5000489341647060992}}, {events = 0, data = {ptr = 0x498d7b0, fd = 77125552, u32 = 77125552, u64 = 77125552}}, {events = 6261640, data = {ptr = 0x2000000000, fd = 0, u32 = 0, u64 = 137438953472}}, {events = 0, data = {ptr = 0x7ffe45654f10, fd = 1164267280, u32 = 1164267280, u64 = 140730062688016}}, {events = 4243216, data = {ptr = 0x456558d000000000, fd = 0, u32 = 0, u64 = 5000500611641245696}}, {events = 32766, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x24e2353c00000000, fd = 0, u32 = 0, u64 = 2657745261916323840}}, {events = 32611, data = {ptr = 0x5fa7290, fd = 100299408, u32 = 100299408, u64 = 100299408}}, {events = 1164267680, data = {ptr = 0x267458000007f00, fd = 32512, u32 = 32512, u64 = 173183526735216384}}, {events = 0, data = {ptr = 0x26cf460, fd = 40694880, u32 = 40694880, u64 = 40694880}}, {events = 1164267360, data = {ptr = 0x40bf1000007ffe, fd = 32766, u32 = 32766, u64 = 18224473949896702}}, {events = 0, data = {ptr = 0x7ffe456558d0, fd = 1164269776, u32 = 1164269776, u64 = 140730062690512}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7f6324e2353c <__GI___libc_free+76>, fd = 618804540, u32 = 618804540, u64 = 140063797294396}}, {events = 1164269776, data = {ptr = 0xd39a270000007ffe, fd = 32766, u32 = 32766, u64 = 15247542369369751550}}, {events = 3435103660, data = {ptr = 0x7ffe45654f20, fd = 1164267296, u32 = 1164267296, u64 = 140730062688032}}, {events = 6023265, data = {ptr = 0x45654f4000000000, fd = 0, u32 = 0, u64 = 5000490097561305088}}, {events = 32766, data = {ptr = 0x26cf460, fd = 40694880, u32 = 40694880, u64 = 40694880}}, {events = 1164267360, data = {ptr = 0x414cb100007ffe, fd = 32766, u32 = 32766, u64 = 18380196579147774}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 6059318, data = {ptr = 0x45654f6000000000, fd = 0, u32 = 0, u64 = 5000490235000258560}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 1164268480, data = {ptr = 0x1d2f66000007ffe, fd = 32766, u32 = 32766, u64 = 131438231324491774}}, {events = 0, data = {ptr = 0x7ffe45654f90, fd = 1164267408, u32 = 1164267408, u64 = 140730062688144}}, {events = 6056161, data = {ptr = 0x40b9c5000000000, fd = 0, u32 = 0, u64 = 291498468306845696}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 67869744, data = {ptr = 0x1d2f66000000000, fd = 0, u32 = 0, u64 = 131438231324459008}}, {events = 0, data = {ptr = 0x7ffe45654fb0, fd = 1164267440, u32 = 1164267440, u64 = 140730062688176}}, {events = 6052907, data = {ptr = 0x40b9c3000000000, fd = 0, u32 = 0, u64 = 291498330867892224}}, {events = 0, data = {ptr = 0x26cf460, fd = 40694880, u32 = 40694880, u64 = 40694880}}, {events = 1164267600, data = {ptr = 0x40bf1000007ffe, fd = 32766, u32 = 32766, u64 = 18224473949896702}}, {events = 0, data = {ptr = 0x7ffe456558d0, fd = 1164269776, u32 = 1164269776, u64 = 140730062690512}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7f6324e2353c <__GI___libc_free+76>, fd = 618804540, u32 = 618804540, u64 = 140063797294396}}, {events = 1164267520, data = {ptr = 0x5c528200007ffe, fd = 32766, u32 = 32766, u64 = 25986416156639230}}, {events = 0, data = {ptr = 0x7ffe45655020, fd = 1164267552, u32 = 1164267552, u64 = 140730062688288}}, {events = 30602848, data = {ptr = 0x4565502000000000, fd = 0, u32 = 0, u64 = 5000491059633979392}}, {events = 32766, data = {ptr = 0x26cf460, fd = 40694880, u32 = 40694880, u64 = 40694880}}, {events = 40065640, data = {ptr = 0x1c63c0000000000, fd = 0, u32 = 0, u64 = 127855610124304384}}, {events = 0, data = {ptr = 0x7ffe45655050, fd = 1164267600, u32 = 1164267600, u64 = 140730062688336}}, {events = 7662758, data = {ptr = 0x4565523000000000, fd = 0, u32 = 0, u64 = 5000493327376711680}}, {events = 32766, data = {ptr = 0x7ffe45655230, fd = 1164268080, u32 = 1164268080, u64 = 140730062688816}}, {events = 1164268240, data = {ptr = 0x26359e000007ffe, fd = 32766, u32 = 32766, u64 = 172080029377789950}}, {events = 0, data = {ptr = 0x7ffe45655150, fd = 1164267856, u32 = 1164267856, u64 = 140730062688592}}, {events = 7663749, data = {ptr = 0x32fb7d800000000, fd = 0, u32 = 0, u64 = 229604244360003584}}, {events = 0, data = {ptr = 0x26359e0, fd = 40065504, u32 = 40065504, u64 = 40065504}}, {events = 17433576, data = {ptr = 0x200000000, fd = 0, u32 = 0, u64 = 8589934592}}, {events = 3473464860, data = {ptr = 0x22cf605900000400, fd = 1024, u32 = 1024, u64 = 2508329452837012480}}, {events = 72, data = {ptr = 0x4565528800000000, fd = 0, u32 = 0, u64 = 5000493705333833728}}, {events = 32766, data = {ptr = 0x7ffe45655230, fd = 1164268080, u32 = 1164268080, u64 = 140730062688816}}, {events = 1164268208, data = {ptr = 0x26aae1000007ffe, fd = 32766, u32 = 32766, u64 = 174142919349927934}}, {events = 0, data = {ptr = 0x26aad30, fd = 40545584, u32 = 40545584, u64 = 40545584}}, {events = 40545856, data = {ptr = 0x25c0672a00000000, fd = 0, u32 = 0, u64 = 2720287605018066944}}, {events = 6, data = {ptr = 0x10a03e8 <RTC::EncryptBuffer+8>, fd = 17433576, u32 = 17433576, u64 = 17433576}}, {events = 4580016, data = {ptr = 0x10a041800000000, fd = 0, u32 = 0, u64 = 74876844930760704}}, {events = 0, data = {ptr = 0x45e2b0 <AES_encrypt>, fd = 4580016, u32 = 4580016, u64 = 4580016}}, {events = 59338224, data = {ptr = 0x3896d5000000000, fd = 0, u32 = 0, u64 = 254855044287954944}}...}
        pe = 0x7ffe456525e0
        e = {events = 1, data = {ptr = 0x23, fd = 35, u32 = 35, u64 = 35}}
        real_timeout = 8
        q = 0x2635a80
        w = 0x32e51a0
        sigset = {__val = {0 <repeats 16 times>}}
        psigset = 0x0
        base = 7833186897
        have_signals = 0
        nevents = 0
        count = 48
        nfds = 1
        fd = 49
        op = 3
        i = 0
        __PRETTY_FUNCTION__ = "uv__io_poll"
#25 0x000000000074569d in uv_run (loop=0x1c63c00, mode=UV_RUN_DEFAULT) at ../deps/libuv/src/unix/core.c:368
        timeout = 8
        r = 1
        ran_pending = 1
#26 0x00000000005b0350 in DepLibUV::RunLoop () at ../src/DepLibUV.cpp:52
        __FUNCTION__ = "RunLoop"
#27 0x00000000005bc545 in Worker::Worker (this=0x7ffe45655740, channel=0x1c63ff0) at ../src/Worker.cpp:31
No locals.
#28 0x000000000073d44a in main (argc=10, argv=0x7ffe456558d8) at ../src/main.cpp:116
        worker = {<Channel::UnixStreamSocket::Listener> = {_vptr.Listener = 0xc0df60 <vtable for Worker+16>}, <SignalsHandler::Listener> = {_vptr.Listener = 0xc0df98 <vtable for Worker+72>}, channel = 0x1c63ff0, signalsHandler = 0x1c91270, closed = false, mapRouters = std::unordered_map with 1 element = {["cc8ec0a9-56f4-4fe4-99f6-35a9dc85db75"] = 0x1d64ac0}}
        __FUNCTION__ = "main"
        version = "3.2.5"
        channel = 0x1c63ff0
(gdb)

It seems that TransportTuple::FillJson() is being called for the TCP selected tuple, and it fails when it calls to Utils::IP::GetAddressInfo(GetRemoteAddress(), family, ip, port);.

  • GetRemoteAddress() returns return this->tcpConnection->GetPeerAddress(), which is as follows:
inline const struct sockaddr* TcpConnection::GetPeerAddress() const
{
	return reinterpret_cast<const struct sockaddr*>(&this->peerAddr);
}
  • Note however that such a this->peerAddr is just filled when TcpConnection::SetPeerAddress() is called, which is called in the Start() method.
void TcpConnection::Start()
{
	MS_TRACE();

	if (this->closed)
		return;

	int err = uv_read_start(
	  reinterpret_cast<uv_stream_t*>(this->uvHandle),
	  static_cast<uv_alloc_cb>(onAlloc),
	  static_cast<uv_read_cb>(onRead));

	if (err != 0)
		MS_THROW_ERROR("uv_read_start() failed: %s", uv_strerror(err));

	// Get the peer address.
	if (!SetPeerAddress())
		MS_THROW_ERROR("error setting peer IP and port");
}

All core dumps above seem to be related to such a this->peerAddress not being filled in src/handles/TcpConnection.cpp.

Can you check this just in case? Modify the TcpConnection::Start() method as follows:

void TcpConnection::Start()
{
	MS_TRACE();

	if (this->closed)
		return;

	// Get the peer address.
	if (!SetPeerAddress())
		MS_THROW_ERROR("error setting peer IP and port");

	int err = uv_read_start(
	  reinterpret_cast<uv_stream_t*>(this->uvHandle),
	  static_cast<uv_alloc_cb>(onAlloc),
	  static_cast<uv_read_cb>(onRead));

	if (err != 0)
		MS_THROW_ERROR("uv_read_start() failed: %s", uv_strerror(err));
}

Sure I will. Is running mediasoup/worker/make enough for rebuild?

Yes, It is.

Core dump after the change:

$ gdb /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker /tmp/cores/core.mediasoup-worke.sig6.6013
GNU gdb (Ubuntu 8.2-0ubuntu1~16.04.1) 8.2
Copyright (C) 2018 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-worker...done.

warning: core file may not match specified executable file.
[New LWP 6013]
[New LWP 6018]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/var/conference/server/node_modules/mediasoup/worker/out/Release/mediasoup-work'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fbdd67a2428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
54      ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
[Current thread is 1 (Thread 0x7fbdd7c7b740 (LWP 6013))]
(gdb) bt full
#0  0x00007fbdd67a2428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pd = <optimized out>
        pid = 6013
        selftid = 6013
#1  0x00007fbdd67a402a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {0, 3684054920433006693, 140735034535104,
              3556217027, 140453345787904, 9101392, 1400, 9101976, 0, 0, 140453324199228, 140453325296208, 140453325309856, 0,
              140453325296208, 9101392}}, sa_flags = -674725888, sa_restorer = 0x8ae050}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fbdd679abd7 in __assert_fail_base (fmt=<optimized out>,
    assertion=assertion@entry=0x8ae050 "(stream->type == UV_TCP || stream->type == UV_NAMED_PIPE || stream->type == UV_TTY) && \"uv_write (unix) does not yet support other types of streams\"", file=file@entry=0x8adca0 "../deps/libuv/src/unix/stream.c", line=line@entry=1400,
    function=function@entry=0x8ae298 <__PRETTY_FUNCTION__.9016> "uv_write2") at assert.c:92
        str = 0x5a6eeb0 "x\033\263ֽ\177"
        total = 4096
#3  0x00007fbdd679ac82 in __GI___assert_fail (
    assertion=0x8ae050 "(stream->type == UV_TCP || stream->type == UV_NAMED_PIPE || stream->type == UV_TTY) && \"uv_write (unix) does not yet support other types of streams\"", file=0x8adca0 "../deps/libuv/src/unix/stream.c", line=1400,
    function=0x8ae298 <__PRETTY_FUNCTION__.9016> "uv_write2") at assert.c:101
No locals.
#4  0x0000000000750416 in uv_write2 (req=0x1ab3180, stream=0x48da6e0, bufs=0x7fff6dbdaef0, nbufs=1, send_handle=0x0, cb=
    0x5d2f14 <onWrite(uv_write_t*, int)>) at ../deps/libuv/src/unix/stream.c:1397
        empty_queue = 32701
        __PRETTY_FUNCTION__ = "uv_write2"
#5  0x00000000007506d8 in uv_write (req=0x1ab3180, handle=0x48da6e0, bufs=0x7fff6dbdaef0, nbufs=1, cb=0x5d2f14 <onWrite(uv_write_t*, int)>)
    at ../deps/libuv/src/unix/stream.c:1492
No locals.
#6  0x00000000005d3d1a in TcpConnection::Write (this=0x571b9d0, data1=0x7fff6dbdaf66 "", len1=2,
    data2=0x52ba2a0 "\025\376", <incomplete sequence \375>, len2=31) at ../src/handles/TcpConnection.cpp:327
        totalLen = 33
        buffers = {{base = 0x7fff6dbdaf66 "", len = 2}, {base = 0x52ba2a0 "\025\376", <incomplete sequence \375>, len = 31}}
        written = 0
        err = 21
        pendingLen = 33
        writeData = 0x1ab3180
        buffer = {base = 0x1ab3240 "", len = 33}
        __FUNCTION__ = "Write"
#7  0x000000000069d50b in RTC::TcpConnection::Send (this=0x571b9d0, data=0x52ba2a0 "\025\376", <incomplete sequence \375>, len=31)
    at ../src/RTC/TcpConnection.cpp:169
        frameLen = "\000\037"
#8  0x000000000062deac in RTC::TransportTuple::Send (this=0x19a8420, data=0x52ba2a0 "\025\376", <incomplete sequence \375>, len=31)
    at ../include/RTC/TransportTuple.hpp:113
No locals.
#9  0x00000000006b9274 in RTC::WebRtcTransport::OnDtlsTransportSendData (this=0x5a69990,
--Type <RET> for more, q to quit, c to continue without paging--c
    data=0x52ba2a0 "\025\376", <incomplete sequence \375>, len=31) at ../src/RTC/WebRtcTransport.cpp:1638
        __FUNCTION__ = "OnDtlsTransportSendData"
#10 0x000000000060fae1 in RTC::DtlsTransport::SendPendingOutgoingDtlsData (this=0x5a78d80) at ../src/RTC/DtlsTransport.cpp:1012
        read = 31
        data = 0x52ba2a0 "\025\376", <incomplete sequence \375>
#11 0x000000000060d81f in RTC::DtlsTransport::~DtlsTransport (this=0x5a78d80, __in_chrg=<optimized out>) at ../src/RTC/DtlsTransport.cpp:652
No locals.
#12 0x000000000060d8de in RTC::DtlsTransport::~DtlsTransport (this=0x5a78d80, __in_chrg=<optimized out>) at ../src/RTC/DtlsTransport.cpp:666
No locals.
#13 0x00000000006afbaa in RTC::WebRtcTransport::~WebRtcTransport (this=0x5a69990, __in_chrg=<optimized out>) at ../src/RTC/WebRtcTransport.cpp:266
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        udpSocket = <optimized out>
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        tcpServer = <optimized out>
#14 0x00000000006afe62 in RTC::WebRtcTransport::~WebRtcTransport (this=0x5a69990, __in_chrg=<optimized out>) at ../src/RTC/WebRtcTransport.cpp:294
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        udpSocket = <optimized out>
        kv = <optimized out>
        __for_range = <optimized out>
        __for_begin = <optimized out>
        __for_end = <optimized out>
        tcpServer = <optimized out>
#15 0x000000000064d26a in RTC::Router::HandleRequest (this=0x1907400, request=0x62b5e60) at ../src/RTC/Router.cpp:283
        transport = 0x5a69990
#16 0x00000000005be6c5 in Worker::OnChannelRequest (this=0x7fff6dbde890, request=0x62b5e60) at ../src/Worker.cpp:188
        router = 0x1907400
#17 0x00000000005e0321 in Channel::UnixStreamSocket::UserOnUnixStreamRead (this=0x18b7ff0) at ../src/Channel/UnixStreamSocket.cpp:265
        jsonRequest = {m_type = nlohmann::detail::value_t::object, m_value = {object = 0x3d0ac60, array = 0x3d0ac60, string = 0x3d0ac60, boolean = 96, number_integer = 64007264, number_unsigned = 64007264, number_float = 3.162379022669117e-316}}
        request = 0x62b5e60
        readLen = 159
        jsonStart = 0x7fbdd5c6d6dd "{\"id\":2333,\"method\":\"transport.close\",\"internal\":{\"routerId\":\"3d0f6784-ee93-49a4-907a-4687b7ac65ef\",\"transportId\":\"b2637581-a4ee-4b8c-aba8-a832fe63ba5a\"}},"
        jsonLen = 154
        nsRet = 0
        __FUNCTION__ = "UserOnUnixStreamRead"
#18 0x00000000005d8cf4 in UnixStreamSocket::OnUvRead (this=0x18b7ff0, nread=159) at ../src/handles/UnixStreamSocket.cpp:265
        __FUNCTION__ = "OnUvRead"
#19 0x00000000005d82cb in onRead (handle=0x18b8040, nread=159, buf=0x7fff6dbdb450) at ../src/handles/UnixStreamSocket.cpp:35
        socket = 0x18b7ff0
#20 0x000000000074fda6 in uv__read (stream=0x18b8040) at ../deps/libuv/src/unix/stream.c:1234
        buflen = 3135808
        buf = {base = 0x7fbdd5c6d6d9 "154:{\"id\":2333,\"method\":\"transport.close\",\"internal\":{\"routerId\":\"3d0f6784-ee93-49a4-907a-4687b7ac65ef\",\"transportId\":\"b2637581-a4ee-4b8c-aba8-a832fe63ba5a\"}},", len = 3135808}
        nread = 159
        msg = {msg_name = 0x7fff6dbdb4d0, msg_namelen = 1841149184, msg_iov = 0x7fff6dbdb4c0, msg_iovlen = 6124928, msg_control = 0x7fff6dbdb4c0, msg_controllen = 6124847, msg_flags = 0}
        cmsg_space = "\000\000\000\000\000\000\000\000\260\177\327\003", '\000' <repeats 12 times>, "\320~\327\003\000\000\000\000\360\265\275m\377\177\000\000k0u\000\000\000\000\000\060\265\275m\377\177\000\000\260\177\327\003\000\000\000\000pR\216\001\000\000\000\000\000\000\000\000\037\000\000\000P\265\275m\377\177\000\000\377\377\377\377\377\377\377\377\200(\303\000\000\000\000\000\000\000\001\000\000\000\000\000P\265\275m\377\177\000\000\200\000\000\000\000\000\000\000\000\265\275m\377\177\000\000\001", '\000' <repeats 31 times>, "\030\316\340\003\000\000\000\000\002\000I\200%\033ݵ\000\000\000\000\000\000\000\000t/]\000\000\000\000\000\240"...
        count = 31
        err = 0
        is_ipc = 0
        __PRETTY_FUNCTION__ = "uv__read"
#21 0x0000000000750085 in uv__stream_io (loop=0x18b7c00, w=0x18b80c8, events=1) at ../deps/libuv/src/unix/stream.c:1301
        stream = 0x18b8040
        __PRETTY_FUNCTION__ = "uv__stream_io"
#22 0x000000000075536a in uv__io_poll (loop=0x18b7c00, timeout=20) at ../deps/libuv/src/unix/linux-core.c:384
        max_safe_timeout = 1789569
        events = {{events = 1, data = {ptr = 0x3, fd = 3, u32 = 3, u64 = 3}}, {events = 1, data = {ptr = 0x53, fd = 83, u32 = 83, u64 = 83}}, {events = 1, data = {ptr = 0x13, fd = 19, u32 = 19, u64 = 19}}, {events = 1, data = {ptr = 0x78, fd = 120, u32 = 120, u64 = 120}}, {events = 1, data = {ptr = 0x3f, fd = 63, u32 = 63, u64 = 63}}, {events = 1, data = {ptr = 0x45, fd = 69, u32 = 69, u64 = 69}}, {events = 1, data = {ptr = 0x2b, fd = 43, u32 = 43, u64 = 43}}, {events = 1, data = {ptr = 0x76, fd = 118, u32 = 118, u64 = 118}}, {events = 1, data = {ptr = 0x7c, fd = 124, u32 = 124, u64 = 124}}, {events = 1, data = {ptr = 0x31, fd = 49, u32 = 49, u64 = 49}}, {events = 1, data = {ptr = 0x5a, fd = 90, u32 = 90, u64 = 90}}, {events = 1, data = {ptr = 0x68, fd = 104, u32 = 104, u64 = 104}}, {events = 1, data = {ptr = 0x80, fd = 128, u32 = 128, u64 = 128}}, {events = 1, data = {ptr = 0x57, fd = 87, u32 = 87, u64 = 87}}, {events = 1, data = {ptr = 0x42, fd = 66, u32 = 66, u64 = 66}}, {events = 1, data = {ptr = 0x64, fd = 100, u32 = 100, u64 = 100}}, {events = 1, data = {ptr = 0x21, fd = 33, u32 = 33, u64 = 33}}, {events = 1, data = {ptr = 0xd, fd = 13, u32 = 13, u64 = 13}}, {events = 1, data = {ptr = 0x19, fd = 25, u32 = 25, u64 = 25}}, {events = 1, data = {ptr = 0x6c, fd = 108, u32 = 108, u64 = 108}}, {events = 1, data = {ptr = 0x2d, fd = 45, u32 = 45, u64 = 45}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 653 times>, {events = 26053008, data = {ptr = 0x18d960800000000, fd = 0, u32 = 0, u64 = 111910526858035200}}, {events = 0, data = {ptr = 0x497bc5 <BN_CTX_get+85>, fd = 4815813, u32 = 4815813, u64 = 4815813}}, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x8, fd = 8, u32 = 8, u64 = 8}}, {events = 26056176, data = {ptr = 0x18d899000000000, fd = 0, u32 = 0, u64 = 111896817322426368}}, {events = 0, data = {ptr = 0x4a7df7 <bn_sqr_fixed_top+103>, fd = 4881911, u32 = 4881911, u64 = 4881911}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 16, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 14 times>, {events = 0, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x18d95f0, fd = 26056176, u32 = 26056176, u64 = 26056176}}, {events = 26057176, data = {ptr = 0x800000000, fd = 0, u32 = 0, u64 = 34359738368}}, {events = 0, data = {ptr = 0x4a13df <bn_from_montgomery_word+735>, fd = 4854751, u32 = 4854751, u64 = 4854751}}, {events = 4294967295, data = {ptr = 0x18d99e0ffffffff, fd = -1, u32 = 4294967295, u64 = 111914757400821759}}, {events = 0, data = {ptr = 0x18d9590, fd = 26056080, u32 = 26056080, u64 = 26056080}}, {events = 8, data = {ptr = 0x18d95f000000000, fd = 0, u32 = 0, u64 = 111910423778820096}}, {events = 0, data = {ptr = 0x18d8990, fd = 26053008, u32 = 26053008, u64 = 26053008}}, {events = 26056176, data = {ptr = 0x6dbde26000000000, fd = 0, u32 = 0, u64 = 7907725422677196800}}, {events = 32767, data = {ptr = 0x18d9590, fd = 26056080, u32 = 26056080, u64 = 26056080}}, {events = 26057552, data = {ptr = 0x6dbde26000000000, fd = 0, u32 = 0, u64 = 7907725422677196800}}, {events = 32767, data = {ptr = 0x4a16d4 <bn_from_mont_fixed_top+84>, fd = 4855508, u32 = 4855508, u64 = 4855508}}, {events = 26056080, data = {ptr = 0x6dbde2d000000000, fd = 0, u32 = 0, u64 = 7907725903713533952}}, {events = 32767, data = {ptr = 0x7fff6dbde260, fd = 1841160800, u32 = 1841160800, u64 = 140735034548832}}, {events = 26053008, data = {ptr = 0x6dbde28000000000, fd = 0, u32 = 0, u64 = 7907725560116150272}}, {events = 32767, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 1841160912, data = {ptr = 0x6dbde26000007fff, fd = 32767, u32 = 32767, u64 = 7907725422677229567}}, {events = 32767, data = {ptr = 0x18d8990, fd = 26053008, u32 = 26053008, u64 = 26053008}}, {events = 4820873, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}} <repeats 79 times>, {events = 0, data = {ptr = 0x6dbde22000000000, fd = 0, u32 = 0, u64 = 7907725147799289856}}, {events = 32767, data = {ptr = 0x7fff6dbde210, fd = 1841160720, u32 = 1841160720, u64 = 140735034548752}}, {events = 8739141, data = {ptr = 0x6dbde34800000000, fd = 0, u32 = 0, u64 = 7907726419109609472}}, {events = 32767, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 3598428461, data = {ptr = 0x7fbd, fd = 32701, u32 = 32701, u64 = 32701}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 117, data = {ptr = 0x6dbddd8800000000, fd = 0, u32 = 0, u64 = 7907720096917749760}}, {events = 32767, data = {ptr = 0x7fff6dbddd78, fd = 1841159544, u32 = 1841159544, u64 = 140735034547576}}, {events = 0, data = {ptr = 0x7fbd, fd = 32701, u32 = 32701, u64 = 32701}}, {events = 0, data = {ptr = 0x7fff6dbddd90, fd = 1841159568, u32 = 1841159568, u64 = 140735034547600}}, {events = 0, data = {ptr = 0xd727dd803ffa8000, fd = 1073381376, u32 = 1073381376, u64 = 15503603785145155584}}, {events = 32701, data = {ptr = 0x7fff6dbde2a0, fd = 1841160864, u32 = 1841160864, u64 = 140735034548896}}, {events = 1841160848, data = {ptr = 0x85594500007fff, fd = 32767, u32 = 32767, u64 = 37534324790165503}}, {events = 0, data = {ptr = 0x7fff6dbde3c8, fd = 1841161160, u32 = 1841161160, u64 = 140735034549192}}, {events = 0, data = {ptr = 0xd67ba92d00000000, fd = 0, u32 = 0, u64 = 15455132556990611456}}, {events = 32701, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x6dbde17500000000, fd = 0, u32 = 0, u64 = 7907724413359882240}}, {events = 0, data = {ptr = 0x7fff6dbdde08, fd = 1841159688, u32 = 1841159688, u64 = 140735034547720}}, {events = 1841159672, data = {ptr = 0x7fff, fd = 32767, u32 = 32767, u64 = 32767}}, {events = 1, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 1841159696, data = {ptr = 0x7fff, fd = 32767, u32 = 32767, u64 = 32767}}, {events = 1073397760, data = {ptr = 0xb00000000, fd = 0, u32 = 0, u64 = 47244640256}}, {events = 0, data = {ptr = 0x85592000000000, fd = 0, u32 = 0, u64 = 37534165876342784}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x6dbdde203ffac000, fd = 1073397760, u32 = 1073397760, u64 = 7907720750826176512}}, {events = 32767, data = {ptr = 0x7fff00000000, fd = 0, u32 = 0, u64 = 140733193388032}}, {events = 10, data = {ptr = 0x300000000, fd = 0, u32 = 0, u64 = 12884901888}}, {events = 0, data = {ptr = 0x7fff6dbde255, fd = 1841160789, u32 = 1841160789, u64 = 140735034548821}}, {events = 3, data = {ptr = 0x85594800000000, fd = 0, u32 = 0, u64 = 37534337675034624}}, {events = 0, data = {ptr = 0x100000000, fd = 0, u32 = 0, u64 = 4294967296}}, {events = 1841159792, data = {ptr = 0x7fff, fd = 32767, u32 = 32767, u64 = 32767}}, {events = 0, data = {ptr = 0xffffffffffffffff, fd = -1, u32 = 4294967295, u64 = 18446744073709551615}}, {events = 0, data = {ptr = 0x6dbde4d00000000b, fd = 11, u32 = 11, u64 = 7907728102736789515}}, {events = 32767, data = {ptr = 0x855949, fd = 8739145, u32 = 8739145, u64 = 8739145}}, {events = 27, data = {ptr = 0x6dbde4e000000000, fd = 0, u32 = 0, u64 = 7907728171456266240}}, {events = 32767, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 3610980879, data = {ptr = 0x6dbde20000007fbd, fd = 32701, u32 = 32701, u64 = 7907725010360369085}}, {events = 32767, data = {ptr = 0x1b, fd = 27, u32 = 27, u64 = 27}}, {events = 560, data = {ptr = 0x1000000000, fd = 0, u32 = 0, u64 = 68719476736}}, {events = 48, data = {ptr = 0x7fff6dbde4a0, fd = 1841161376, u32 = 1841161376, u64 = 140735034549408}}, {events = 1841161184, data = {ptr = 0x6dbddec000007fff, fd = 32767, u32 = 32767, u64 = 7907721436947578879}}, {events = 0, data = {ptr = 0x7fff6dbde4d0, fd = 1841161424, u32 = 1841161424, u64 = 140735034549456}}, {events = 2453807441, data = {ptr = 0x6dbddeafffff8000, fd = -32768, u32 = 4294934528, u64 = 7907721368228036608}}, {events = 32767, data = {ptr = 0x2, fd = 2, u32 = 2, u64 = 2}}, {events = 9, data = {ptr = 0x32, fd = 50, u32 = 50, u64 = 50}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 91, data = {ptr = 0x6e, fd = 110, u32 = 110, u64 = 110}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 119, data = {ptr = 0x6dbde2000000007c, fd = 124, u32 = 124, u64 = 7907725010360336508}}, {events = 32767, data = {ptr = 0x7fff6dbde4d0, fd = 1841161424, u32 = 1841161424, u64 = 140735034549456}}, {events = 57, data = {ptr = 0x6dbde4e000000000, fd = 0, u32 = 0, u64 = 7907728171456266240}}, {events = 32767, data = {ptr = 0x100, fd = 256, u32 = 256, u64 = 256}}, {events = 8761888, data = {ptr = 0x6dbddf0000000000, fd = 0, u32 = 0, u64 = 7907721711825453056}}, {events = 32767, data = {ptr = 0x5ea403 <std::array<unsigned char, 400ul>::operator[](unsigned long) const+35>, fd = 6202371, u32 = 6202371, u64 = 6202371}}, {events = 256, data = {ptr = 0xd73b477c00000000, fd = 0, u32 = 0, u64 = 15509068339681951744}}, {events = 32701, data = {ptr = 0x7fff6dbddf40, fd = 1841160000, u32 = 1841160000, u64 = 140735034548032}}, {events = 64245072, data = {ptr = 0x5f8b8800000000, fd = 0, u32 = 0, u64 = 26893539019325440}}, {events = 0, data = {ptr = 0x5f8bb7 <nlohmann::detail::output_string_adapter<char, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >::write_characters(char const*, unsigned long)+47>, fd = 6261687, u32 = 6261687, u64 = 6261687}}, {events = 1841160000, data = {ptr = 0x2400007fff, fd = 32767, u32 = 32767, u64 = 154618855423}}, {events = 0, data = {ptr = 0x7fff6dbde24a, fd = 1841160778, u32 = 1841160778, u64 = 140735034548810}}, {events = 64245072, data = {ptr = 0x6dbde06000000000, fd = 0, u32 = 0, u64 = 7907723223653941248}}, {events = 32767, data = {ptr = 0x5e576e <nlohmann::detail::serializer<nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> >::dump_escaped(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool)+2680>, fd = 6182766, u32 = 6182766, u64 = 6182766}}, {events = 120, data = {ptr = 0xb3ec370000000000, fd = 0, u32 = 0, u64 = 12964797900432343040}}, {events = 1259871232, data = {ptr = 0x1a18be0, fd = 27364320, u32 = 27364320, u64 = 27364320}}, {events = 1841160688, data = {ptr = 0x6dbddfe000007fff, fd = 32767, u32 = 32767, u64 = 7907722673898160127}}, {events = 32767, data = {ptr = 0x3030bd00d0, fd = 817692880, u32 = 817692880, u64 = 206976123088}}, {events = 36, data = {ptr = 0x2400000000, fd = 0, u32 = 0, u64 = 154618822656}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 36, data = {ptr = 0x6dbddfe000000000, fd = 0, u32 = 0, u64 = 7907722673898127360}}, {events = 0, data = {ptr = 0x3d44d50, fd = 64245072, u32 = 64245072, u64 = 64245072}}, {events = 6261640, data = {ptr = 0x2000000000, fd = 0, u32 = 0, u64 = 137438953472}}, {events = 0, data = {ptr = 0x7fff6dbde060, fd = 1841160288, u32 = 1841160288, u64 = 140735034548320}}, {events = 4243216, data = {ptr = 0x6dbdea2000000000, fd = 0, u32 = 0, u64 = 7907733943892312064}}, {events = 32767, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0xd67f153c00000000, fd = 0, u32 = 0, u64 = 15456095793601052672}}, {events = 32701, data = {ptr = 0x631f670, fd = 103937648, u32 = 103937648, u64 = 103937648}}, {events = 1841160688, data = {ptr = 0x428b49000007f00, fd = 32512, u32 = 32512, u64 = 299687905788460800}}, {events = 0, data = {ptr = 0x1ba4a00, fd = 28985856, u32 = 28985856, u64 = 28985856}}, {events = 1841160368, data = {ptr = 0x40bf1000007fff, fd = 32767, u32 = 32767, u64 = 18224473949896703}}, {events = 0, data = {ptr = 0x7fff6dbdea20, fd = 1841162784, u32 = 1841162784, u64 = 140735034550816}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7fbdd67f153c <__GI___libc_free+76>, fd = -696314564, u32 = 3598652732, u64 = 140453324199228}}, {events = 1841162784, data = {ptr = 0xb3ec370000007fff, fd = 32767, u32 = 32767, u64 = 12964797900432375807}}, {events = 1259871383, data = {ptr = 0x7fff6dbde070, fd = 1841160304, u32 = 1841160304, u64 = 140735034548336}}, {events = 6023265, data = {ptr = 0x6dbde09000000000, fd = 0, u32 = 0, u64 = 7907723429812371456}}, {events = 32767, data = {ptr = 0x1ba4a00, fd = 28985856, u32 = 28985856, u64 = 28985856}}, {events = 1841160368, data = {ptr = 0x40bf1000007fff, fd = 32767, u32 = 32767, u64 = 18224473949896703}}, {events = 0, data = {ptr = 0x7fff6dbdea20, fd = 1841162784, u32 = 1841162784, u64 = 140735034550816}}, {events = 6059318, data = {ptr = 0x6dbde0b000000000, fd = 0, u32 = 0, u64 = 7907723567251324928}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 28985728, data = {ptr = 0x4dd124000000000, fd = 0, u32 = 0, u64 = 350456412091973632}}, {events = 0, data = {ptr = 0x7fff6dbde0e0, fd = 1841160416, u32 = 1841160416, u64 = 140735034548448}}, {events = 6056161, data = {ptr = 0x1ba49a000000000, fd = 0, u32 = 0, u64 = 124492891249704960}}, {events = 0, data = {ptr = 0x1, fd = 1, u32 = 1, u64 = 1}}, {events = 28985728, data = {ptr = 0x4dd124000000000, fd = 0, u32 = 0, u64 = 350456412091973632}}, {events = 0, data = {ptr = 0x7fff6dbde100, fd = 1841160448, u32 = 1841160448, u64 = 140735034548480}}, {events = 6052907, data = {ptr = 0x1ba498000000000, fd = 0, u32 = 0, u64 = 124492753810751488}}, {events = 0, data = {ptr = 0x1ba4a00, fd = 28985856, u32 = 28985856, u64 = 28985856}}, {events = 1841160608, data = {ptr = 0x40bf1000007fff, fd = 32767, u32 = 32767, u64 = 18224473949896703}}, {events = 0, data = {ptr = 0x7fff6dbdea20, fd = 1841162784, u32 = 1841162784, u64 = 140735034550816}}, {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}, {events = 0, data = {ptr = 0x7fbdd67f153c <__GI___libc_free+76>, fd = -696314564, u32 = 3598652732, u64 = 140453324199228}}, {events = 1841160528, data = {ptr = 0x5c528200007fff, fd = 32767, u32 = 32767, u64 = 25986416156639231}}, {events = 0, data = {ptr = 0x7fff6dbde170, fd = 1841160560, u32 = 1841160560, u64 = 140735034548592}}, {events = 81596992, data = {ptr = 0x6dbde17000000000, fd = 0, u32 = 0, u64 = 7907724391885045760}}, {events = 32767, data = {ptr = 0x1ba4a00, fd = 28985856, u32 = 28985856, u64 = 28985856}}, {events = 81792984, data = {ptr = 0x18b7c0000000000, fd = 0, u32 = 0, u64 = 111318955242553344}}, {events = 0, data = {ptr = 0x7fff6dbde1a0, fd = 1841160608, u32 = 1841160608, u64 = 140735034548640}}, {events = 7662758, data = {ptr = 0x6dbde38000000000, fd = 0, u32 = 0, u64 = 7907726659627778048}}, {events = 32767, data = {ptr = 0x7fff6dbde380, fd = 1841161088, u32 = 1841161088, u64 = 140735034549120}}, {events = 1841161248, data = {ptr = 0x4e00f5000007fff, fd = 32767, u32 = 32767, u64 = 351297607206731775}}, {events = 0, data = {ptr = 0x7fff6dbde2a0, fd = 1841160864, u32 = 1841160864, u64 = 140735034548896}}, {events = 7663749, data = {ptr = 0x19012f800000000, fd = 0, u32 = 0, u64 = 112610847045451776}}, {events = 0, data = {ptr = 0x4e00f50, fd = 81792848, u32 = 81792848, u64 = 81792848}}, {events = 17433576, data = {ptr = 0x200000000, fd = 0, u32 = 0, u64 = 8589934592}}, {events = 1451476510, data = {ptr = 0xf189e32c00000400, fd = 1024, u32 = 1024, u64 = 17404692013068059648}}, {events = 72, data = {ptr = 0x6dbde3d800000000, fd = 0, u32 = 0, u64 = 7907727037584900096}}, {events = 32767, data = {ptr = 0x7fff6dbde380, fd = 1841161088, u32 = 1841161088, u64 = 140735034549120}}, {events = 1841161216, data = {ptr = 0x3d6ebe000007fff, fd = 32767, u32 = 32767, u64 = 276667774435098623}}, {events = 0, data = {ptr = 0x3d6eb00, fd = 64416512, u32 = 64416512, u64 = 64416512}}, {events = 64416784, data = {ptr = 0x6dbde23000000000, fd = 0, u32 = 0, u64 = 7907725216518766592}}, {events = 6, data = {ptr = 0x10a03e8 <RTC::EncryptBuffer+8>, fd = 17433576, u32 = 17433576, u64 = 17433576}}...}
        pe = 0x7fff6dbdb730
        e = {events = 0, data = {ptr = 0x0, fd = 0, u32 = 0, u64 = 0}}
        real_timeout = 20
        q = 0x4e00ff0
        w = 0x18b80c8
        sigset = {__val = {0 <repeats 16 times>}}
        psigset = 0x0
        base = 8097070447
        have_signals = 0
        nevents = 0
        count = 48
        nfds = 1
        fd = 3
        op = 3
        i = 0
        __PRETTY_FUNCTION__ = "uv__io_poll"
#23 0x000000000074569d in uv_run (loop=0x18b7c00, mode=UV_RUN_DEFAULT) at ../deps/libuv/src/unix/core.c:368
        timeout = 20
        r = 1
        ran_pending = 0
#24 0x00000000005b0350 in DepLibUV::RunLoop () at ../src/DepLibUV.cpp:52
        __FUNCTION__ = "RunLoop"
#25 0x00000000005bc545 in Worker::Worker (this=0x7fff6dbde890, channel=0x18b7ff0) at ../src/Worker.cpp:31
No locals.
#26 0x000000000073d44a in main (argc=10, argv=0x7fff6dbdea28) at ../src/main.cpp:116
        worker = {<Channel::UnixStreamSocket::Listener> = {_vptr.Listener = 0xc0df60 <vtable for Worker+16>}, <SignalsHandler::Listener> = {_vptr.Listener = 0xc0df98 <vtable for Worker+72>}, channel = 0x18b7ff0, signalsHandler = 0x18e5270, closed = false, mapRouters = std::unordered_map with 1 element = {["3d0f6784-ee93-49a4-907a-4687b7ac65ef"] = 0x1907400}}
        __FUNCTION__ = "main"
        version = "3.2.5"
        channel = 0x18b7ff0
(gdb)