[raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Bugs that we were not able to reproduce, and/or are waiting for more detailed info.
Post Reply
Copy link
someone1337
Fast Inserter
Fast Inserter
Posts: 140
Joined: Wed Apr 26, 2017 11:29 pm
Contact:
Contact someone1337

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by someone1337 »

Also: consider looking into your "dmesg" if you get these freezes and also look up your ram with "free -m" to see if your swap is full and/or your ram is free (free = there was something that is gone now; usually linux will keep all files you open in ram until it needs ram, then it flushes these VFS caches, so usually normal operation means: you have almost no free ram, but what you actually care about is available ram). As in: maybe its a swapping to death condition where everything gets swapped out, but the forked child that is saving, then swapped back in, then swapped back out, until the fork completes saving. As in: you dont have enough ram to keep both processes in ram.

If its not an out of ram/swapping issue, consider running htop in your terminal, find factorio in the list and press "s" -> strace factorio, maybe you see something. This repeating seems normal, tho:

Code: Select all

15:43:54.226976 futex(0x7ffd91e95a90, FUTEX_WAKE_PRIVATE, 2147483647) = 1 <0.000013>
15:43:54.227011 futex(0x7ffd91e95a20, FUTEX_WAKE_PRIVATE, 1) = 1 <0.000013>
15:43:54.227051 clock_nanosleep(CLOCK_REALTIME, 0, {tv_sec=0, tv_nsec=500000}, 0x7ffd91e959f0) = 0 <0.000566>
15:43:54.227660 recvmsg(8, {msg_namelen=0}, 0) = -1 EAGAIN (Resource temporarily unavailable) <0.000009>
15:43:54.227697 recvmsg(8, {msg_namelen=0}, 0) = -1 EAGAIN (Resource temporarily unavailable) <0.000010>
15:43:54.227733 read(10, 0x7ffd91e93dc0, 4096) = -1 EAGAIN (Resource temporarily unavailable) <0.000014>
15:43:54.227784 read(11, 0x7ffd91e93da0, 4096) = -1 EAGAIN (Resource temporarily unavailable) <0.000016>
Top
berggen
Burner Inserter
Burner Inserter
Posts: 10
Joined: Tue Sep 01, 2020 7:12 pm
Contact:
Contact berggen

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by berggen »

I feel like I've seen a Factorio freeze when leaving the menu open (paused) for a long time. Seems maybe unrelated, but I'll try to replicate again. Only issue is the last time this happened I didn't see anything in the logs.
Top
XANi
Burner Inserter
Burner Inserter
Posts: 10
Joined: Tue Jun 11, 2019 4:44 pm
Contact:
Contact XANi

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by XANi »

I just got it. Factorio is basically using no CPU

Here is stacktrace (thread apply all bt)

Code: Select all

(gdb) thread apply all bt 100

Thread 45 (Thread 0x7fda696006c0 (LWP 517575) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x6c6b460) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x6c6b460, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x6c6b460, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x6c6b3e8, cond=0x6c6b438) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x6c6b438, mutex=0x6c6b3e8) at ./nptl/pthread_cond_wait.c:618
#5  0x000000000113e6ff in PackagePathAdapter::readFile() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 44 (Thread 0x7fda896006c0 (LWP 415836) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda5259ab50) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda5259ab50, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda5259ab50, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda5259ab00, cond=0x7fda5259ab28) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda5259ab28, mutex=0x7fda5259ab00) at ./nptl/pthread_cond_wait.c:618
#5  0x0000000001047b02 in MapGenerationHelper::consumeTasks() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 43 (Thread 0x7fda934006c0 (LWP 415835) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda8773bec0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda8773bec0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda8773bec0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda8773be70, cond=0x7fda8773be98) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda8773be98, mutex=0x7fda8773be70) at ./nptl/pthread_cond_wait.c:618
#5  0x0000000001047b02 in MapGenerationHelper::consumeTasks() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
--Type <RET> for more, q to quit, c to continue without paging--c
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 42 (Thread 0x7fda77e006c0 (LWP 415785) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84015d70) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84015d70, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84015d70, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015d00, cond=0x7fda84015d48) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015d48, mutex=0x7fda84015d00) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 41 (Thread 0x7fda7cc006c0 (LWP 415784) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84015a84) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84015a84, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84015a84, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015a10, cond=0x7fda84015a58) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015a58, mutex=0x7fda84015a10) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 40 (Thread 0x7fda7d6006c0 (LWP 415783) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84015790) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84015790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84015790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015720, cond=0x7fda84015768) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015768, mutex=0x7fda84015720) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 39 (Thread 0x7fda7e8006c0 (LWP 415782) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840154a0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840154a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840154a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015430, cond=0x7fda84015478) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015478, mutex=0x7fda84015430) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 38 (Thread 0x7fda7f2006c0 (LWP 415781) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840151b0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840151b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840151b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015140, cond=0x7fda84015188) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015188, mutex=0x7fda84015140) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 37 (Thread 0x7fda8a0006c0 (LWP 415780) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014ec4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014ec4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014ec4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014e50, cond=0x7fda84014e98) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014e98, mutex=0x7fda84014e50) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 36 (Thread 0x7fda8aa006c0 (LWP 415779) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014bd0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014bd0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014bd0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014b60, cond=0x7fda84014ba8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014ba8, mutex=0x7fda84014b60) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 35 (Thread 0x7fda8b4006c0 (LWP 415778) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840148e4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840148e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840148e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014870, cond=0x7fda840148b8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840148b8, mutex=0x7fda84014870) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 34 (Thread 0x7fda8be006c0 (LWP 415777) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840145f0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840145f0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840145f0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014580, cond=0x7fda840145c8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840145c8, mutex=0x7fda84014580) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 33 (Thread 0x7fda916006c0 (LWP 415776) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014334) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014334, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014334, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda840142c0, cond=0x7fda84014308) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014308, mutex=0x7fda840142c0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 32 (Thread 0x7fda920006c0 (LWP 415775) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014070) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014070, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014070, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014000, cond=0x7fda84014048) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014048, mutex=0x7fda84014000) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 31 (Thread 0x7fda92a006c0 (LWP 415774) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840451e4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840451e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840451e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84045170, cond=0x7fda840451b8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840451b8, mutex=0x7fda84045170) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 30 (Thread 0x7fda93e006c0 (LWP 415773) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840456e4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840456e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840456e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84045670, cond=0x7fda840456b8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840456b8, mutex=0x7fda84045670) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 29 (Thread 0x7fda75a006c0 (LWP 415772) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84045640) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84045640, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84045640, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda840455d0, cond=0x7fda84045618) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84045618, mutex=0x7fda840455d0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 28 (Thread 0x7fda750006c0 (LWP 415771) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84043cb0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84043cb0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84043cb0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84043c40, cond=0x7fda84043c88) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84043c88, mutex=0x7fda84043c40) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 27 (Thread 0x7fda6be006c0 (LWP 415770) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84043be0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84043be0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84043be0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84043b70, cond=0x7fda84043bb8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84043bb8, mutex=0x7fda84043b70) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 26 (Thread 0x7fda6a0006c0 (LWP 415723) "factorio:shlo2"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e8350) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e82f8, cond=0x38e8328) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8328, mutex=0x38e82f8) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 25 (Thread 0x7fda6aa006c0 (LWP 415722) "factorio:shlo1"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e8350) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e82f8, cond=0x38e8328) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8328, mutex=0x38e82f8) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 24 (Thread 0x7fda6b4006c0 (LWP 415720) "GameUpdate"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7ffc17e990d0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7ffc17e990d0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7ffc17e990d0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7ffc17e99060, cond=0x7ffc17e990a8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7ffc17e990a8, mutex=0x7ffc17e99060) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 23 (Thread 0x7fdae74006c0 (LWP 413728) "SDLAudioP2"):
#0  0x00007fdb131270f6 in __ppoll (fds=0x3a08ea0, nfds=3, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
#1  0x00007fdb1331f029 in pa_mainloop_poll () from /lib/x86_64-linux-gnu/libpulse.so.0
#2  0x00007fdb1331f606 in pa_mainloop_iterate () from /lib/x86_64-linux-gnu/libpulse.so.0
#3  0x0000000001820ed4 in PULSEAUDIO_PlayDevice ()
#4  0x00000000017f35c4 in SDL_RunAudio.lto_priv.0 ()
#5  0x00000000017deacf in RunThread ()
#6  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#7  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 22 (Thread 0x7fdb0df326c0 (LWP 413727) "PulseHotplug"):
#0  0x00007fdb131270f6 in __ppoll (fds=0x421ebd0, nfds=3, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
#1  0x00007fdb1331f029 in pa_mainloop_poll () from /lib/x86_64-linux-gnu/libpulse.so.0
#2  0x00007fdb1331f606 in pa_mainloop_iterate () from /lib/x86_64-linux-gnu/libpulse.so.0
#3  0x00007fdb1331f6b0 in pa_mainloop_run () from /lib/x86_64-linux-gnu/libpulse.so.0
#4  0x00000000018214cd in HotplugThread ()
#5  0x00000000017deacf in RunThread ()
#6  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#7  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 21 (Thread 0x7fdae7e006c0 (LWP 413726) "factorio:sh2"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e81a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e8148, cond=0x38e8178) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8178, mutex=0x38e8148) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 20 (Thread 0x7fdaf0c006c0 (LWP 413725) "factorio:sh1"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e81a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e8148, cond=0x38e8178) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8178, mutex=0x38e8148) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 19 (Thread 0x7fdaf16006c0 (LWP 413724) "factorio:gl0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3a8a7a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3a8a7a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3a8a7a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3a8a748, cond=0x3a8a778) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3a8a778, mutex=0x3a8a748) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 18 (Thread 0x7fdaf20006c0 (LWP 413723) "factorio:gdrv0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3a56860) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3a56860, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3a56860, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3a56808, cond=0x3a56838) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3a56838, mutex=0x3a56808) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 17 (Thread 0x7fdaf2a006c0 (LWP 413722) "factor:traceq0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3b15568) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3b15568, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3b15568, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3b15510, cond=0x3b15540) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3b15540, mutex=0x3b15510) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 16 (Thread 0x7fdaf34006c0 (LWP 413718) "factor:traceq0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x39befb8) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x39befb8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x39befb8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x39bef60, cond=0x39bef90) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x39bef90, mutex=0x39bef60) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 15 (Thread 0x7fdaf3e006c0 (LWP 413717) "factor:traceq0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x396e108) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x396e108, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x396e108, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x396e0b0, cond=0x396e0e0) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x396e0e0, mutex=0x396e0b0) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 14 (Thread 0x7fdaf90006c0 (LWP 413716) "factorio:shlo0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e8350) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e82f8, cond=0x38e8328) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8328, mutex=0x38e82f8) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 13 (Thread 0x7fdaf9a006c0 (LWP 413715) "factorio:sh0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e81a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e8148, cond=0x38e8178) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8178, mutex=0x38e8148) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 12 (Thread 0x7fdafa4006c0 (LWP 413714) "factori:disk$0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x395c188) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x395c188, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x395c188, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x395c130, cond=0x395c160) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x395c160, mutex=0x395c130) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 11 (Thread 0x7fdafae006c0 (LWP 413713) "factorio:cs0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38d6cc4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38d6cc4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38d6cc4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38d6c68, cond=0x38d6c98) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38d6c98, mutex=0x38d6c68) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 10 (Thread 0x7fdb098006c0 (LWP 413710) "SDLTimer"):
#0  __futex_abstimed_wait_common64 (private=<optimized out>, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x36ff790) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x36ff790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=<optimized out>, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x36ff790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=<optimized out>) at ./nptl/futex-internal.c:139
#3  0x00007fdb130bbadf in do_futex_wait (sem=sem@entry=0x36ff790, abstime=0x0, clockid=0) at ./nptl/sem_waitcommon.c:111
#4  0x00007fdb130bbb70 in __new_sem_wait_slow64 (sem=0x36ff790, abstime=0x0, clockid=0) at ./nptl/sem_waitcommon.c:183
#5  0x00000000017f6722 in SDL_TimerThread ()
#6  0x00000000017deacf in RunThread ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 9 (Thread 0x7fdb0a2006c0 (LWP 413709) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x35fac60) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x35fac60, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x35fac60, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x35fabf0, cond=0x35fac38) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x35fac38, mutex=0x35fabf0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 8 (Thread 0x7fdb0ac006c0 (LWP 413708) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3602ea0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3602ea0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3602ea0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3602e30, cond=0x3602e78) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3602e78, mutex=0x3602e30) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 7 (Thread 0x7fdb0b6006c0 (LWP 413707) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3629df4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3629df4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3629df4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3629d80, cond=0x3629dc8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3629dc8, mutex=0x3629d80) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 6 (Thread 0x7fdb0c0006c0 (LWP 413706) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x35e34a0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x35e34a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x35e34a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x35e3430, cond=0x35e3478) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x35e3478, mutex=0x35e3430) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 5 (Thread 0x7fdb0ca006c0 (LWP 413705) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x35e9844) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x35e9844, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x35e9844, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x35e97d0, cond=0x35e9818) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x35e9818, mutex=0x35e97d0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 4 (Thread 0x7fdb0d4006c0 (LWP 413704) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x370f214) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x370f214, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x370f214, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x370f1a0, cond=0x370f1e8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x370f1e8, mutex=0x370f1a0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 3 (Thread 0x7fdb0de006c0 (LWP 413703) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3714834) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3714834, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3714834, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x37147c0, cond=0x3714808) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3714808, mutex=0x37147c0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 2 (Thread 0x7fdb0e8006c0 (LWP 413702) "TaskManager"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x36bf150) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x36bf150, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x36bf150, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x36bf100, cond=0x36bf128) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x36bf128, mutex=0x36bf100) at ./nptl/pthread_cond_wait.c:618
#5  0x0000000001717f3b in std::thread::_State_impl<std::thread::_Invoker<std::tuple<TaskManager::TaskManager()::{lambda()#1}> > >::_M_run() [clone .lto_priv.0] ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 1 (Thread 0x7fdb12563140 (LWP 168135) "factorio"):
#0  __recvmsg_syscall (flags=0, msg=0x7ffc17e97b90, fd=58) at ../sysdeps/unix/sysv/linux/recvmsg.c:27
#1  __libc_recvmsg (fd=58, msg=0x7ffc17e97b90, flags=0) at ../sysdeps/unix/sysv/linux/recvmsg.c:41
#2  0x00007fdb136f4fb8 in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#3  0x00007fdb136f5d86 in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#4  0x00007fdb136f6712 in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#5  0x00007fdb136f823c in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#6  0x00007fdb136e7a55 in glXSwapBuffers () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#7  0x00000000018a68d6 in X11_GL_SwapWindow ()
#8  0x0000000000c27fe6 in GraphicsInterfaceOpenGL::swapBuffers() ()
#9  0x0000000000beefd6 in SDLWindow::swap() const ()
#10 0x0000000001745982 in GlobalContext::swapRenderBuffers() [clone .part.0] ()
#11 0x00000000007cb605 in MainLoop::run(Filesystem::Path const&, Filesystem::Path const&, bool, bool, std::function<void ()>, Filesystem::Path const&, MainLoop::HeavyMode) ()
#12 0x0000000000616ea9 in main ()
Top
savisitor15
Manual Inserter
Manual Inserter
Posts: 4
Joined: Sun Mar 17, 2019 6:15 am
Contact:
Contact savisitor15

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by savisitor15 »

Just at a glance it looks like the main thread was locked up waiting for a message from a socket. Could be wrong but I wonder if the saving thread reports done to the master with a socket write. And there's no timeout set.
Top
olivetho
Manual Inserter
Manual Inserter
Posts: 1
Joined: Sat Apr 27, 2024 3:19 pm
Contact:
Contact olivetho

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by olivetho »

Just throwing things at the wall here, but reading nagapito's comments it sounds like the issue might have to do with an autosave thread hanging after completion, which somehow disrupts the following autosave and causes the game to crash. The crashing might arise from the main process only expecting to have a single autosave thread running at a time (which is a very reasonable assumption to make) - meaning that once the second autosave thread is created, it causes an undefined behaviour which results in crashing.
Another possible suspect might be a rogue "wait" call causing the game thread to freeze for some reason - it would also explain the near-zero CPU usage while frozen.

It might be simpler to implement logic that can handle a zombified autosave thread rather than attempting to fix the rare issue of a thread going zombie in the first place - either by terminating any and all existing autosave threads by the time the next autosave rolls around; or by doing the grandfather trick of forking the child thread to create a grandchild, then immediately killing the child thread such that the grandchild becomes orphaned - this causes it to be inherited by init, which will always reap its dead children (explained in further detail here: https://web.archive.org/web/20160501063 ... ost1589801).

(Keep in mind that I don't really deal with this OS level stuff on a day to day basis, so everything I said here could be completely wrong)
Top
XANi
Burner Inserter
Burner Inserter
Posts: 10
Joined: Tue Jun 11, 2019 4:44 pm
Contact:
Contact XANi

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by XANi »

I'll keep an eye for any zombified process but IIRC I did not saw any zombie process hanging around while the "main" factorio process hanged. So I think if autosave was just a fork() the auto-saving process exited correctly.

I think workaround might be plainly doing waitpid() on the forked process if the message isn't received within x seconds, or at least crashing with message so we can be sure it's that.
Top
User avatar
raiguard
Factorio Staff
Factorio Staff
Posts: 579
Joined: Wed Dec 13, 2017 8:29 pm
Contact:
Contact raiguard

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by raiguard »

XANi wrote: ↑Fri Apr 26, 2024 11:03 pm I just got it. Factorio is basically using no CPU

Here is stacktrace (thread apply all bt)

Code: Select all

(gdb) thread apply all bt 100

Thread 45 (Thread 0x7fda696006c0 (LWP 517575) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x6c6b460) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x6c6b460, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x6c6b460, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x6c6b3e8, cond=0x6c6b438) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x6c6b438, mutex=0x6c6b3e8) at ./nptl/pthread_cond_wait.c:618
#5  0x000000000113e6ff in PackagePathAdapter::readFile() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 44 (Thread 0x7fda896006c0 (LWP 415836) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda5259ab50) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda5259ab50, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda5259ab50, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda5259ab00, cond=0x7fda5259ab28) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda5259ab28, mutex=0x7fda5259ab00) at ./nptl/pthread_cond_wait.c:618
#5  0x0000000001047b02 in MapGenerationHelper::consumeTasks() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 43 (Thread 0x7fda934006c0 (LWP 415835) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda8773bec0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda8773bec0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda8773bec0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda8773be70, cond=0x7fda8773be98) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda8773be98, mutex=0x7fda8773be70) at ./nptl/pthread_cond_wait.c:618
#5  0x0000000001047b02 in MapGenerationHelper::consumeTasks() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
--Type <RET> for more, q to quit, c to continue without paging--c
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 42 (Thread 0x7fda77e006c0 (LWP 415785) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84015d70) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84015d70, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84015d70, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015d00, cond=0x7fda84015d48) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015d48, mutex=0x7fda84015d00) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 41 (Thread 0x7fda7cc006c0 (LWP 415784) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84015a84) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84015a84, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84015a84, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015a10, cond=0x7fda84015a58) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015a58, mutex=0x7fda84015a10) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 40 (Thread 0x7fda7d6006c0 (LWP 415783) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84015790) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84015790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84015790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015720, cond=0x7fda84015768) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015768, mutex=0x7fda84015720) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 39 (Thread 0x7fda7e8006c0 (LWP 415782) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840154a0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840154a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840154a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015430, cond=0x7fda84015478) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015478, mutex=0x7fda84015430) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 38 (Thread 0x7fda7f2006c0 (LWP 415781) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840151b0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840151b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840151b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84015140, cond=0x7fda84015188) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84015188, mutex=0x7fda84015140) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 37 (Thread 0x7fda8a0006c0 (LWP 415780) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014ec4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014ec4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014ec4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014e50, cond=0x7fda84014e98) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014e98, mutex=0x7fda84014e50) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 36 (Thread 0x7fda8aa006c0 (LWP 415779) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014bd0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014bd0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014bd0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014b60, cond=0x7fda84014ba8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014ba8, mutex=0x7fda84014b60) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 35 (Thread 0x7fda8b4006c0 (LWP 415778) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840148e4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840148e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840148e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014870, cond=0x7fda840148b8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840148b8, mutex=0x7fda84014870) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 34 (Thread 0x7fda8be006c0 (LWP 415777) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840145f0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840145f0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840145f0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014580, cond=0x7fda840145c8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840145c8, mutex=0x7fda84014580) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 33 (Thread 0x7fda916006c0 (LWP 415776) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014334) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014334, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014334, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda840142c0, cond=0x7fda84014308) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014308, mutex=0x7fda840142c0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 32 (Thread 0x7fda920006c0 (LWP 415775) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84014070) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84014070, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84014070, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84014000, cond=0x7fda84014048) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84014048, mutex=0x7fda84014000) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 31 (Thread 0x7fda92a006c0 (LWP 415774) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840451e4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840451e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840451e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84045170, cond=0x7fda840451b8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840451b8, mutex=0x7fda84045170) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 30 (Thread 0x7fda93e006c0 (LWP 415773) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda840456e4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda840456e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda840456e4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84045670, cond=0x7fda840456b8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda840456b8, mutex=0x7fda84045670) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 29 (Thread 0x7fda75a006c0 (LWP 415772) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84045640) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84045640, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84045640, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda840455d0, cond=0x7fda84045618) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84045618, mutex=0x7fda840455d0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 28 (Thread 0x7fda750006c0 (LWP 415771) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84043cb0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84043cb0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84043cb0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84043c40, cond=0x7fda84043c88) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84043c88, mutex=0x7fda84043c40) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 27 (Thread 0x7fda6be006c0 (LWP 415770) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7fda84043be0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7fda84043be0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7fda84043be0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fda84043b70, cond=0x7fda84043bb8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7fda84043bb8, mutex=0x7fda84043b70) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 26 (Thread 0x7fda6a0006c0 (LWP 415723) "factorio:shlo2"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e8350) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e82f8, cond=0x38e8328) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8328, mutex=0x38e82f8) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 25 (Thread 0x7fda6aa006c0 (LWP 415722) "factorio:shlo1"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e8350) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e82f8, cond=0x38e8328) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8328, mutex=0x38e82f8) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 24 (Thread 0x7fda6b4006c0 (LWP 415720) "GameUpdate"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7ffc17e990d0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7ffc17e990d0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7ffc17e990d0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7ffc17e99060, cond=0x7ffc17e990a8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7ffc17e990a8, mutex=0x7ffc17e99060) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 23 (Thread 0x7fdae74006c0 (LWP 413728) "SDLAudioP2"):
#0  0x00007fdb131270f6 in __ppoll (fds=0x3a08ea0, nfds=3, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
#1  0x00007fdb1331f029 in pa_mainloop_poll () from /lib/x86_64-linux-gnu/libpulse.so.0
#2  0x00007fdb1331f606 in pa_mainloop_iterate () from /lib/x86_64-linux-gnu/libpulse.so.0
#3  0x0000000001820ed4 in PULSEAUDIO_PlayDevice ()
#4  0x00000000017f35c4 in SDL_RunAudio.lto_priv.0 ()
#5  0x00000000017deacf in RunThread ()
#6  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#7  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 22 (Thread 0x7fdb0df326c0 (LWP 413727) "PulseHotplug"):
#0  0x00007fdb131270f6 in __ppoll (fds=0x421ebd0, nfds=3, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
#1  0x00007fdb1331f029 in pa_mainloop_poll () from /lib/x86_64-linux-gnu/libpulse.so.0
#2  0x00007fdb1331f606 in pa_mainloop_iterate () from /lib/x86_64-linux-gnu/libpulse.so.0
#3  0x00007fdb1331f6b0 in pa_mainloop_run () from /lib/x86_64-linux-gnu/libpulse.so.0
#4  0x00000000018214cd in HotplugThread ()
#5  0x00000000017deacf in RunThread ()
#6  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#7  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 21 (Thread 0x7fdae7e006c0 (LWP 413726) "factorio:sh2"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e81a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e8148, cond=0x38e8178) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8178, mutex=0x38e8148) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 20 (Thread 0x7fdaf0c006c0 (LWP 413725) "factorio:sh1"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e81a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e8148, cond=0x38e8178) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8178, mutex=0x38e8148) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 19 (Thread 0x7fdaf16006c0 (LWP 413724) "factorio:gl0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3a8a7a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3a8a7a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3a8a7a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3a8a748, cond=0x3a8a778) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3a8a778, mutex=0x3a8a748) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 18 (Thread 0x7fdaf20006c0 (LWP 413723) "factorio:gdrv0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3a56860) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3a56860, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3a56860, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3a56808, cond=0x3a56838) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3a56838, mutex=0x3a56808) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 17 (Thread 0x7fdaf2a006c0 (LWP 413722) "factor:traceq0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3b15568) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3b15568, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3b15568, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3b15510, cond=0x3b15540) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3b15540, mutex=0x3b15510) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 16 (Thread 0x7fdaf34006c0 (LWP 413718) "factor:traceq0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x39befb8) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x39befb8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x39befb8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x39bef60, cond=0x39bef90) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x39bef90, mutex=0x39bef60) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 15 (Thread 0x7fdaf3e006c0 (LWP 413717) "factor:traceq0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x396e108) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x396e108, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x396e108, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x396e0b0, cond=0x396e0e0) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x396e0e0, mutex=0x396e0b0) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 14 (Thread 0x7fdaf90006c0 (LWP 413716) "factorio:shlo0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e8350) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e8350, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e82f8, cond=0x38e8328) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8328, mutex=0x38e82f8) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 13 (Thread 0x7fdaf9a006c0 (LWP 413715) "factorio:sh0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38e81a4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38e81a4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38e8148, cond=0x38e8178) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38e8178, mutex=0x38e8148) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 12 (Thread 0x7fdafa4006c0 (LWP 413714) "factori:disk$0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x395c188) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x395c188, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x395c188, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x395c130, cond=0x395c160) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x395c160, mutex=0x395c130) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 11 (Thread 0x7fdafae006c0 (LWP 413713) "factorio:cs0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x38d6cc4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x38d6cc4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x38d6cc4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x38d6c68, cond=0x38d6c98) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x38d6c98, mutex=0x38d6c68) at ./nptl/pthread_cond_wait.c:618
#5  0x00007fdb0631992d in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#6  0x00007fdb062f970b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#7  0x00007fdb0631985b in ?? () from /usr/lib/x86_64-linux-gnu/dri/radeonsi_dri.so
#8  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#9  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 10 (Thread 0x7fdb098006c0 (LWP 413710) "SDLTimer"):
#0  __futex_abstimed_wait_common64 (private=<optimized out>, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x36ff790) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x36ff790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=<optimized out>, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x36ff790, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=<optimized out>) at ./nptl/futex-internal.c:139
#3  0x00007fdb130bbadf in do_futex_wait (sem=sem@entry=0x36ff790, abstime=0x0, clockid=0) at ./nptl/sem_waitcommon.c:111
#4  0x00007fdb130bbb70 in __new_sem_wait_slow64 (sem=0x36ff790, abstime=0x0, clockid=0) at ./nptl/sem_waitcommon.c:183
#5  0x00000000017f6722 in SDL_TimerThread ()
#6  0x00000000017deacf in RunThread ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 9 (Thread 0x7fdb0a2006c0 (LWP 413709) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x35fac60) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x35fac60, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x35fac60, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x35fabf0, cond=0x35fac38) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x35fac38, mutex=0x35fabf0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 8 (Thread 0x7fdb0ac006c0 (LWP 413708) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3602ea0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3602ea0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3602ea0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3602e30, cond=0x3602e78) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3602e78, mutex=0x3602e30) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 7 (Thread 0x7fdb0b6006c0 (LWP 413707) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3629df4) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3629df4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3629df4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x3629d80, cond=0x3629dc8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3629dc8, mutex=0x3629d80) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 6 (Thread 0x7fdb0c0006c0 (LWP 413706) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x35e34a0) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x35e34a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x35e34a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x35e3430, cond=0x35e3478) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x35e3478, mutex=0x35e3430) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 5 (Thread 0x7fdb0ca006c0 (LWP 413705) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x35e9844) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x35e9844, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x35e9844, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x35e97d0, cond=0x35e9818) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x35e9818, mutex=0x35e97d0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 4 (Thread 0x7fdb0d4006c0 (LWP 413704) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x370f214) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x370f214, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x370f214, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x370f1a0, cond=0x370f1e8) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x370f1e8, mutex=0x370f1a0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 3 (Thread 0x7fdb0de006c0 (LWP 413703) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x3714834) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x3714834, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x3714834, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x37147c0, cond=0x3714808) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x3714808, mutex=0x37147c0) at ./nptl/pthread_cond_wait.c:618
#5  0x00000000013cccad in WorkerThread::loop() ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 2 (Thread 0x7fdb0e8006c0 (LWP 413702) "TaskManager"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x36bf150) at ./nptl/futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x36bf150, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at ./nptl/futex-internal.c:87
#2  0x00007fdb130b0d9b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x36bf150, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
#3  0x00007fdb130b33f8 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x36bf100, cond=0x36bf128) at ./nptl/pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x36bf128, mutex=0x36bf100) at ./nptl/pthread_cond_wait.c:618
#5  0x0000000001717f3b in std::thread::_State_impl<std::thread::_Invoker<std::tuple<TaskManager::TaskManager()::{lambda()#1}> > >::_M_run() [clone .lto_priv.0] ()
#6  0x0000000001f5215f in execute_native_thread_routine ()
#7  0x00007fdb130b3fd4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#8  0x00007fdb131345bc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 1 (Thread 0x7fdb12563140 (LWP 168135) "factorio"):
#0  __recvmsg_syscall (flags=0, msg=0x7ffc17e97b90, fd=58) at ../sysdeps/unix/sysv/linux/recvmsg.c:27
#1  __libc_recvmsg (fd=58, msg=0x7ffc17e97b90, flags=0) at ../sysdeps/unix/sysv/linux/recvmsg.c:41
#2  0x00007fdb136f4fb8 in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#3  0x00007fdb136f5d86 in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#4  0x00007fdb136f6712 in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#5  0x00007fdb136f823c in ?? () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#6  0x00007fdb136e7a55 in glXSwapBuffers () from /home/xani/.steam/ubuntu12_64/gameoverlayrenderer.so
#7  0x00000000018a68d6 in X11_GL_SwapWindow ()
#8  0x0000000000c27fe6 in GraphicsInterfaceOpenGL::swapBuffers() ()
#9  0x0000000000beefd6 in SDLWindow::swap() const ()
#10 0x0000000001745982 in GlobalContext::swapRenderBuffers() [clone .part.0] ()
#11 0x00000000007cb605 in MainLoop::run(Filesystem::Path const&, Filesystem::Path const&, bool, bool, std::function<void ()>, Filesystem::Path const&, MainLoop::HeavyMode) ()
#12 0x0000000000616ea9 in main ()
It looks like the main thread is hanging in the Steam overlay render process, which looks similar to this issue.
Don't forget, you're here forever.
Top
XANi
Burner Inserter
Burner Inserter
Posts: 10
Joined: Tue Jun 11, 2019 4:44 pm
Contact:
Contact XANi

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by XANi »

I my case the steam overlay was enabled but not in use at the time of the freeze.

I had them both when actively playing and when the window was alt+tabbed.

I guess I'll try to disable the overlay to see whether it's still happening but it's so rare it will be hard to get something conclusive, since I posted the crash I only had it happen once despise playing for good few dozen hours.
Top
ctrom
Manual Inserter
Manual Inserter
Posts: 3
Joined: Sat Jun 29, 2024 6:19 pm
Contact:
Contact ctrom

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by ctrom »

I have experienced this "stopped responding" issue several times although very infrequently. Based on the comments in this thread, I've disabled the Steam overlay and will attempt to capture debug info if I see it happen again. Based on the timestamps, it appears to have stopped responding at about the time that the most recent autosave completed. I've attached the log for reference, just let me know if I should provide anything more.
Attachments
factorio-current.log
(6.2 KiB) Downloaded 27 times
Top
bothie
Manual Inserter
Manual Inserter
Posts: 4
Joined: Mon Jul 08, 2024 6:52 am
Contact:
Contact bothie

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by bothie »

I just run into this lockup again. Still using 1.1.100.

The saving process has terminated (zombie).

The main thread seems to be trying to read some status update from the saving process:

Code: Select all

#0  __GI___libc_read (nbytes=4, buf=0x7ffe412bcc68, fd=94) at ../sysdeps/unix/sysv/linux/read.c:26
#1  __GI___libc_read (fd=94, buf=0x7ffe412bcc68, nbytes=4) at ../sysdeps/unix/sysv/linux/read.c:24
#2  0x00000000007c373e in ChildProcessAgent::readPipe (this=0x5e, child=16313) at /tmp/factorio-build-S6mUHx/src/ChildProcessAgent.cpp:195
#3  0x00000000015fbaac in ChildProcessAgent::getProgress () at /tmp/factorio-build-S6mUHx/src/ChildProcessAgent.cpp:144
(...)
The pipe is open on fd 94 and 95, one being the writing side, the other the reading side:

Code: Select all

grep "" /proc/1671/fdinfo/9[45]
/proc/1671/fdinfo/94:pos:       0
/proc/1671/fdinfo/94:flags:     00
/proc/1671/fdinfo/94:mnt_id:    12
/proc/1671/fdinfo/94:ino:       3738555543
/proc/1671/fdinfo/95:pos:       0
/proc/1671/fdinfo/95:flags:     01
/proc/1671/fdinfo/95:mnt_id:    12
/proc/1671/fdinfo/95:ino:       3738555543
Now, the fix would be:
1. In the parent process, close the writing side of the pipe, so the writing side is open in the saving process only.
2. Then reading from the pipe, expect to read 0 bytes.

A simple C program to illustrate the difference:

Code: Select all

#include <errno.h>
#include <stdio.h>
#include <unistd.h>
#include <string.h>
#include <stdlib.h>
#include <stdbool.h>

void test(bool do_close) {
        int p[2];
        int r = pipe(p);
        if (r) {
                printf("pipe = %i: %s\n", r, strerror(errno));
                exit(2);
        }
        int f = fork();
        if (f < 0) {
                printf("fork: %s\n", strerror(errno));
                exit(2);
        }
        if (f) {
                // parent
                if (do_close) {
                        close(p[1]);
                }
                for (int i = 0; i < 5; ++i) {
                        int x;
                        printf("(%i): >>> read\n", getpid());
                        r = read(p[0], &x, sizeof(x));
                        printf("(%i): <<< read\n", getpid());
                        if (r != sizeof(x)) {
                                printf("(%i): read = %i: %s\n", getpid(), r, strerror(errno));
                                close(p[0]);
                                if (!do_close) {
                                        close(p[1]);
                                }
                                return;
                        }
                        printf("(%i): parent read %i\n", getpid(), x);
                }
                printf("(%i): parent: Loop ended\n", getpid());
        } else {
                // child
                for (int i = 0; i < 4; ++i) {
                        write(p[1], &i, sizeof(i));
                }
                printf("(%i): child: loop ended, terminating\n", getpid());
                exit(0);
        }
}

int main() {
        printf("(%i): Testing with closed write end in parent:\n", getpid());
        test(true);
        printf("(%i): Testing without closed write end in parent:\n", getpid());
        test(false);
}
Output will be something like this:

Code: Select all

(5517):  Testing with closed write end in parent:
(5517): >>> read
(5517): <<< read
(5517): parent read 0
(5517): >>> read
(5517): <<< read
(5517): parent read 1
(5517): >>> read
(5517): <<< read
(5517): parent read 2
(5517): >>> read
(5517): <<< read
(5517): parent read 3
(5517): >>> read
(5518): child: loop ended, terminating
(5517): <<< read
(5517): read = 0: Success
(5517): Testing without closed write end in parent:
(5517): >>> read
(5517): <<< read
(5517): parent read 0
(5517): >>> read
(5517): <<< read
(5517): parent read 1
(5517): >>> read
(5517): <<< read
(5517): parent read 2
(5517): >>> read
(5517): <<< read
(5517): parent read 3
(5517): >>> read
(5519): child: loop ended, terminating
Note that the parent hangs forever in run two. This seems to be exactly what happens to factorio.

This is the full stacktrace of the hanging factorio process:

Code: Select all

(gdb) thread apply all bt

Thread 31 (Thread 0x7f5e03fff6c0 (LWP 24315) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x577b334) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x577b334, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x577b334, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x577b2b8, cond=0x577b308) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x577b308, mutex=0x577b2b8) at pthread_cond_wait.c:618
#5  0x000000000123aa3f in PackagePathAdapter::readFile (this=0x577b290) at /tmp/factorio-build-S6mUHx/src/Package/PackagePathAdapter.cpp:117
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x14e94e50) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 30 (Thread 0x7f5e0affd6c0 (LWP 14456) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x1bd377b4) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x1bd377b4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x1bd377b4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x1bd37738, cond=0x1bd37788) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x1bd37788, mutex=0x1bd37738) at pthread_cond_wait.c:618
#5  0x000000000123aa3f in PackagePathAdapter::readFile (this=0x1bd37710) at /tmp/factorio-build-S6mUHx/src/Package/PackagePathAdapter.cpp:117
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0xb935250) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 29 (Thread 0x7f5e12ffd6c0 (LWP 32731) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7f5bc503b3a0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7f5bc503b3a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7f5bc503b3a0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7f5bc503b350, cond=0x7f5bc503b378) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7f5bc503b378, mutex=0x7f5bc503b350) at pthread_cond_wait.c:618
#5  0x0000000001134aa2 in MapGenerationHelper::consumeTasks (this=0x7f5bc503b350) at /tmp/factorio-build-S6mUHx/src/Map/MapGenerationHelper.cpp:154
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x7f5b73bd0390) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 28 (Thread 0x7f5e0a7fc6c0 (LWP 32270) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7f5bb3d4c4f0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7f5bb3d4c4f0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7f5bb3d4c4f0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7f5bb3d4c480, cond=0x7f5bb3d4c4c8) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7f5bb3d4c4c8, mutex=0x7f5bb3d4c480) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x7f5bb3d4c480) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x7f5bb3c27d00) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 27 (Thread 0x7f5e0bfff6c0 (LWP 32269) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7f5bb2f7b504) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7f5bb2f7b504, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7f5bb2f7b504, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7f5bb2f7b490, cond=0x7f5bb2f7b4d8) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7f5bb2f7b4d8, mutex=0x7f5bb2f7b490) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x7f5bb2f7b490) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x7f5bb3d4c290) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
--Type <RET> for more, q to quit, c to continue without paging--
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 26 (Thread 0x7f5e13fff6c0 (LWP 32268) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7f5ab853b490) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7f5ab853b490, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7f5ab853b490, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7f5ab853b420, cond=0x7f5ab853b468) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7f5ab853b468, mutex=0x7f5ab853b420) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x7f5ab853b420) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x7f5bb3c27d30) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 25 (Thread 0x7f5e09df86c0 (LWP 32267) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7f5abbfaa6d0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7f5abbfaa6d0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7f5abbfaa6d0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7f5abbfaa660, cond=0x7f5abbfaa6a8) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7f5abbfaa6a8, mutex=0x7f5abbfaa660) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x7f5abbfaa660) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x7f5bb3c27cd0) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 24 (Thread 0x7f5e0b7fe6c0 (LWP 32266) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7f5afb727714) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7f5afb727714, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7f5afb727714, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7f5afb7276a0, cond=0x7f5afb7276e8) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7f5afb7276e8, mutex=0x7f5afb7276a0) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x7f5afb7276a0) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x7f5abbfdab00) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 23 (Thread 0x7f5e08df66c0 (LWP 32265) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7f5ab8cfc0b0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7f5ab8cfc0b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7f5ab8cfc0b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7f5ab8cfc040, cond=0x7f5ab8cfc088) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7f5ab8cfc088, mutex=0x7f5ab8cfc040) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x7f5ab8cfc040) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x7f5abbfdaad0) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 22 (Thread 0x7f5deea676c0 (LWP 9006) "factorio:shlo2"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cd21ec) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cd21ec, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cd21ec, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cd2198, cond=0x2cd21c0) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cd21c0, mutex=0x2cd2198) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0xb9df020) at ../mesa-23.1.6/src/util/u_queue.c:290
--Type <RET> for more, q to quit, c to continue without paging--
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 21 (Thread 0x7f5e38f486c0 (LWP 9005) "factorio:shlo1"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cd21e8) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cd21e8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cd21e8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cd2198, cond=0x2cd21c0) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cd21c0, mutex=0x2cd2198) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x7f5e240043c0) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 20 (Thread 0x7f5e137fe6c0 (LWP 6368) "GameUpdate"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x7ffe412bd124) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x7ffe412bd124, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x7ffe412bd124, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7ffe412bd0b0, cond=0x7ffe412bd0f8) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x7ffe412bd0f8, mutex=0x7ffe412bd0b0) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x7ffe412bd0b0) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0xa0e88b0) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 19 (Thread 0x7f5e3bfff6c0 (LWP 1694) "SDLAudioP2"):
#0  0x00007f5e5a54c658 in __GI___poll (fds=0x35f20b0, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
#1  0x00007f5e5a71c929 in pa_mainloop_iterate (block=<optimized out>, retval=<optimized out>, m=0x35f1db0) at /usr/src/debug/media-sound/apulse-0.1.13-r2/apulse-0.1.13/src/apulse-mainloop.c:409
#2  pa_mainloop_iterate (m=0x35f1db0, block=<optimized out>, retval=<optimized out>) at /usr/src/debug/media-sound/apulse-0.1.13-r2/apulse-0.1.13/src/apulse-mainloop.c:398
#3  0x0000000001953d2d in PULSEAUDIO_PlayDevice (this=0x35f20b0) at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/audio/pulseaudio/SDL_pulseaudio.c:399
#4  0x000000000195cdff in SDL_RunAudio (devicep=0x35f14c0) at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/audio/SDL_audio.c:787
#5  0x000000000198634f in SDL_RunThread () at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/SDL_thread.c:305
#6  RunThread (data=0x35ec210) at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/pthread/SDL_systhread.c:77
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 18 (Thread 0x7f5e4bcc76c0 (LWP 1693) "PulseHotplug"):
#0  0x00007f5e5a54c658 in __GI___poll (fds=0x35f1110, nfds=1, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
#1  0x00007f5e5a71c929 in pa_mainloop_iterate (block=<optimized out>, retval=<optimized out>, m=0x35f0f80) at /usr/src/debug/media-sound/apulse-0.1.13-r2/apulse-0.1.13/src/apulse-mainloop.c:409
#2  pa_mainloop_iterate (m=0x35f0f80, block=<optimized out>, retval=<optimized out>) at /usr/src/debug/media-sound/apulse-0.1.13-r2/apulse-0.1.13/src/apulse-mainloop.c:398
#3  0x00007f5e5a71c96a in pa_mainloop_run (m=0x35f0f80, retval=0x0) at /usr/src/debug/media-sound/apulse-0.1.13-r2/apulse-0.1.13/src/apulse-mainloop.c:580
#4  0x000000000193b01d in HotplugThread (data=0x35f1110) at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/audio/pulseaudio/SDL_pulseaudio.c:841
#5  0x000000000198634f in SDL_RunThread () at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/SDL_thread.c:305
#6  RunThread (data=0x35f1280) at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/pthread/SDL_systhread.c:77
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 17 (Thread 0x7f5e411f56c0 (LWP 1692) "factorio:sh3"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cd1c80) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cd1c80, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cd1c80, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cd1c30, cond=0x2cd1c58) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cd1c58, mutex=0x2cd1c30) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
--Type <RET> for more, q to quit, c to continue without paging--
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x7f5e3007f1d0) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 16 (Thread 0x7f5e419f66c0 (LWP 1691) "factorio:sh2"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cd1c80) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cd1c80, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cd1c80, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cd1c30, cond=0x2cd1c58) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cd1c58, mutex=0x2cd1c30) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x7f5e30018120) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 15 (Thread 0x7f5e421f76c0 (LWP 1690) "factorio:sh1"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cd1c84) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cd1c84, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cd1c84, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cd1c30, cond=0x2cd1c58) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cd1c58, mutex=0x2cd1c30) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x7f5e30026d40) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 14 (Thread 0x7f5e42bf96c0 (LWP 1689) "factorio:gl0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2e389e8) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2e389e8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2e389e8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2e38998, cond=0x2e389c0) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2e389c0, mutex=0x2e38998) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x2e88210) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 13 (Thread 0x7f5e433fa6c0 (LWP 1688) "factorio:gdrv0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2e04abc) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2e04abc, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2e04abc, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2e04a68, cond=0x2e04a90) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2e04a90, mutex=0x2e04a68) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x2beda40) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 12 (Thread 0x7f5e43fff6c0 (LWP 1685) "factorio:shlo0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cd21e8) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cd21e8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cance--Type <RET> for more, q to quit, c to continue without paging--
l@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cd21e8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cd2198, cond=0x2cd21c0) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cd21c0, mutex=0x2cd2198) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x2d44f00) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 11 (Thread 0x7f5e489fd6c0 (LWP 1684) "factorio:sh0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cd1c80) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cd1c80, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cd1c80, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cd1c30, cond=0x2cd1c58) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cd1c58, mutex=0x2cd1c30) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x2d44ca0) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 10 (Thread 0x7f5e491fe6c0 (LWP 1683) "factori:disk$0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2d449e0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2d449e0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2d449e0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2d44990, cond=0x2d449b8) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2d449b8, mutex=0x2d44990) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x2d45d60) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 9 (Thread 0x7f5e499ff6c0 (LWP 1682) "factorio:cs0"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2cc07c8) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2cc07c8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2cc07c8, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2cc0778, cond=0x2cc07a0) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2cc07a0, mutex=0x2cc0778) at pthread_cond_wait.c:618
#5  0x00007f5e54dc1199 in cnd_wait (cond=<optimized out>, mtx=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:135
#6  0x00007f5e54ca1c63 in util_queue_thread_func (input=input@entry=0x2cbea00) at ../mesa-23.1.6/src/util/u_queue.c:290
#7  0x00007f5e54dc10d7 in impl_thrd_routine (p=<optimized out>) at ../mesa-23.1.6/src/c11/impl/threads_posix.c:67
#8  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#9  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 8 (Thread 0x7f5e570ce6c0 (LWP 1681) "SDLTimer"):
#0  __futex_abstimed_wait_common64 (private=<optimized out>, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2aa8fa0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2aa8fa0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=<optimized out>, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2aa8fa0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=<optimized out>) at futex-internal.c:139
#3  0x00007f5e5a4e27cf in do_futex_wait (sem=sem@entry=0x2aa8fa0, abstime=0x0, clockid=0) at /var/tmp/portage/portage/sys-libs/glibc-2.37-r3/work/glibc-2.37/nptl/sem_waitcommon.c:111
#4  0x00007f5e5a4e2860 in __new_sem_wait_slow64 (sem=0x2aa8fa0, abstime=0x0, clockid=0) at /var/tmp/portage/portage/sys-libs/glibc-2.37-r3/work/glibc-2.37/nptl/sem_waitcommon.c:183
#5  0x0000000001983232 in SDL_SemWait () at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/pthread/SDL_syssem.c:95
#6  SDL_SemWaitTimeout () at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/pthread/SDL_syssem.c:126
#7  SDL_TimerThread (_data=0x0) at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/timer/SDL_timer.c:203
--Type <RET> for more, q to quit, c to continue without paging--
#8  0x000000000198634f in SDL_RunThread () at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/SDL_thread.c:305
#9  RunThread (data=0x2aa8fd0) at /tmp/factorio-build-S6mUHx/libraries/SDL2/src/thread/pthread/SDL_systhread.c:77
#10 0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#11 0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 7 (Thread 0x7f5e578cf6c0 (LWP 1680) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2aa99b0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2aa99b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2aa99b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa9940, cond=0x2aa9988) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2aa9988, mutex=0x2aa9940) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x2aa9940) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x2a78650) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 6 (Thread 0x7f5e580d06c0 (LWP 1679) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2ab7a54) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2ab7a54, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2ab7a54, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2ab79e0, cond=0x2ab7a28) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2ab7a28, mutex=0x2ab79e0) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x2ab79e0) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x2a784d0) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 5 (Thread 0x7f5e588d16c0 (LWP 1678) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2ab9da0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2ab9da0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2ab9da0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2ab9d30, cond=0x2ab9d78) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2ab9d78, mutex=0x2ab9d30) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x2ab9d30) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x2a78320) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 4 (Thread 0x7f5e590d26c0 (LWP 1677) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2ac21b4) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2ac21b4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2ac21b4, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2ac2140, cond=0x2ac2188) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2ac2188, mutex=0x2ac2140) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x2ac2140) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x2a781a0) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 3 (Thread 0x7f5e598d36c0 (LWP 1676) "factorio"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2ac78b0) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2ac78b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2ac78b0, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2ac7840, cond=0x2ac7888) at pthread_cond_wait.c:503
--Type <RET> for more, q to quit, c to continue without paging--
#4  ___pthread_cond_wait (cond=0x2ac7888, mutex=0x2ac7840) at pthread_cond_wait.c:618
#5  0x00000000014edb4d in WorkerThread::loop (this=0x2ac7840) at /tmp/factorio-build-S6mUHx/src/Util/WorkerThread.cpp:67
#6  0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x2a78020) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#7  0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#8  0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 2 (Thread 0x7f5e5a1076c0 (LWP 1675) "TaskManager"):
#0  __futex_abstimed_wait_common64 (private=0, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x2a6fd60) at futex-internal.c:57
#1  __futex_abstimed_wait_common (futex_word=futex_word@entry=0x2a6fd60, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0, cancel=cancel@entry=true) at futex-internal.c:87
#2  0x00007f5e5a4d7c0b in __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x2a6fd60, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at futex-internal.c:139
#3  0x00007f5e5a4da280 in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2a6fd10, cond=0x2a6fd38) at pthread_cond_wait.c:503
#4  ___pthread_cond_wait (cond=0x2a6fd38, mutex=0x2a6fd10) at pthread_cond_wait.c:618
#5  0x0000000001889e9b in TaskManager::run () at /tmp/factorio-build-S6mUHx/src/Util/TaskManager.cpp:68
#6  operator() () at /tmp/factorio-build-S6mUHx/src/Util/TaskManager.cpp:12
#7  __invoke_impl<void, TaskManager::TaskManager()::<lambda()> > () at /opt/gcc-12.2.0/include/c++/12.2.0/bits/invoke.h:61
#8  __invoke<TaskManager::TaskManager()::<lambda()> > () at /opt/gcc-12.2.0/include/c++/12.2.0/bits/invoke.h:96
#9  _M_invoke<0> () at /opt/gcc-12.2.0/include/c++/12.2.0/bits/std_thread.h:252
#10 operator() () at /opt/gcc-12.2.0/include/c++/12.2.0/bits/std_thread.h:259
#11 _M_run (this=0x2a735a0) at /opt/gcc-12.2.0/include/c++/12.2.0/bits/std_thread.h:210
#12 0x00000000020b3e2f in std::execute_native_thread_routine (__p=0x2a735a0) at /tmp/tmp.muiMGHWJQ4/objdir/../gcc-12.2.0/libstdc++-v3/src/c++11/thread.cc:82
#13 0x00007f5e5a4dae54 in start_thread (arg=<optimized out>) at pthread_create.c:444
#14 0x00007f5e5a5593dc in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Thread 1 (Thread 0x7f5e5aa7d540 (LWP 1671) "factorio"):
#0  __GI___libc_read (nbytes=4, buf=0x7ffe412bcc68, fd=94) at ../sysdeps/unix/sysv/linux/read.c:26
#1  __GI___libc_read (fd=94, buf=0x7ffe412bcc68, nbytes=4) at ../sysdeps/unix/sysv/linux/read.c:24
#2  0x00000000007c373e in ChildProcessAgent::readPipe (this=0x5e, child=16313) at /tmp/factorio-build-S6mUHx/src/ChildProcessAgent.cpp:195
#3  0x00000000015fbaac in ChildProcessAgent::getProgress () at /tmp/factorio-build-S6mUHx/src/ChildProcessAgent.cpp:144
#4  operator() () at /tmp/factorio-build-S6mUHx/src/Scenario/AsyncScenarioSaver.cpp:184
#5  __invoke_impl<float, AsyncScenarioSaver::makeInfoBoxConnector(InfoBoxManager*)::<lambda()>&> () at /opt/gcc-12.2.0/include/c++/12.2.0/bits/invoke.h:61
#6  __invoke_r<float, AsyncScenarioSaver::makeInfoBoxConnector(InfoBoxManager*)::<lambda()>&> () at /opt/gcc-12.2.0/include/c++/12.2.0/bits/invoke.h:114
#7  _M_invoke (__functor=...) at /opt/gcc-12.2.0/include/c++/12.2.0/bits/std_function.h:290
#8  0x0000000000e007cd in std::function<float ()>::operator()() const () at /opt/gcc-12.2.0/include/c++/12.2.0/bits/std_function.h:591
#9  ProgressInfoBoxConnector::update (this=0xa6c80a0) at /tmp/factorio-build-S6mUHx/src/Gui/InfoBoxConnector.cpp:77
#10 0x0000000000e0845a in InfoBoxManager::removeConnectorsToBeDestroyed () at /tmp/factorio-build-S6mUHx/src/Gui/InfoBoxManager.cpp:38
#11 InfoBoxManager::update (this=0xa6aa560) at /tmp/factorio-build-S6mUHx/src/Gui/InfoBoxManager.cpp:10
#12 0x000000000089d95e in MainLoop::prepare () at /tmp/factorio-build-S6mUHx/src/MainLoop.cpp:1118
#13 0x000000000088b519 in MainLoop::mainLoopStep () at /tmp/factorio-build-S6mUHx/src/MainLoop.cpp:715
#14 MainLoop::run(Filesystem::Path const&, Filesystem::Path const&, bool, bool, std::function<void ()>, Filesystem::Path const&, MainLoop::HeavyMode) (execPath=..., configPath=..., rotateLogs=4, headlessMode=164, afterInit=<error reading variable: Cannot access memory at address 0x1>, saveAs=..., heavyMode=(unknown: 0xfffffe00)) at /tmp/factorio-build-S6mUHx/src/MainLoop.cpp:423
#15 0x00000000006e5ee0 in main (argc=1, argv=0x7ffe412c10d8) at /tmp/factorio-build-S6mUHx/src/Main.cpp:1267
(gdb)
Top
calumapplepie
Manual Inserter
Manual Inserter
Posts: 1
Joined: Fri Aug 09, 2024 2:23 pm
Contact:
Contact calumapplepie

Re: [raiguard][1.1.91][linux] "stopped responding" when saving bar was full. (non-blocking save)

Post by calumapplepie »

The core method (of using fork() to get a separate process with the same memory map and then doing the save in that process) is pretty risky. You need to make sure that no locks are held by any thread other than the one calling fork() at the time of the fork. This include locks buried in library code; malloc() might try to acquire locks.

See, for instance: http://www.doublersolutions.com/docs/dc ... pde193.htm

The method that site advances is to do a mass cancel of all threads, then restart them. I suspect having threads lock in a state where they don’t hold any locks might work as well. Other sites point out that there are pthread() calls that are used to run code around a fork; these are what glibc uses to make its malloc() multithreaded-fork safe. Note that malloc does not inherently have that property according to POSIX. The same is true for most library code; unless it was specifically designed to support forking, multithreaded code will break.

Check that your malloc supports forking as well as multithreading.
Top
Post Reply

Return to “Pending”