Result of trunk_asan@ruby-sp1 at 2024-07-19 15:15:15 +0900

OK (6428ce80f0)[LOG]
test-all: 33483 tests, 6465285 assertions, 0 failures, 0 errors, 360 skips
test-spec: 3432 files, 32772 examples, 133814 expectations, 0 failures, 0 errors, 0 tagged

commands:

 "make update-download -j16" exit with 0.
"make update-src      -j16" exit with 0.
"make after-update    -j16" exit with 0.
"make miniruby -j16" exit with 0.
"make ruby -j16" exit with 0.
"make all -j16" exit with 0.
"make install -j16" exit with 0.
"make yes-btest TESTOPTS='-q -j16'" exit with 512.
$$$ #<Timeout::Error: execution expired>
### enter analyzing mode for stuck processes
$$$ ps jx
   PPID     PID    PGID     SID TTY        TPGID STAT   UID   TIME COMMAND
      1     947     947     947 ?             -1 Ss    1000   0:01 SCREEN -d -m dash -c cd build-ruby; BUILD_RUBY_WORKING_DIR=/tmp/ruby sh build-loop.sh trunk_asan --incremental
    947     957     957     957 pts/0        957 Ss+   1000   0:00 dash -c cd build-ruby; BUILD_RUBY_WORKING_DIR=/tmp/ruby sh build-loop.sh trunk_asan --incremental
    957     958     957     957 pts/0        957 S+    1000   0:00 sh build-loop.sh trunk_asan --incremental
      1  924644     957     957 pts/0        957 Rl+   1000 3666:01 /tmp/ruby/build/trunk_asan/ruby
      1 2109098 2109098 2109098 ?             -1 Ss    1000   0:00 /usr/lib/systemd/systemd --user
2109098 2109100 2109098 2109098 ?             -1 S     1000   0:00 (sd-pam)
2109044 2109233 2109044 2109044 ?             -1 S     1000   0:00 sshd: ko1@pts/1
2109233 2109240 2109240 2109240 pts/1    2109240 Ss+   1000   0:00 -bash
    958 3668465     957     957 pts/0        957 Sl+   1000   0:00 ruby ./br.rb build_report trunk_asan --incremental
3668465 3668468     957     957 pts/0        957 S+    1000   0:00 sh -c ruby /home/ko1/build-ruby/build-ruby.rb --target_name=trunk_asan --logfile=/home/ko1/ruby/logs/brlog.trunk_asan.20240719-060055 --root_dir=/tmp/ruby --timeout=600 --no-timeout-error --configure_opts="'CC=clang-17' 'cflags=-fsanitize=address -fno-omit-frame-pointer -DUSE_MN_THREADS=0'" --incremental
3668468 3668469     957     957 pts/0        957 Sl+   1000   0:00 ruby /home/ko1/build-ruby/build-ruby.rb --target_name=trunk_asan --logfile=/home/ko1/ruby/logs/brlog.trunk_asan.20240719-060055 --root_dir=/tmp/ruby --timeout=600 --no-timeout-error --configure_opts='CC=clang-17' 'cflags=-fsanitize=address -fno-omit-frame-pointer -DUSE_MN_THREADS=0' --incremental
3668469 3669366     957     957 pts/0        957 S+    1000   0:00 sh -c make yes-btest TESTOPTS='-q -j16'
3669366 3669367     957     957 pts/0        957 S+    1000   0:00 make yes-btest TESTOPTS=-q -j16
3669367 3669382     957     957 pts/0        957 Sl+   1000   0:03 /usr/bin/ruby --disable=gems /tmp/ruby/src/trunk_asan/bootstraptest/runner.rb --ruby=./miniruby -I/tmp/ruby/src/trunk_asan/lib -I. -I.ext/common  -r./x86_64-linux-fake --disable-gems -q -j16
      1 3675541     957     957 pts/0        957 Sl+   1000   0:00 /tmp/ruby/build/trunk_asan/miniruby -I/tmp/ruby/src/trunk_asan/lib -I/tmp/ruby/build/trunk_asan -I/tmp/ruby/build/trunk_asan/.ext/common -r/tmp/ruby/build/trunk_asan/x86_64-linux-fake --disable-gems -W0 bootstraptest.test_thread.rb_449_1586.rb
3668469 3710111     957     957 pts/0        957 R+    1000   0:00 ps jx
{1=>[947, 924644, 2109098, 3675541], 947=>[957], 957=>[958], 2109098=>[2109100], 2109044=>[2109233], 2109233=>[2109240], 958=>[3668465], 3668465=>[3668468], 3668468=>[3668469], 3668469=>[3669366, 3710111], 3669366=>[3669367], 3669367=>[3669382]}
$ timeout 60 gdb -p 3669382 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
[New LWP 3669426]
[New LWP 3669388]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
0x00007a5c08f1ba00 in __GI_ppoll (fds=0x7ffdf7e06928, nfds=1, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
>>> Threads
  Id   Target Id                                           Frame 
* 1    Thread 0x7a5c09620740 (LWP 3669382) "ruby"          0x00007a5c08f1ba00 in __GI_ppoll (fds=0x7ffdf7e06928, nfds=1, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
  2    Thread 0x7a5bf1a006c0 (LWP 3669426) "runner.rb:519" 0x00007a5c08f1b4cd in __GI___poll (fds=0x7a5bf18ff180, nfds=1, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
  3    Thread 0x7a5c02a006c0 (LWP 3669388) "runner.rb:322" 0x00007a5c08e98d61 in __futex_abstimed_wait_common64 (private=31324, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x5a2c4f95ffdc) at ./nptl/futex-internal.c:57
>>> Machine level backtrace
Thread 3 (Thread 0x7a5c02a006c0 (LWP 3669388) "runner.rb:322"):
#0  0x00007a5c08e98d61 in __futex_abstimed_wait_common64 (private=31324, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x5a2c4f95ffdc) at ./nptl/futex-internal.c:57
        sc_cancel_oldtype = 0
        sc_ret = <optimized out>
        resultvar = <optimized out>
        __arg6 = <optimized out>
        __arg5 = <optimized out>
        __arg4 = <optimized out>
        __arg3 = <optimized out>
        __arg2 = <optimized out>
        __arg1 = <optimized out>
        _a6 = <optimized out>
        _a5 = <optimized out>
        _a4 = <optimized out>
        _a3 = <optimized out>
        _a2 = <optimized out>
        _a1 = <optimized out>
#1  __futex_abstimed_wait_common (cancel=true, private=31324, abstime=0x0, clockid=0, expected=0, futex_word=0x5a2c4f95ffdc) at ./nptl/futex-internal.c:87
        err = <optimized out>
        clockbit = 256
        op = 393
        err = <optimized out>
        clockbit = <optimized out>
        op = <optimized out>
#2  __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x5a2c4f95ffdc, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
No locals.
#3  0x00007a5c08e9b7dd in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x5a2c4f91b5b0, cond=0x5a2c4f95ffb0) at ./nptl/pthread_cond_wait.c:503
        spin = 0
        buffer = {__routine = 0x7a5c08e9b4a0 <__condvar_cleanup_waiting>, __arg = 0x7a5c028ff370, __canceltype = 129151188, __prev = 0x0}
        cbuffer = {wseq = 367, cond = 0x5a2c4f95ffb0, mutex = 0x5a2c4f91b5b0, private = 0}
        err = <optimized out>
        g = 1
        flags = <optimized out>
        g1_start = <optimized out>
        maxspin = 0
        signals = <optimized out>
        result = 0
        wseq = 367
        seq = 183
        private = 0
        maxspin = <optimized out>
        err = <optimized out>
        result = <optimized out>
        wseq = <optimized out>
        g = <optimized out>
        seq = <optimized out>
        flags = <optimized out>
        private = <optimized out>
        signals = <optimized out>
        done = <optimized out>
        g1_start = <optimized out>
        spin = <optimized out>
        buffer = <optimized out>
        cbuffer = <optimized out>
        s = <optimized out>
#4  ___pthread_cond_wait (cond=0x5a2c4f95ffb0, mutex=0x5a2c4f91b5b0) at ./nptl/pthread_cond_wait.c:627
No locals.
#5  0x00007a5c0940fced in rb_native_cond_wait () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#6  0x00007a5c0941189c in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#7  0x00007a5c09411992 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#8  0x00007a5c0941679c in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#9  0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#10 0x00007a5c0940bf21 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#11 0x00007a5c0940bfcb in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#12 0x00007a5c0944d8f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#13 0x00007a5c094500ff in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#14 0x00007a5c094531c2 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#15 0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#16 0x00007a5c0945c7ae in rb_vm_invoke_proc () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#17 0x00007a5c09414a6f in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#18 0x00007a5c09414f61 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#19 0x00007a5c09415836 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#20 0x00007a5c08e9ca94 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
        ret = <optimized out>
        pd = <optimized out>
        out = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {134535599621824, 7110142500779325620, 134535599621824, -136, 22, 140728762128624, 7110142500791908532, 7110154679948015796}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
#21 0x00007a5c08f29c3c in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:78
No locals.
Thread 2 (Thread 0x7a5bf1a006c0 (LWP 3669426) "runner.rb:519"):
#0  0x00007a5c08f1b4cd in __GI___poll (fds=0x7a5bf18ff180, nfds=1, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
        sc_ret = -516
        sc_cancel_oldtype = 0
        sc_ret = <optimized out>
#1  0x00007a5c092e763f in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#2  0x00007a5c092e85d9 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#3  0x00007a5c09414563 in rb_thread_io_blocking_region () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#4  0x00007a5c092e89be in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#5  0x00007a5c092edbf9 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#6  0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#7  0x00007a5c092e90f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#8  0x00007a5c092ed0f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#9  0x00007a5c092f0626 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#10 0x00007a5c0944d8f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#11 0x00007a5c094500ff in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#12 0x00007a5c094531c2 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#13 0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#14 0x00007a5c0945c7ae in rb_vm_invoke_proc () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#15 0x00007a5c09414a6f in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#16 0x00007a5c09414f61 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#17 0x00007a5c09415836 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#18 0x00007a5c08e9ca94 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
        ret = <optimized out>
        pd = <optimized out>
        out = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {134535314409152, 7107712580081940660, 134535314409152, -136, 22, 134535590179360, 7107712580094523572, 7110154679948015796}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
        not_first_call = <optimized out>
#19 0x00007a5c08f29c3c in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:78
No locals.
Thread 1 (Thread 0x7a5c09620740 (LWP 3669382) "ruby"):
#0  0x00007a5c08f1ba00 in __GI_ppoll (fds=0x7ffdf7e06928, nfds=1, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
        sc_ret = -514
        sc_cancel_oldtype = 0
        sc_ret = <optimized out>
        tval = {tv_sec = 140728762132976, tv_nsec = 134535710830873}
#1  0x00007a5c094109e9 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#2  0x00007a5c09411aa1 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#3  0x00007a5c094142c2 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#4  0x00007a5c09415a65 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#5  0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#6  0x00007a5c09410eab in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#7  0x00007a5c09453428 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#8  0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#9  0x00007a5c0945c287 in rb_yield () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#10 0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#11 0x00007a5c092952a6 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#12 0x00007a5c0944d8f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#13 0x00007a5c094500ff in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#14 0x00007a5c094545dc in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#15 0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#16 0x00007a5c092b4e5c in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#17 0x00007a5c092b9193 in ruby_run_node () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
No symbol table info available.
#18 0x00005a2c4f2ce187 in ?? ()
No symbol table info available.
#19 0x00007a5c08e2a1ca in __libc_start_call_main (main=main@entry=0x5a2c4f2ce120, argc=argc@entry=6, argv=argv@entry=0x7ffdf7e077f8) at ../sysdeps/nptl/libc_start_call_main.h:58
        self = <optimized out>
        result = <optimized out>
        unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140728762136568, 7633502489611598004, 6, 0, 99146353413440, 134535714177024, 7633502489630472372, 7110154755988125876}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x6, 0x7ffdf7e077f0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 6}}}
        not_first_call = <optimized out>
#20 0x00007a5c08e2a28b in __libc_start_main_impl (main=0x5a2c4f2ce120, argc=6, argv=0x7ffdf7e077f8, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffdf7e077e8) at ../csu/libc-start.c:360
No locals.
#21 0x00005a2c4f2ce1d5 in _start ()
No symbol table info available.
>>> Dump Ruby level backtrace (if possible)
[Inferior 1 (process 3669382) detached]
$ timeout 60 gdb -p 3669367 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
 make: *** [uncommon.mk:898: yes-btest] Killed
>>> Threads
No threads.
>>> Machine level backtrace
>>> Dump Ruby level backtrace (if possible)
#<Errno::ESRCH: No such process>
$ timeout 60 gdb -p 3669366 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
Could not attach to process.  If your uid matches the uid of the target
process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try
again as the root user.  For more details, see /etc/sysctl.d/10-ptrace.conf
>>> Threads
No threads.
>>> Machine level backtrace
>>> Dump Ruby level backtrace (if possible)
$ timeout 60 gdb -p 3710111 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
>>> Threads
No threads.
>>> Machine level backtrace
>>> Dump Ruby level backtrace (if possible)
#<Errno::ESRCH: No such process>
"make yes-test-basic TESTS='-j16'" exit with 0.
"make yes-test-all TESTOPTS='--stderr-on-failure' TESTS='-j16'" exit with 0.
"make yes-test-rubyspec MSPECOPT='--error-output stderr -j' TESTS='-j16'" exit with 0.

Linux ruby-sp1 6.8.0-38-generic #38-Ubuntu SMP PREEMPT_DYNAMIC Fri Jun  7 15:25:01 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Logfile: /home/ko1/ruby/logs/brlog.trunk_asan.20240719-060055
#<BuildRuby:0x0000720d681efdd8
 @BUILD_DIR="/tmp/ruby/build",
 @INSTALL_DIR="/tmp/ruby/install",
 @REPOSITORY="https://github.com/ruby/ruby.git",
 @REPOSITORY_TYPE=:git,
 @SRC_DIR="/tmp/ruby/src",
 @TARGET_BUILD_DIR="/tmp/ruby/build/trunk_asan",
 @TARGET_INSTALL_DIR="/tmp/ruby/install/trunk_asan",
 @TARGET_NAME="trunk_asan",
 @TARGET_SRC_DIR="/tmp/ruby/src/trunk_asan",
 @btest_opts="-j16",
 @build_opts="-j16",
 @configure_opts=
  ["'CC=clang-17' 'cflags=-fsanitize=address -fno-omit-frame-pointer -DUSE_MN_THREADS=0'"],
 @gist=false,
 @git_branch=nil,
 @git_worktree=nil,
 @incremental=true,
 @logfile="/home/ko1/ruby/logs/brlog.trunk_asan.20240719-060055",
 @make="make",
 @no_timeout_error=true,
 @quiet=false,
 @ruby_env=[["RUBY_DEBUG", "ci"]],
 @spec_opts="-j",
 @steps=
  ["checkout",
   "autoconf",
   "configure",
   "build_up",
   "build_miniruby",
   "build_ruby",
   "build_all",
   "build_install",
   "test_btest",
   "test_basic",
   "test_all",
   "test_rubyspec"],
 @svn_revision=nil,
 @test_opts="TESTS='-j16'",
 @timeout=600>
                           user     system      total        real
checkout               0.000007   0.000003   0.000010 (  0.000010)
autoconf               0.000015   0.000005   0.000020 (  0.000019)
configure              0.000011   0.000003   0.000014 (  0.000014)
build_up               0.001778   0.003914   1.658954 (  1.992978)
build_miniruby         0.000463   0.000792   0.812404 (  0.810708)
build_ruby             0.000318   0.001114   1.530025 (  1.528599)
build_all              0.002277   0.003107  17.526958 (  2.344463)
build_install          0.008598   0.003699  19.704370 (  4.108771)
test_btest             0.003244   0.003636 403.484249 (600.313550)
test_basic             0.002091   0.003133   1.175331 (  1.229516)
test_all               0.141534   0.055913 1982.180716 (198.046072)
test_rubyspec          0.055860   0.057758 540.972641 ( 49.035053)
total: 859.41 sec

	"make update-download -j16" exit with 0.
	"make update-src -j16" exit with 0.
	"make after-update -j16" exit with 0.
	"make miniruby -j16" exit with 0.
	"make ruby -j16" exit with 0.
	"make all -j16" exit with 0.
	"make install -j16" exit with 0.
	"make yes-btest TESTOPTS='-q -j16'" exit with 512.
	$$$ #<Timeout::Error: execution expired>
	### enter analyzing mode for stuck processes
	$$$ ps jx
	PPID PID PGID SID TTY TPGID STAT UID TIME COMMAND
	1 947 947 947 ? -1 Ss 1000 0:01 SCREEN -d -m dash -c cd build-ruby; BUILD_RUBY_WORKING_DIR=/tmp/ruby sh build-loop.sh trunk_asan --incremental
	947 957 957 957 pts/0 957 Ss+ 1000 0:00 dash -c cd build-ruby; BUILD_RUBY_WORKING_DIR=/tmp/ruby sh build-loop.sh trunk_asan --incremental
	957 958 957 957 pts/0 957 S+ 1000 0:00 sh build-loop.sh trunk_asan --incremental
	1 924644 957 957 pts/0 957 Rl+ 1000 3666:01 /tmp/ruby/build/trunk_asan/ruby
	1 2109098 2109098 2109098 ? -1 Ss 1000 0:00 /usr/lib/systemd/systemd --user
	2109098 2109100 2109098 2109098 ? -1 S 1000 0:00 (sd-pam)
	2109044 2109233 2109044 2109044 ? -1 S 1000 0:00 sshd: ko1@pts/1
	2109233 2109240 2109240 2109240 pts/1 2109240 Ss+ 1000 0:00 -bash
	958 3668465 957 957 pts/0 957 Sl+ 1000 0:00 ruby ./br.rb build_report trunk_asan --incremental
	3668465 3668468 957 957 pts/0 957 S+ 1000 0:00 sh -c ruby /home/ko1/build-ruby/build-ruby.rb --target_name=trunk_asan --logfile=/home/ko1/ruby/logs/brlog.trunk_asan.20240719-060055 --root_dir=/tmp/ruby --timeout=600 --no-timeout-error --configure_opts="'CC=clang-17' 'cflags=-fsanitize=address -fno-omit-frame-pointer -DUSE_MN_THREADS=0'" --incremental
	3668468 3668469 957 957 pts/0 957 Sl+ 1000 0:00 ruby /home/ko1/build-ruby/build-ruby.rb --target_name=trunk_asan --logfile=/home/ko1/ruby/logs/brlog.trunk_asan.20240719-060055 --root_dir=/tmp/ruby --timeout=600 --no-timeout-error --configure_opts='CC=clang-17' 'cflags=-fsanitize=address -fno-omit-frame-pointer -DUSE_MN_THREADS=0' --incremental
	3668469 3669366 957 957 pts/0 957 S+ 1000 0:00 sh -c make yes-btest TESTOPTS='-q -j16'
	3669366 3669367 957 957 pts/0 957 S+ 1000 0:00 make yes-btest TESTOPTS=-q -j16
	3669367 3669382 957 957 pts/0 957 Sl+ 1000 0:03 /usr/bin/ruby --disable=gems /tmp/ruby/src/trunk_asan/bootstraptest/runner.rb --ruby=./miniruby -I/tmp/ruby/src/trunk_asan/lib -I. -I.ext/common -r./x86_64-linux-fake --disable-gems -q -j16
	1 3675541 957 957 pts/0 957 Sl+ 1000 0:00 /tmp/ruby/build/trunk_asan/miniruby -I/tmp/ruby/src/trunk_asan/lib -I/tmp/ruby/build/trunk_asan -I/tmp/ruby/build/trunk_asan/.ext/common -r/tmp/ruby/build/trunk_asan/x86_64-linux-fake --disable-gems -W0 bootstraptest.test_thread.rb_449_1586.rb
	3668469 3710111 957 957 pts/0 957 R+ 1000 0:00 ps jx
	{1=>[947, 924644, 2109098, 3675541], 947=>[957], 957=>[958], 2109098=>[2109100], 2109044=>[2109233], 2109233=>[2109240], 958=>[3668465], 3668465=>[3668468], 3668468=>[3668469], 3668469=>[3669366, 3710111], 3669366=>[3669367], 3669367=>[3669382]}
	$ timeout 60 gdb -p 3669382 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
	[New LWP 3669426]
	[New LWP 3669388]
	[Thread debugging using libthread_db enabled]
	Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
	0x00007a5c08f1ba00 in __GI_ppoll (fds=0x7ffdf7e06928, nfds=1, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
	>>> Threads
	Id Target Id Frame
	* 1 Thread 0x7a5c09620740 (LWP 3669382) "ruby" 0x00007a5c08f1ba00 in __GI_ppoll (fds=0x7ffdf7e06928, nfds=1, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
	2 Thread 0x7a5bf1a006c0 (LWP 3669426) "runner.rb:519" 0x00007a5c08f1b4cd in __GI___poll (fds=0x7a5bf18ff180, nfds=1, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
	3 Thread 0x7a5c02a006c0 (LWP 3669388) "runner.rb:322" 0x00007a5c08e98d61 in __futex_abstimed_wait_common64 (private=31324, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x5a2c4f95ffdc) at ./nptl/futex-internal.c:57
	>>> Machine level backtrace
	Thread 3 (Thread 0x7a5c02a006c0 (LWP 3669388) "runner.rb:322"):
	#0 0x00007a5c08e98d61 in __futex_abstimed_wait_common64 (private=31324, cancel=true, abstime=0x0, op=393, expected=0, futex_word=0x5a2c4f95ffdc) at ./nptl/futex-internal.c:57
	sc_cancel_oldtype = 0
	sc_ret = <optimized out>
	resultvar = <optimized out>
	__arg6 = <optimized out>
	__arg5 = <optimized out>
	__arg4 = <optimized out>
	__arg3 = <optimized out>
	__arg2 = <optimized out>
	__arg1 = <optimized out>
	_a6 = <optimized out>
	_a5 = <optimized out>
	_a4 = <optimized out>
	_a3 = <optimized out>
	_a2 = <optimized out>
	_a1 = <optimized out>
	#1 __futex_abstimed_wait_common (cancel=true, private=31324, abstime=0x0, clockid=0, expected=0, futex_word=0x5a2c4f95ffdc) at ./nptl/futex-internal.c:87
	err = <optimized out>
	clockbit = 256
	op = 393
	err = <optimized out>
	clockbit = <optimized out>
	op = <optimized out>
	#2 __GI___futex_abstimed_wait_cancelable64 (futex_word=futex_word@entry=0x5a2c4f95ffdc, expected=expected@entry=0, clockid=clockid@entry=0, abstime=abstime@entry=0x0, private=private@entry=0) at ./nptl/futex-internal.c:139
	No locals.
	#3 0x00007a5c08e9b7dd in __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x5a2c4f91b5b0, cond=0x5a2c4f95ffb0) at ./nptl/pthread_cond_wait.c:503
	spin = 0
	buffer = {__routine = 0x7a5c08e9b4a0 <__condvar_cleanup_waiting>, __arg = 0x7a5c028ff370, __canceltype = 129151188, __prev = 0x0}
	cbuffer = {wseq = 367, cond = 0x5a2c4f95ffb0, mutex = 0x5a2c4f91b5b0, private = 0}
	err = <optimized out>
	g = 1
	flags = <optimized out>
	g1_start = <optimized out>
	maxspin = 0
	signals = <optimized out>
	result = 0
	wseq = 367
	seq = 183
	private = 0
	maxspin = <optimized out>
	err = <optimized out>
	result = <optimized out>
	wseq = <optimized out>
	g = <optimized out>
	seq = <optimized out>
	flags = <optimized out>
	private = <optimized out>
	signals = <optimized out>
	done = <optimized out>
	g1_start = <optimized out>
	spin = <optimized out>
	buffer = <optimized out>
	cbuffer = <optimized out>
	s = <optimized out>
	#4 ___pthread_cond_wait (cond=0x5a2c4f95ffb0, mutex=0x5a2c4f91b5b0) at ./nptl/pthread_cond_wait.c:627
	No locals.
	#5 0x00007a5c0940fced in rb_native_cond_wait () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#6 0x00007a5c0941189c in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#7 0x00007a5c09411992 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#8 0x00007a5c0941679c in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#9 0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#10 0x00007a5c0940bf21 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#11 0x00007a5c0940bfcb in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#12 0x00007a5c0944d8f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#13 0x00007a5c094500ff in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#14 0x00007a5c094531c2 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#15 0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#16 0x00007a5c0945c7ae in rb_vm_invoke_proc () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#17 0x00007a5c09414a6f in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#18 0x00007a5c09414f61 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#19 0x00007a5c09415836 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#20 0x00007a5c08e9ca94 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
	ret = <optimized out>
	pd = <optimized out>
	out = <optimized out>
	unwind_buf = {cancel_jmp_buf = {{jmp_buf = {134535599621824, 7110142500779325620, 134535599621824, -136, 22, 140728762128624, 7110142500791908532, 7110154679948015796}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
	not_first_call = <optimized out>
	#21 0x00007a5c08f29c3c in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:78
	No locals.
	Thread 2 (Thread 0x7a5bf1a006c0 (LWP 3669426) "runner.rb:519"):
	#0 0x00007a5c08f1b4cd in __GI___poll (fds=0x7a5bf18ff180, nfds=1, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
	sc_ret = -516
	sc_cancel_oldtype = 0
	sc_ret = <optimized out>
	#1 0x00007a5c092e763f in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#2 0x00007a5c092e85d9 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#3 0x00007a5c09414563 in rb_thread_io_blocking_region () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#4 0x00007a5c092e89be in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#5 0x00007a5c092edbf9 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#6 0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#7 0x00007a5c092e90f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#8 0x00007a5c092ed0f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#9 0x00007a5c092f0626 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#10 0x00007a5c0944d8f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#11 0x00007a5c094500ff in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#12 0x00007a5c094531c2 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#13 0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#14 0x00007a5c0945c7ae in rb_vm_invoke_proc () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#15 0x00007a5c09414a6f in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#16 0x00007a5c09414f61 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#17 0x00007a5c09415836 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#18 0x00007a5c08e9ca94 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
	ret = <optimized out>
	pd = <optimized out>
	out = <optimized out>
	unwind_buf = {cancel_jmp_buf = {{jmp_buf = {134535314409152, 7107712580081940660, 134535314409152, -136, 22, 134535590179360, 7107712580094523572, 7110154679948015796}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
	not_first_call = <optimized out>
	#19 0x00007a5c08f29c3c in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:78
	No locals.
	Thread 1 (Thread 0x7a5c09620740 (LWP 3669382) "ruby"):
	#0 0x00007a5c08f1ba00 in __GI_ppoll (fds=0x7ffdf7e06928, nfds=1, timeout=<optimized out>, sigmask=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:42
	sc_ret = -514
	sc_cancel_oldtype = 0
	sc_ret = <optimized out>
	tval = {tv_sec = 140728762132976, tv_nsec = 134535710830873}
	#1 0x00007a5c094109e9 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#2 0x00007a5c09411aa1 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#3 0x00007a5c094142c2 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#4 0x00007a5c09415a65 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#5 0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#6 0x00007a5c09410eab in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#7 0x00007a5c09453428 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#8 0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#9 0x00007a5c0945c287 in rb_yield () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#10 0x00007a5c092b7440 in rb_ensure () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#11 0x00007a5c092952a6 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#12 0x00007a5c0944d8f0 in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#13 0x00007a5c094500ff in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#14 0x00007a5c094545dc in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#15 0x00007a5c09457b3a in rb_vm_exec () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#16 0x00007a5c092b4e5c in ?? () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#17 0x00007a5c092b9193 in ruby_run_node () from /lib/x86_64-linux-gnu/libruby-3.2.so.3.2
	No symbol table info available.
	#18 0x00005a2c4f2ce187 in ?? ()
	No symbol table info available.
	#19 0x00007a5c08e2a1ca in __libc_start_call_main (main=main@entry=0x5a2c4f2ce120, argc=argc@entry=6, argv=argv@entry=0x7ffdf7e077f8) at ../sysdeps/nptl/libc_start_call_main.h:58
	self = <optimized out>
	result = <optimized out>
	unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140728762136568, 7633502489611598004, 6, 0, 99146353413440, 134535714177024, 7633502489630472372, 7110154755988125876}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x6, 0x7ffdf7e077f0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 6}}}
	not_first_call = <optimized out>
	#20 0x00007a5c08e2a28b in __libc_start_main_impl (main=0x5a2c4f2ce120, argc=6, argv=0x7ffdf7e077f8, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffdf7e077e8) at ../csu/libc-start.c:360
	No locals.
	#21 0x00005a2c4f2ce1d5 in _start ()
	No symbol table info available.
	>>> Dump Ruby level backtrace (if possible)
	[Inferior 1 (process 3669382) detached]
	$ timeout 60 gdb -p 3669367 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
	make: *** [uncommon.mk:898: yes-btest] Killed
	>>> Threads
	No threads.
	>>> Machine level backtrace
	>>> Dump Ruby level backtrace (if possible)
	#<Errno::ESRCH: No such process>
	$ timeout 60 gdb -p 3669366 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
	Could not attach to process. If your uid matches the uid of the target
	process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try
	again as the root user. For more details, see /etc/sysctl.d/10-ptrace.conf
	>>> Threads
	No threads.
	>>> Machine level backtrace
	>>> Dump Ruby level backtrace (if possible)
	$ timeout 60 gdb -p 3710111 -x /home/ko1/build-ruby/gdbscript -batch -quiet 2> /dev/null
	>>> Threads
	No threads.
	>>> Machine level backtrace
	>>> Dump Ruby level backtrace (if possible)
	#<Errno::ESRCH: No such process>
	"make yes-test-basic TESTS='-j16'" exit with 0.
	"make yes-test-all TESTOPTS='--stderr-on-failure' TESTS='-j16'" exit with 0.
	"make yes-test-rubyspec MSPECOPT='--error-output stderr -j' TESTS='-j16'" exit with 0.