Skip to content

[BUG] Hang in SRANDMEMBER call during CoW fork saving #12200

New issue
New issue
Closed
#12276
Closed
[BUG] Hang in SRANDMEMBER call during CoW fork saving#12200
#12276
@Fusl

Description

@Fusl
Fusl
opened on May 19, 2023

Our application uses Lua EVAL/EVALSHA to do most heavy lifting of logic that requires atomic database changes.
During normal operation, Redis has a seemingly random chance to hang during the (only) SRANDMEMBER call of our Lua code when performing a background save (using either RDB or AOF) where it doesn't recover from even after the background save finishes.
We're unable to determine a solid reproduction case at this point since we can't pinpoint exactly what's causing it yet but across multiple GDB backtraces (below) we believe that we were able to figure out that when Redis is hanging during the command call, it's always stuck in this while loop, although we're not 100% sure about that.

The version of Redis we're using is 7.0.11 running inside Docker with this configuration:

activedefrag yes
active-defrag-ignore-bytes 100mb
active-defrag-threshold-lower 10
active-defrag-threshold-upper 50
active-defrag-cycle-min 1
active-defrag-cycle-max 25
active-defrag-max-scan-fields 10000
lazyfree-lazy-eviction yes
lazyfree-lazy-expire yes
lazyfree-lazy-server-del yes
replica-lazy-flush yes
lazyfree-lazy-user-del yes
appendonly yes
auto-aof-rewrite-percentage 100
auto-aof-rewrite-min-size 1gb
client-output-buffer-limit slave 10737418240 1073741824 300
bind 0.0.0.0
port ${PORT}
requirepass ${PASS}
save ''
lua-time-limit 5000
busy-reply-threshold 5000

Note that while we have AOF configured here with RDB being disabled, we also tried running this Redis server with AOF disabled and RDB set to snapshot every 5 minutes after 1 change. We also tried explicitly setting lua-time-limit and busy-reply-threshold in the startup configuration as well as setting CONFIG SET watchdog-period 1000 during runtime but none of those has produced any usable logs at the time Redis became unresponsive.

Logs indicate that the hangs always happen during a background save:

AOF rewrite:

1:M 18 May 2023 12:46:34.929 * Starting automatic rewriting of AOF on 100% growth                                                                                          
1:M 18 May 2023 12:46:34.930 * Creating AOF incr file appendonly.aof.4377.incr.aof on background rewrite
1:M 18 May 2023 12:46:35.164 * Background append only file rewriting started by pid 59
<Redis became unresponsive at 12:47:23>
59:C 18 May 2023 12:47:37.119 * Successfully created the temporary AOF base file temp-rewriteaof-bg-59.aof
59:C 18 May 2023 12:47:37.260 * Fork CoW for AOF rewrite: current 1572 MB, peak 1572 MB, average 818 MB

AOF rewrite:

1:M 19 May 2023 02:08:38.075 * Starting automatic rewriting of AOF on 100% growth
1:M 19 May 2023 02:08:38.076 * Creating AOF incr file appendonly.aof.4385.incr.aof on background rewrite
1:M 19 May 2023 02:08:38.345 * Background append only file rewriting started by pid 25
<Redis became unresponsive at 02:08:50>
25:C 19 May 2023 02:10:04.373 * Successfully created the temporary AOF base file temp-rewriteaof-bg-25.aof
25:C 19 May 2023 02:10:04.591 * Fork CoW for AOF rewrite: current 605 MB, peak 605 MB, average 329 MB

RDB save:

1:M 19 May 2023 04:25:55.055 * 1 changes in 300 seconds. Saving...
1:M 19 May 2023 04:25:55.374 * Background saving started by pid 28
<Redis became unresponsive at 04:25:58>
28:C 19 May 2023 04:27:20.861 * DB saved on disk
28:C 19 May 2023 04:27:21.083 * Fork CoW for RDB: current 142 MB, peak 142 MB, average 96 MB

2023-05-18T13:02:50+00:00
#0  _dictKeyIndex (existing=0x0, hash=4486456289374595091, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1054
#1  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#2  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#3  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#4  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#5  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#6  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#7  0x0000558d683b9e88 in luaD_precall ()
#8  0x0000558d683c4110 in luaV_execute ()
#9  0x0000558d683ba525 in luaD_call ()
#10 0x0000558d683b9858 in luaD_rawrunprotected ()
#11 0x0000558d683ba6d0 in luaD_pcall ()
#12 0x0000558d683b79f8 in lua_pcall ()
#13 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#14 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#15 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#16 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#17 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#18 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#19 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#20 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#21 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#22 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#23 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#24 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:02:56+00:00
#0  0x00007f56c792531f in random () from target:/lib/x86_64-linux-gnu/libc.so.6
#1  0x00007f56c7925799 in rand () from target:/lib/x86_64-linux-gnu/libc.so.6
#2  0x0000558d682d3764 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:797
#3  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#4  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#5  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#6  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#7  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#8  0x0000558d683b9e88 in luaD_precall ()
#9  0x0000558d683c4110 in luaV_execute ()
#10 0x0000558d683ba525 in luaD_call ()
#11 0x0000558d683b9858 in luaD_rawrunprotected ()
#12 0x0000558d683ba6d0 in luaD_pcall ()
#13 0x0000558d683b79f8 in lua_pcall ()
#14 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#15 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#16 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#17 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#18 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#19 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#20 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#21 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#22 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#23 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#24 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#25 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:00+00:00
#0  0x0000558d682d4abe in dictSdsKeyCompare (d=<optimized out>, key1=<optimized out>, key2=<optimized out>) at server.c:244
#1  0x0000558d682d2904 in _dictKeyIndex (existing=0x0, hash=15826992378078849043, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1055
#2  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#3  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#4  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#5  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#6  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#7  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#8  0x0000558d683b9e88 in luaD_precall ()
#9  0x0000558d683c4110 in luaV_execute ()
#10 0x0000558d683ba525 in luaD_call ()
#11 0x0000558d683b9858 in luaD_rawrunprotected ()
#12 0x0000558d683ba6d0 in luaD_pcall ()
#13 0x0000558d683b79f8 in lua_pcall ()
#14 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#15 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#16 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#17 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#18 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#19 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#20 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#21 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#22 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#23 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#24 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#25 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:05+00:00
#0  0x0000558d682e30b9 in sdsfree (s=<optimized out>) at sds.c:196
#1  0x0000558d68318938 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:792
#2  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#3  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#4  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#5  0x0000558d683b9e88 in luaD_precall ()
#6  0x0000558d683c4110 in luaV_execute ()
#7  0x0000558d683ba525 in luaD_call ()
#8  0x0000558d683b9858 in luaD_rawrunprotected ()
#9  0x0000558d683ba6d0 in luaD_pcall ()
#10 0x0000558d683b79f8 in lua_pcall ()
#11 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#12 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#13 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#14 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#15 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#16 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#17 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#18 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#19 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#20 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#21 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#22 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:10+00:00
#0  dictGetSomeKeys (d=d@entry=0x7f552a142cf8, des=0x7ffc86daaac0, des@entry=0x7ffc86daaaa0, count=<optimized out>, count@entry=15) at dict.c:764
#1  0x0000558d682d3759 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:791
#2  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#3  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#4  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#5  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#6  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#7  0x0000558d683b9e88 in luaD_precall ()
#8  0x0000558d683c4110 in luaV_execute ()
#9  0x0000558d683ba525 in luaD_call ()
#10 0x0000558d683b9858 in luaD_rawrunprotected ()
#11 0x0000558d683ba6d0 in luaD_pcall ()
#12 0x0000558d683b79f8 in lua_pcall ()
#13 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#14 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#15 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#16 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#17 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#18 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#19 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#20 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#21 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#22 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#23 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#24 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:16+00:00
#0  sz_index2size_lookup (index=1) at include/jemalloc/internal/sz.h:199
#1  sz_index2size (index=1) at include/jemalloc/internal/sz.h:207
#2  arena_salloc (ptr=<optimized out>, tsdn=<optimized out>) at include/jemalloc/internal/arena_inlines_b.h:195
#3  isalloc (ptr=<optimized out>, tsdn=<optimized out>) at include/jemalloc/internal/jemalloc_internal_inlines_c.h:38
#4  je_malloc_usable_size (ptr=ptr@entry=0x7f56906063c0) at src/jemalloc.c:3740
#5  0x0000558d682e69fe in zfree (ptr=0x7f56906063c0) at zmalloc.c:372
#6  zfree (ptr=0x7f56906063c0) at zmalloc.c:364
#7  0x0000558d68318938 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:792
#8  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#9  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#10 0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#11 0x0000558d683b9e88 in luaD_precall ()
#12 0x0000558d683c4110 in luaV_execute ()
#13 0x0000558d683ba525 in luaD_call ()
#14 0x0000558d683b9858 in luaD_rawrunprotected ()
#15 0x0000558d683ba6d0 in luaD_pcall ()
#16 0x0000558d683b79f8 in lua_pcall ()
#17 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#18 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#19 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#20 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#21 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#22 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#23 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#24 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#25 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#26 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#27 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#28 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:20+00:00
#0  0x00007f56c7a42a31 in ?? () from target:/lib/x86_64-linux-gnu/libc.so.6
#1  0x0000558d682d4ab2 in dictSdsKeyCompare (d=<optimized out>, key1=<optimized out>, key2=<optimized out>) at server.c:243
#2  0x0000558d682d2904 in _dictKeyIndex (existing=0x0, hash=16039903783278520339, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1055
#3  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#4  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#5  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#6  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#7  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#8  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#9  0x0000558d683b9e88 in luaD_precall ()
#10 0x0000558d683c4110 in luaV_execute ()
#11 0x0000558d683ba525 in luaD_call ()
#12 0x0000558d683b9858 in luaD_rawrunprotected ()
#13 0x0000558d683ba6d0 in luaD_pcall ()
#14 0x0000558d683b79f8 in lua_pcall ()
#15 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#16 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#17 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#18 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#19 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#20 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#21 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#22 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#23 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#24 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#25 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#26 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:24+00:00
#0  dictGetSomeKeys (d=d@entry=0x7f552a142cf8, des=des@entry=0x7ffc86daaaa0, count=<optimized out>, count@entry=15) at dict.c:738
#1  0x0000558d682d3759 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:791
#2  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#3  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#4  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#5  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#6  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#7  0x0000558d683b9e88 in luaD_precall ()
#8  0x0000558d683c4110 in luaV_execute ()
#9  0x0000558d683ba525 in luaD_call ()
#10 0x0000558d683b9858 in luaD_rawrunprotected ()
#11 0x0000558d683ba6d0 in luaD_pcall ()
#12 0x0000558d683b79f8 in lua_pcall ()
#13 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#14 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#15 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#16 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#17 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#18 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#19 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#20 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#21 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#22 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#23 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#24 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:29+00:00
#0  dictGetSomeKeys (d=d@entry=0x7f552a142cf8, des=0x7ffc86daab00, des@entry=0x7ffc86daaaa0, count=<optimized out>, count@entry=15) at dict.c:733
#1  0x0000558d682d3759 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:791
#2  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#3  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#4  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#5  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#6  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#7  0x0000558d683b9e88 in luaD_precall ()
#8  0x0000558d683c4110 in luaV_execute ()
#9  0x0000558d683ba525 in luaD_call ()
#10 0x0000558d683b9858 in luaD_rawrunprotected ()
#11 0x0000558d683ba6d0 in luaD_pcall ()
#12 0x0000558d683b79f8 in lua_pcall ()
#13 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#14 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#15 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#16 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#17 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#18 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#19 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#20 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#21 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#22 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#23 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#24 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:34+00:00
#0  0x0000558d682d27be in dictTypeExpandAllowed (d=0x7f549517e318) at dict.c:989
#1  _dictExpandIfNeeded (d=0x7f549517e318) at dict.c:1008
#2  _dictKeyIndex (existing=0x0, hash=4334487920869140499, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1048
#3  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#4  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#5  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#6  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#7  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#8  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#9  0x0000558d683b9e88 in luaD_precall ()
#10 0x0000558d683c4110 in luaV_execute ()
#11 0x0000558d683ba525 in luaD_call ()
#12 0x0000558d683b9858 in luaD_rawrunprotected ()
#13 0x0000558d683ba6d0 in luaD_pcall ()
#14 0x0000558d683b79f8 in lua_pcall ()
#15 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#16 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#17 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#18 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#19 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#20 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#21 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#22 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#23 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#24 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#25 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#26 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:38+00:00
#0  0x0000558d682d4a7d in sdslen (s=0x7f56909d2311 "i:blZ7htj") at sds.h:89
#1  dictSdsKeyCompare (d=<optimized out>, key1=0x7f56906063c1, key2=0x7f56909d2311) at server.c:241
#2  0x0000558d682d2904 in _dictKeyIndex (existing=0x0, hash=2834940632465860627, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1055
#3  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#4  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#5  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#6  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#7  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#8  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#9  0x0000558d683b9e88 in luaD_precall ()
#10 0x0000558d683c4110 in luaV_execute ()
#11 0x0000558d683ba525 in luaD_call ()
#12 0x0000558d683b9858 in luaD_rawrunprotected ()
#13 0x0000558d683ba6d0 in luaD_pcall ()
#14 0x0000558d683b79f8 in lua_pcall ()
#15 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#16 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#17 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#18 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#19 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#20 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#21 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#22 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#23 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#24 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#25 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#26 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:44+00:00
#0  dictGetSomeKeys (d=d@entry=0x7f552a142cf8, des=0x7ffc86daaac0, des@entry=0x7ffc86daaaa0, count=<optimized out>, count@entry=15) at dict.c:768
#1  0x0000558d682d3759 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:791
#2  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#3  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#4  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#5  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#6  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#7  0x0000558d683b9e88 in luaD_precall ()
#8  0x0000558d683c4110 in luaV_execute ()
#9  0x0000558d683ba525 in luaD_call ()
#10 0x0000558d683b9858 in luaD_rawrunprotected ()
#11 0x0000558d683ba6d0 in luaD_pcall ()
#12 0x0000558d683b79f8 in lua_pcall ()
#13 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#14 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#15 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#16 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#17 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#18 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#19 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#20 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#21 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#22 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#23 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#24 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:03:51+00:00
#0  0x00007f56c7a42a28 in ?? () from target:/lib/x86_64-linux-gnu/libc.so.6
#1  0x0000558d682d4ab2 in dictSdsKeyCompare (d=<optimized out>, key1=<optimized out>, key2=<optimized out>) at server.c:243
#2  0x0000558d682d2904 in _dictKeyIndex (existing=0x0, hash=1090945667569254371, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1055
#3  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#4  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#5  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#6  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#7  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#8  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#9  0x0000558d683b9e88 in luaD_precall ()
#10 0x0000558d683c4110 in luaV_execute ()
#11 0x0000558d683ba525 in luaD_call ()
#12 0x0000558d683b9858 in luaD_rawrunprotected ()
#13 0x0000558d683ba6d0 in luaD_pcall ()
#14 0x0000558d683b79f8 in lua_pcall ()
#15 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#16 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#17 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#18 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#19 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#20 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#21 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#22 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#23 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#24 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#25 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#26 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:04:13+00:00
#0  zfree (ptr=0x7f56906063c0) at zmalloc.c:373
#1  zfree (ptr=0x7f56906063c0) at zmalloc.c:364
#2  0x0000558d68318938 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:792
#3  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#4  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#5  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#6  0x0000558d683b9e88 in luaD_precall ()
#7  0x0000558d683c4110 in luaV_execute ()
#8  0x0000558d683ba525 in luaD_call ()
#9  0x0000558d683b9858 in luaD_rawrunprotected ()
#10 0x0000558d683ba6d0 in luaD_pcall ()
#11 0x0000558d683b79f8 in lua_pcall ()
#12 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#13 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#14 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#15 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#16 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#17 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#18 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#19 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#20 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#21 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#22 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#23 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:04:17+00:00
#0  0x0000558d682d35d9 in dictGetSomeKeys (d=d@entry=0x7f552a142cf8, des=des@entry=0x7ffc86daaaa0, count=<optimized out>, count@entry=15) at dict.c:755
#1  0x0000558d682d3759 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:791
#2  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#3  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#4  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#5  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#6  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#7  0x0000558d683b9e88 in luaD_precall ()
#8  0x0000558d683c4110 in luaV_execute ()
#9  0x0000558d683ba525 in luaD_call ()
#10 0x0000558d683b9858 in luaD_rawrunprotected ()
#11 0x0000558d683ba6d0 in luaD_pcall ()
#12 0x0000558d683b79f8 in lua_pcall ()
#13 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#14 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#15 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#16 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#17 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#18 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#19 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#20 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#21 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#22 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#23 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#24 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:04:23+00:00
#0  0x00007f56c7a42a24 in ?? () from target:/lib/x86_64-linux-gnu/libc.so.6
#1  0x0000558d682d4ab2 in dictSdsKeyCompare (d=<optimized out>, key1=<optimized out>, key2=<optimized out>) at server.c:243
#2  0x0000558d682d2904 in _dictKeyIndex (existing=0x0, hash=17057246290930548707, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1055
#3  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#4  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#5  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#6  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#7  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#8  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#9  0x0000558d683b9e88 in luaD_precall ()
#10 0x0000558d683c4110 in luaV_execute ()
#11 0x0000558d683ba525 in luaD_call ()
#12 0x0000558d683b9858 in luaD_rawrunprotected ()
#13 0x0000558d683ba6d0 in luaD_pcall ()
#14 0x0000558d683b79f8 in lua_pcall ()
#15 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#16 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#17 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#18 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#19 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#20 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#21 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#22 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#23 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#24 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#25 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#26 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:04:27+00:00
#0  0x00007f56c7925330 in random () from target:/lib/x86_64-linux-gnu/libc.so.6
#1  0x00007f56c7925799 in rand () from target:/lib/x86_64-linux-gnu/libc.so.6
#2  0x0000558d682d3764 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:797
#3  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#4  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#5  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#6  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#7  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#8  0x0000558d683b9e88 in luaD_precall ()
#9  0x0000558d683c4110 in luaV_execute ()
#10 0x0000558d683ba525 in luaD_call ()
#11 0x0000558d683b9858 in luaD_rawrunprotected ()
#12 0x0000558d683ba6d0 in luaD_pcall ()
#13 0x0000558d683b79f8 in lua_pcall ()
#14 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#15 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#16 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#17 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#18 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#19 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#20 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#21 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#22 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#23 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#24 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#25 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:04:32+00:00
#0  0x00007f56c7925712 in random_r () from target:/lib/x86_64-linux-gnu/libc.so.6
#1  0x00007f56c79252dd in random () from target:/lib/x86_64-linux-gnu/libc.so.6
#2  0x00007f56c7925799 in rand () from target:/lib/x86_64-linux-gnu/libc.so.6
#3  0x0000558d682d3764 in dictGetFairRandomKey (d=0x7f552a142cf8) at dict.c:797
#4  0x0000558d683179b9 in setTypeRandomElement (setobj=0x7f563c36d7c0, sdsele=0x7ffc86daab80, llele=0x7ffc86daab88) at t_set.c:213
#5  0x0000558d68318889 in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:780
#6  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#7  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#8  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#9  0x0000558d683b9e88 in luaD_precall ()
#10 0x0000558d683c4110 in luaV_execute ()
#11 0x0000558d683ba525 in luaD_call ()
#12 0x0000558d683b9858 in luaD_rawrunprotected ()
#13 0x0000558d683ba6d0 in luaD_pcall ()
#14 0x0000558d683b79f8 in lua_pcall ()
#15 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#16 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#17 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#18 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#19 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#20 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#21 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#22 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#23 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#24 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#25 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#26 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:21:03+00:00
#0  0x00007f56c7a42a28 in ?? () from target:/lib/x86_64-linux-gnu/libc.so.6
#1  0x0000558d682d4ab2 in dictSdsKeyCompare (d=<optimized out>, key1=<optimized out>, key2=<optimized out>) at server.c:243
#2  0x0000558d682d2904 in _dictKeyIndex (existing=0x0, hash=18240379238795239395, key=0x7f56906063c1, d=0x7f549517e318) at dict.c:1055
#3  dictAddRaw (d=0x7f549517e318, key=0x7f56906063c1, existing=0x0) at dict.c:337
#4  0x0000558d682d2b01 in dictAdd (d=d@entry=0x7f549517e318, key=key@entry=0x7f56906063c1, val=val@entry=0x0) at dict.c:302
#5  0x0000558d6831885e in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:789
#6  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#7  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#8  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#9  0x0000558d683b9e88 in luaD_precall ()
#10 0x0000558d683c4110 in luaV_execute ()
#11 0x0000558d683ba525 in luaD_call ()
#12 0x0000558d683b9858 in luaD_rawrunprotected ()
#13 0x0000558d683ba6d0 in luaD_pcall ()
#14 0x0000558d683b79f8 in lua_pcall ()
#15 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#16 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#17 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#18 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#19 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#20 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#21 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#22 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#23 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#24 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#25 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#26 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

2023-05-18T13:32:52+00:00
#0  extend_to_usable (ptr=ptr@entry=0x7f56906063c0, size=size@entry=16) at zmalloc.c:107
#1  0x0000558d682e6320 in zmalloc_usable (size=size@entry=11, usable=usable@entry=0x7ffc86daab18) at zmalloc.c:162
#2  0x0000558d682e2dc3 in _sdsnewlen (init=0x7f56004947b1, initlen=9, trymalloc=<optimized out>) at sds.c:117
#3  0x0000558d6831884a in srandmemberWithCountCommand (c=0x7f56c7525000) at t_set.c:784
#4  0x0000558d682d94db in call (c=c@entry=0x7f56c7525000, flags=15) at server.c:3385
#5  0x0000558d683a68fd in scriptCall (run_ctx=run_ctx@entry=0x7ffc86dab0f0, err=err@entry=0x7ffc86daaca8) at script.c:570
#6  0x0000558d683a4756 in luaRedisGenericCommand (lua=0x558d69f537f0, raise_error=1) at script_lua.c:936
#7  0x0000558d683b9e88 in luaD_precall ()
#8  0x0000558d683c4110 in luaV_execute ()
#9  0x0000558d683ba525 in luaD_call ()
#10 0x0000558d683b9858 in luaD_rawrunprotected ()
#11 0x0000558d683ba6d0 in luaD_pcall ()
#12 0x0000558d683b79f8 in lua_pcall ()
#13 0x0000558d683a5ddb in luaCallFunction (run_ctx=0x7ffc86dab0f0, lua=0x558d69f537f0, keys=0x7f56c7434668, nkeys=0, args=0x7f56c7434668, nargs=10, debug_enabled=0) at script_lua.c:1678
#14 0x0000558d6834c503 in evalGenericCommand (c=0x7f56aff39a00, evalsha=1) at eval.c:553
#15 0x0000558d682d94db in call (c=c@entry=0x7f56aff39a00, flags=flags@entry=15) at server.c:3385
#16 0x0000558d682dbca5 in processCommand (c=c@entry=0x7f56aff39a00) at server.c:4019
#17 0x0000558d682f36ee in processCommandAndResetClient (c=0x7f56aff39a00) at networking.c:2473
#18 processInputBuffer (c=0x7f56aff39a00) at networking.c:2577
#19 0x0000558d682f65e0 in readQueryFromClient (conn=<optimized out>) at networking.c:2713
#20 0x0000558d6839ebc8 in callHandler (handler=<optimized out>, conn=0x7f552bb06380) at connhelpers.h:79
#21 connSocketEventHandler (el=<optimized out>, fd=<optimized out>, clientData=0x7f552bb06380, mask=<optimized out>) at connection.c:310
#22 0x0000558d682d099a in aeProcessEvents (eventLoop=eventLoop@entry=0x7f56c742b1e0, flags=flags@entry=27) at ae.c:436
#23 0x0000558d682d0d3d in aeMain (eventLoop=0x7f56c742b1e0) at ae.c:496
#24 0x0000558d682cc5f1 in main (argc=<optimized out>, argv=0x7ffc86dab498) at server.c:7168

Here is also the output of ltrace -ffs256 -p<pid> of the hanging Redis process.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions