Intermittent crashes

[theoephraim]

Unclear if this is modjs or keydb related, but I am seeing crashes.

I believe it has to do with a high volume of logging - as when I disable my logging function (which calls keydb.log) then the crashes tend to stop happening. I can trigger it fairly reliably if I enable logging and run my script with a large amount of data. If I run the same script with a small volume of calls/data, then it does not crash.

bug report details:

=== KEYDB BUG REPORT START: Cut & paste starting from here ===

1:22:M 09 Nov 2020 16:52:06.950 # KeyDB 6.0.16 crashed by signal: 11

1:22:M 09 Nov 2020 16:52:06.950 # Crashed running the instruction at: 0x7f2ad998232a

1:22:M 09 Nov 2020 16:52:06.950 # Accessing address: (nil)

1:22:M 09 Nov 2020 16:52:06.950 # Failed assertion: <no assertion failed> (<no file>:0)


------ STACK TRACE ------

EIP:

/modjs-modules/modjs.so(v8::internal::RootIndexMap::RootIndexMap(v8::internal::Isolate*)+0x3a) [0x7f2ad998232a]


Backtrace:

keydb-server *:6379(logStackTrace(ucontext_t*)+0x6b) [0x555a80ea492b]

keydb-server *:6379(sigsegvHandler(int, siginfo_t*, void*)+0xc9) [0x555a80ea50c9]

/lib/x86_64-linux-gnu/libpthread.so.0(+0x128a0) [0x7f2ae20e08a0]

/modjs-modules/modjs.so(v8::internal::RootIndexMap::RootIndexMap(v8::internal::Isolate*)+0x3a) [0x7f2ad998232a]

/modjs-modules/modjs.so(v8::internal::compiler::JSHeapBroker::JSHeapBroker(v8::internal::Isolate*, v8::internal::Zone*, bool, bool)+0x67) [0x7f2ada15e067]

/modjs-modules/modjs.so(v8::internal::compiler::PipelineData::PipelineData(v8::internal::compiler::ZoneStats*, v8::internal::Isolate*, v8::internal::OptimizedCompilationInfo*, v8::internal::compiler::PipelineStatistics*, bool)+0x1a5) [0x7f2ad9b3a265]

/modjs-modules/modjs.so(v8::internal::compiler::PipelineCompilationJob::PipelineCompilationJob(v8::internal::Isolate*, v8::internal::Handle<v8::internal::SharedFunctionInfo>, v8::internal::Handle<v8::internal::JSFunction>, v8::internal::BailoutId, v8::internal::JavaScriptFrame*)+0x1b3) [0x7f2ad9b39ee3]

/modjs-modules/modjs.so(v8::internal::compiler::Pipeline::NewCompilationJob(v8::internal::Isolate*, v8::internal::Handle<v8::internal::JSFunction>, bool, v8::internal::BailoutId, v8::internal::JavaScriptFrame*)+0xa4) [0x7f2ad9b44044]

/modjs-modules/modjs.so(+0x4b8049) [0x7f2ad9612049]

/modjs-modules/modjs.so(v8::internal::Compiler::CompileOptimized(v8::internal::Handle<v8::internal::JSFunction>, v8::internal::ConcurrencyMode)+0x8e) [0x7f2ad9612f9e]

/modjs-modules/modjs.so(v8::internal::Runtime_CompileOptimized_Concurrent(int, unsigned long*, v8::internal::Isolate*)+0x95) [0x7f2ad9e674d5]

/modjs-modules/modjs.so(+0xb17858) [0x7f2ad9c71858]


------ INFO OUTPUT ------

�

# Server

redis_version:6.0.16

redis_git_sha1:63c47a09

redis_git_dirty:1

redis_build_id:f20f71e10920f6e0

redis_mode:standalone

os:Linux 4.19.76-linuxkit x86_64

arch_bits:64

multiplexing_api:epoll

atomicvar_api:atomic-builtin

gcc_version:7.5.0

process_id:1

run_id:ae5f90e55f15bb107b3c6f5ca6731c0ef6c0c92e

tcp_port:6379

uptime_in_seconds:10

uptime_in_days:0

hz:10

configured_hz:10

lru_clock:11105206

executable:/data/keydb-server

config_file:/etc/keydb/keydb.conf


# Clients

connected_clients:1

client_recent_max_input_buffer:2

client_recent_max_output_buffer:0

blocked_clients:0

tracking_clients:0

clients_in_timeout_table:0

current_client_thread:0

thread_0_clients:1

thread_1_clients:0


�

# Memory

used_memory:9673568

used_memory_human:9.23M

used_memory_rss:34697216

used_memory_rss_human:33.09M

used_memory_peak:9673568

used_memory_peak_human:9.23M

used_memory_peak_perc:100.34%

used_memory_overhead:9566170

used_memory_startup:9541208

used_memory_dataset:107398

used_memory_dataset_perc:81.14%

allocator_allocated:10278832

allocator_active:11214848

allocator_resident:13946880

total_system_memory:3142434816

total_system_memory_human:2.93G

used_memory_lua:41984

used_memory_lua_human:41.00K

used_memory_scripts:128

used_memory_scripts_human:128B

number_of_cached_scripts:1

maxmemory:0

maxmemory_human:0B

maxmemory_policy:noeviction

allocator_frag_ratio:1.09

allocator_frag_bytes:936016

allocator_rss_ratio:1.24

allocator_rss_bytes:2732032

rss_overhead_ratio:2.49

rss_overhead_bytes:20750336

mem_fragmentation_ratio:3.61

mem_fragmentation_bytes:25098216

mem_not_counted_for_evict:0

mem_replication_backlog:0

mem_clients_slaves:0

mem_clients_normal:17186

mem_aof_buffer:0

mem_allocator:jemalloc-5.1.0

active_defrag_running:0

lazyfree_pending_objects:0


# Persistence

loading:0

rdb_changes_since_last_save:1452

rdb_bgsave_in_progress:0

rdb_last_save_time:1604940723

rdb_last_bgsave_status:ok

rdb_last_bgsave_time_sec:-1

rdb_current_bgsave_time_sec:-1

rdb_last_cow_size:0

aof_enabled:0

aof_rewrite_in_progress:0

aof_rewrite_scheduled:0

aof_last_rewrite_time_sec:-1

aof_current_rewrite_time_sec:-1

aof_last_bgrewrite_status:ok

aof_last_write_status:ok

aof_last_cow_size:0

module_fork_in_progress:0

module_fork_last_cow_size:0


# Stats

total_connections_received:1

total_commands_processed:996

instantaneous_ops_per_sec:23

total_net_input_bytes:7276

total_net_output_bytes:7109

instantaneous_input_kbps:0.13

instantaneous_output_kbps:0.02

rejected_connections:0

sync_full:0

sync_partial_ok:0

sync_partial_err:0

expired_keys:0

expired_stale_perc:0.00

expired_time_cap_reached_count:0

expire_cycle_cpu_milliseconds:0

evicted_keys:0

keyspace_hits:176

keyspace_misses:26

pubsub_channels:0

pubsub_patterns:0

latest_fork_usec:0

migrate_cached_sockets:0

slave_expires_tracked_keys:0

active_defrag_hits:0

active_defrag_misses:0

active_defrag_key_hits:0

active_defrag_key_misses:0

tracking_total_keys:0

tracking_total_items:0

tracking_total_prefixes:0

unexpected_error_replies:0


# Replication

role:master

connected_slaves:0

master_replid:59caeead660634c6dc98213a1cad19123a80ec09

master_replid2:0000000000000000000000000000000000000000

master_repl_offset:0

second_repl_offset:-1

repl_backlog_active:0

repl_backlog_size:1048576

repl_backlog_first_byte_offset:0

repl_backlog_histlen:0


# CPU

used_cpu_sys:0.105267

used_cpu_user:0.133195

used_cpu_sys_children:0.002780

used_cpu_user_children:0.000525

server_threads:2

long_lock_waits:0


# Modules

module:name=modjs,ver=1,api=1,filters=0,usedby=[],using=[],options=[]


# Commandstats

cmdstat_expiremember:calls=20,usec=265,usec_per_call=13.25

cmdstat_RLQ_TICK:calls=11,usec=55026,usec_per_call=5002.36

cmdstat_scard:calls=4,usec=37,usec_per_call=9.25

cmdstat_incr:calls=11,usec=101,usec_per_call=9.18

cmdstat_RLQ_GET_NEXT_JOBS:calls=2,usec=14301,usec_per_call=7150.50

cmdstat_hdel:calls=4,usec=42,usec_per_call=10.50

cmdstat_zadd:calls=142,usec=2391,usec_per_call=16.84

cmdstat_hmset:calls=347,usec=2855,usec_per_call=8.23

cmdstat_zrem:calls=142,usec=1159,usec_per_call=8.16

cmdstat_RLQ_JOB_COMPLETED:calls=4,usec=2634,usec_per_call=658.50

cmdstat_keydb.cron:calls=1,usec=9,usec_per_call=9.00

cmdstat_RLQ_ADD_JOBS:calls=1,usec=8820,usec_per_call=8820.00

cmdstat_hgetall:calls=166,usec=1233,usec_per_call=7.43

cmdstat_zrangebyscore:calls=27,usec=403,usec_per_call=14.93

cmdstat_hget:calls=4,usec=73,usec_per_call=18.25

cmdstat_del:calls=1,usec=5,usec_per_call=5.00

cmdstat_hmget:calls=1,usec=122,usec_per_call=122.00

cmdstat_hincrby:calls=80,usec=655,usec_per_call=8.19

cmdstat_srem:calls=14,usec=143,usec_per_call=10.21

cmdstat_flushall:calls=1,usec=1394,usec_per_call=1394.00

cmdstat_sadd:calls=9,usec=216,usec_per_call=24.00

cmdstat_info:calls=1,usec=67,usec_per_call=67.00

cmdstat_RLQ_INIT:calls=1,usec=681,usec_per_call=681.00

cmdstat_RLQ_DEFINE_LIMIT_TYPE:calls=2,usec=1156,usec_per_call=578.00


# Cluster

cluster_enabled:0


# Keyspace

db0:keys=113,expires=2,avg_ttl=48996


------ CLIENT LIST OUTPUT ------

id=360 addr=172.25.0.1:37754 fd=89 name= age=3 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=36 qbuf-free=32732 obl=0 oll=0 omem=0 events=r cmd=RLQ_JOB_COMPLETED user=default


------ REGISTERS ------

1:22:M 09 Nov 2020 16:52:06.965 #

RAX:00007f2ad080e918 RBX:00007f2ad080e918

RCX:00007f2ac0000000 RDX:0000555a80fc8140

RDI:0000000000000000 RSI:00007f2ad27fab60

RBP:00007f2ad27f8c60 RSP:00007f2ad27f8c20

R8 :0000000000000004 R9 :00000000000002a8

R10:00007f2ad27faab8 R11:0000000000000054

R12:000037be00000000 R13:000037be00000000

R14:00007f2ad087f330 R15:0000000000000000

RIP:00007f2ad998232a EFL:0000000000010202

CSGSFS:002b000000000033

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c2f) -> 00007f2ad08820c8

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c2e) -> 00007f2ad087f300

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c2d) -> 0000000000000000

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c2c) -> 000037be00000000

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c2b) -> 00007f2ad0882170

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c2a) -> 00007f2ad08820c8

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c29) -> 00007f2ada15e067

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c28) -> 00007f2ad27f8ca0

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c27) -> 0000000000000000

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c26) -> 00007f2ac4004b18

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c25) -> 0000000000000000

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c24) -> 000037be00000000

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c23) -> 00007f2ad087f300

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c22) -> 00007f2ad0882040

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c21) -> 00007f2ad99e2ed5

1:22:M 09 Nov 2020 16:52:06.965 # (00007f2ad27f8c20) -> 00007f2ad27f8c40


------ MODULES INFO OUTPUT ------


------ FAST MEMORY TEST ------

1:22:M 09 Nov 2020 16:52:06.965 # Bio thread for job type #0 terminated

1:22:M 09 Nov 2020 16:52:06.965 # Bio thread for job type #1 terminated

1:22:M 09 Nov 2020 16:52:06.966 # Bio thread for job type #2 terminated

*** Preparing to test memory region 37be00000000 (49152 bytes)

*** Preparing to test memory region 37be00040000 (4096 bytes)

*** Preparing to test memory region 37be00080000 (4096 bytes)

*** Preparing to test memory region 37be08080000 (577536 bytes)

*** Preparing to test memory region 37be08140000 (4096 bytes)

*** Preparing to test memory region 37be08180000 (671744 bytes)

*** Preparing to test memory region 37be08240000 (135168 bytes)

*** Preparing to test memory region 37be08300000 (262144 bytes)

*** Preparing to test memory region 555a81211000 (2281472 bytes)

*** Preparing to test memory region 555a814d6000 (700416 bytes)

*** Preparing to test memory region 7f2abc000000 (135168 bytes)

*** Preparing to test memory region 7f2ac4000000 (135168 bytes)

*** Preparing to test memory region 7f2ac8600000 (2097152 bytes)

*** Preparing to test memory region 7f2acb800000 (8388608 bytes)

*** Preparing to test memory region 7f2acc000000 (135168 bytes)

*** Preparing to test memory region 7f2ad0200000 (4194304 bytes)

*** Preparing to test memory region 7f2ad07ff000 (4194304 bytes)

*** Preparing to test memory region 7f2ad0c00000 (8388608 bytes)

*** Preparing to test memory region 7f2ad1400000 (2097152 bytes)

*** Preparing to test memory region 7f2ad17fc000 (8388608 bytes)

*** Preparing to test memory region 7f2ad1ffd000 (8388608 bytes)

*** Preparing to test memory region 7f2ad27fe000 (8388608 bytes)

*** Preparing to test memory region 7f2ad2fff000 (8388608 bytes)

*** Preparing to test memory region 7f2ad3800000 (8388608 bytes)

*** Preparing to test memory region 7f2ad4000000 (135168 bytes)

*** Preparing to test memory region 7f2ad8159000 (8388608 bytes)

*** Preparing to test memory region 7f2ad895a000 (8388608 bytes)

*** Preparing to test memory region 7f2ada89a000 (114688 bytes)

*** Preparing to test memory region 7f2adaabe000 (8388608 bytes)

*** Preparing to test memory region 7f2adb4ca000 (24576 bytes)

*** Preparing to test memory region 7f2adb6e8000 (8192 bytes)

*** Preparing to test memory region 7f2adbb00000 (17825792 bytes)

*** Preparing to test memory region 7f2adcfc1000 (188416 bytes)

*** Preparing to test memory region 7f2add2f7000 (4096 bytes)

*** Preparing to test memory region 7f2add541000 (4096 bytes)

*** Preparing to test memory region 7f2addfcd000 (4096 bytes)

*** Preparing to test memory region 7f2ade4fc000 (4096 bytes)

*** Preparing to test memory region 7f2adee4b000 (4096 bytes)

*** Preparing to test memory region 7f2adf4c1000 (8192 bytes)

*** Preparing to test memory region 7f2adfb03000 (4096 bytes)

*** Preparing to test memory region 7f2ae082a000 (4096 bytes)

*** Preparing to test memory region 7f2ae1224000 (8192 bytes)

*** Preparing to test memory region 7f2ae20ca000 (16384 bytes)

*** Preparing to test memory region 7f2ae22e9000 (16384 bytes)

*** Preparing to test memory region 7f2ae2c28000 (16384 bytes)

*** Preparing to test memory region 7f2ae30f4000 (12288 bytes)

*** Preparing to test memory region 7f2ae3e1e000 (114688 bytes)

*** Preparing to test memory region 7f2ae3e3f000 (4096 bytes)

.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.

[theoephraim]

Been getting another similar crash when I have logging disabled. In this case, I'm hitting a custom script with long-ish list of arguments.

=== KEYDB BUG REPORT START: Cut & paste starting from here ===

1:21:M 10 Nov 2020 00:28:08.202 # KeyDB 6.0.16 crashed by signal: 11

1:21:M 10 Nov 2020 00:28:08.202 # Crashed running the instruction at: 0x7f0962d8232a

1:21:M 10 Nov 2020 00:28:08.202 # Accessing address: (nil)

1:21:M 10 Nov 2020 00:28:08.202 # Failed assertion: <no assertion failed> (<no file>:0)


------ STACK TRACE ------

EIP:

/modjs-modules/modjs.so(v8::internal::RootIndexMap::RootIndexMap(v8::internal::Isolate*)+0x3a) [0x7f0962d8232a]


Backtrace:

keydb-server *:6379(logStackTrace(ucontext_t*)+0x6b) [0x55df0a6b592b]

keydb-server *:6379(sigsegvHandler(int, siginfo_t*, void*)+0xc9) [0x55df0a6b60c9]

/lib/x86_64-linux-gnu/libpthread.so.0(+0x128a0) [0x7f096b3538a0]

/modjs-modules/modjs.so(v8::internal::RootIndexMap::RootIndexMap(v8::internal::Isolate*)+0x3a) [0x7f0962d8232a]

/modjs-modules/modjs.so(v8::internal::compiler::JSHeapBroker::JSHeapBroker(v8::internal::Isolate*, v8::internal::Zone*, bool, bool)+0x67) [0x7f096355e067]

/modjs-modules/modjs.so(v8::internal::compiler::PipelineData::PipelineData(v8::internal::compiler::ZoneStats*, v8::internal::Isolate*, v8::internal::OptimizedCompilationInfo*, v8::internal::compiler::PipelineStatistics*, bool)+0x1a5) [0x7f0962f3a265]

/modjs-modules/modjs.so(v8::internal::compiler::PipelineCompilationJob::PipelineCompilationJob(v8::internal::Isolate*, v8::internal::Handle<v8::internal::SharedFunctionInfo>, v8::internal::Handle<v8::internal::JSFunction>, v8::internal::BailoutId, v8::internal::JavaScriptFrame*)+0x1b3) [0x7f0962f39ee3]

/modjs-modules/modjs.so(v8::internal::compiler::Pipeline::NewCompilationJob(v8::internal::Isolate*, v8::internal::Handle<v8::internal::JSFunction>, bool, v8::internal::BailoutId, v8::internal::JavaScriptFrame*)+0xa4) [0x7f0962f44044]

/modjs-modules/modjs.so(+0x4b8049) [0x7f0962a12049]

/modjs-modules/modjs.so(v8::internal::Compiler::CompileOptimized(v8::internal::Handle<v8::internal::JSFunction>, v8::internal::ConcurrencyMode)+0x8e) [0x7f0962a12f9e]

/modjs-modules/modjs.so(v8::internal::Runtime_CompileOptimized_Concurrent(int, unsigned long*, v8::internal::Isolate*)+0x95) [0x7f09632674d5]

/modjs-modules/modjs.so(+0xb17858) [0x7f0963071858]


------ INFO OUTPUT ------

�

# Server

redis_version:6.0.16

redis_git_sha1:63c47a09

redis_git_dirty:1

redis_build_id:f20f71e10920f6e0

redis_mode:standalone

os:Linux 4.19.76-linuxkit x86_64

arch_bits:64

multiplexing_api:epoll

atomicvar_api:atomic-builtin

gcc_version:7.5.0

process_id:1

run_id:3f4c9d0159ad8159b278656376a12b37d97829af

tcp_port:6379

uptime_in_seconds:15

uptime_in_days:0

hz:10

configured_hz:10

lru_clock:11132568

executable:/data/keydb-server

config_file:/etc/keydb/keydb.conf


# Clients

connected_clients:1

client_recent_max_input_buffer:2

client_recent_max_output_buffer:0

blocked_clients:0

tracking_clients:0

clients_in_timeout_table:0

current_client_thread:0

thread_0_clients:1

thread_1_clients:0


�

# Memory

used_memory:9679336

used_memory_human:9.23M

used_memory_rss:35463168

used_memory_rss_human:33.82M

used_memory_peak:14455040

used_memory_peak_human:13.79M

used_memory_peak_perc:66.96%

used_memory_overhead:9567898

used_memory_startup:9541208

used_memory_dataset:111438

used_memory_dataset_perc:80.68%

allocator_allocated:9945448

allocator_active:11419648

allocator_resident:14475264

total_system_memory:3142434816

total_system_memory_human:2.93G

used_memory_lua:41984

used_memory_lua_human:41.00K

used_memory_scripts:128

used_memory_scripts_human:128B

number_of_cached_scripts:1

maxmemory:0

maxmemory_human:0B

maxmemory_policy:noeviction

allocator_frag_ratio:1.15

allocator_frag_bytes:1474200

allocator_rss_ratio:1.27

allocator_rss_bytes:3055616

rss_overhead_ratio:2.45

rss_overhead_bytes:20987904

mem_fragmentation_ratio:3.69

mem_fragmentation_bytes:25846712

mem_not_counted_for_evict:0

mem_replication_backlog:0

mem_clients_slaves:0

mem_clients_normal:17186

mem_aof_buffer:0

mem_allocator:jemalloc-5.1.0

active_defrag_running:0

lazyfree_pending_objects:0


# Persistence

loading:0

rdb_changes_since_last_save:11087

rdb_bgsave_in_progress:0

rdb_last_save_time:1604968081

rdb_last_bgsave_status:ok

rdb_last_bgsave_time_sec:-1

rdb_current_bgsave_time_sec:-1

rdb_last_cow_size:0

aof_enabled:0

aof_rewrite_in_progress:0

aof_rewrite_scheduled:0

aof_last_rewrite_time_sec:-1

aof_current_rewrite_time_sec:-1

aof_last_bgrewrite_status:ok

aof_last_write_status:ok

aof_last_cow_size:0

module_fork_in_progress:0

module_fork_last_cow_size:0


# Stats

total_connections_received:1

total_commands_processed:527

instantaneous_ops_per_sec:159

total_net_input_bytes:17900

total_net_output_bytes:3815

instantaneous_input_kbps:6.64

instantaneous_output_kbps:0.01

rejected_connections:0

sync_full:0

sync_partial_ok:0

sync_partial_err:0

expired_keys:0

expired_stale_perc:0.00

expired_time_cap_reached_count:0

expire_cycle_cpu_milliseconds:0

evicted_keys:0

keyspace_hits:60

keyspace_misses:31

pubsub_channels:0

pubsub_patterns:0

latest_fork_usec:0

migrate_cached_sockets:0

slave_expires_tracked_keys:0

active_defrag_hits:0

active_defrag_misses:0

active_defrag_key_hits:0

active_defrag_key_misses:0

tracking_total_keys:0

tracking_total_items:0

tracking_total_prefixes:0

unexpected_error_replies:0


# Replication

role:master

connected_slaves:0

master_replid:65b9227ea3d0632567886a089b477d8172417990

master_replid2:0000000000000000000000000000000000000000

master_repl_offset:0

second_repl_offset:-1

repl_backlog_active:0

repl_backlog_size:1048576

repl_backlog_first_byte_offset:0

repl_backlog_histlen:0


# CPU

used_cpu_sys:0.121664

used_cpu_user:0.165906

used_cpu_sys_children:0.003446

used_cpu_user_children:0.000000

server_threads:2

long_lock_waits:0


# Modules

module:name=modjs,ver=1,api=1,filters=0,usedby=[],using=[],options=[]


# Commandstats

cmdstat_scard:calls=15,usec=182,usec_per_call=12.13

cmdstat_incr:calls=15,usec=163,usec_per_call=10.87

cmdstat_RLQ_ADD_JOBS:calls=14,usec=30945,usec_per_call=2210.36

cmdstat_hgetall:calls=46,usec=860,usec_per_call=18.70

cmdstat_flushall:calls=1,usec=9131,usec_per_call=9131.00

cmdstat_hmset:calls=328,usec=3801,usec_per_call=11.59

cmdstat_zrangebyscore:calls=30,usec=328,usec_per_call=10.93

cmdstat_del:calls=1,usec=6,usec_per_call=6.00

cmdstat_sadd:calls=42,usec=620,usec_per_call=14.76

cmdstat_keydb.cron:calls=1,usec=15,usec_per_call=15.00

cmdstat_RLQ_TICK:calls=15,usec=6363,usec_per_call=424.20

cmdstat_RLQ_DEFINE_LIMIT_TYPE:calls=3,usec=5188,usec_per_call=1729.33

cmdstat_info:calls=1,usec=120,usec_per_call=120.00

cmdstat_zadd:calls=14,usec=807,usec_per_call=57.64

cmdstat_RLQ_INIT:calls=1,usec=1631,usec_per_call=1631.00


# Cluster

cluster_enabled:0


# Keyspace

db0:keys=131,expires=1,avg_ttl=15


------ CLIENT LIST OUTPUT ------

id=49 addr=172.25.0.1:40538 fd=89 name= age=7 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=5279 qbuf-free=27489 obl=0 oll=0 omem=0 events=r cmd=RLQ_ADD_JOBS user=default


------ CURRENT CLIENT INFO ------

id=49 addr=172.25.0.1:40538 fd=89 name= age=7 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=5279 qbuf-free=27489 obl=0 oll=0 omem=0 events=r cmd=RLQ_ADD_JOBS user=default

argv[0]: 'RLQ_ADD_JOBS'

argv[1]: '{"priority":3,"limits":[["USER",37],["WORKSPACE",7],["ACCOUNT",5]]}'

argv[2]: 'j0'

argv[3]: '{"desc":"Job # 0 - W7/U37/A5 - P3"}'

argv[4]: 'j1'

argv[5]: '{"desc":"Job # 1 - W7/U37/A5 - P3"}'

argv[6]: 'j2'

argv[7]: '{"desc":"Job # 2 - W7/U37/A5 - P3"}'

argv[8]: 'j3'

argv[9]: '{"desc":"Job # 3 - W7/U37/A5 - P3"}'

argv[10]: 'j4'

argv[11]: '{"desc":"Job # 4 - W7/U37/A5 - P3"}'

argv[12]: 'j5'

argv[13]: '{"desc":"Job # 5 - W7/U37/A5 - P3"}'

argv[14]: 'j6'

argv[15]: '{"desc":"Job # 6 - W7/U37/A5 - P3"}'

argv[16]: 'j7'

argv[17]: '{"desc":"Job # 7 - W7/U37/A5 - P3"}'

argv[18]: 'j8'

argv[19]: '{"desc":"Job # 8 - W7/U37/A5 - P3"}'

argv[20]: 'j9'

argv[21]: '{"desc":"Job # 9 - W7/U37/A5 - P3"}'

argv[22]: 'j10'

argv[23]: '{"desc":"Job # 10 - W7/U37/A5 - P3"}'

argv[24]: 'j11'

argv[25]: '{"desc":"Job # 11 - W7/U37/A5 - P3"}'

argv[26]: 'j12'

argv[27]: '{"desc":"Job # 12 - W7/U37/A5 - P3"}'

argv[28]: 'j13'

argv[29]: '{"desc":"Job # 13 - W7/U37/A5 - P3"}'

argv[30]: 'j14'

argv[31]: '{"desc":"Job # 14 - W7/U37/A5 - P3"}'

argv[32]: 'j15'

argv[33]: '{"desc":"Job # 15 - W7/U37/A5 - P3"}'

argv[34]: 'j16'

argv[35]: '{"desc":"Job # 16 - W7/U37/A5 - P3"}'

argv[36]: 'j17'

argv[37]: '{"desc":"Job # 17 - W7/U37/A5 - P3"}'

argv[38]: 'j18'

argv[39]: '{"desc":"Job # 18 - W7/U37/A5 - P3"}'

argv[40]: 'j19'

argv[41]: '{"desc":"Job # 19 - W7/U37/A5 - P3"}'

argv[42]: 'j20'

argv[43]: '{"desc":"Job # 20 - W7/U37/A5 - P3"}'

argv[44]: 'j21'

argv[45]: '{"desc":"Job # 21 - W7/U37/A5 - P3"}'

argv[46]: 'j22'

argv[47]: '{"desc":"Job # 22 - W7/U37/A5 - P3"}'

argv[48]: 'j23'

argv[49]: '{"desc":"Job # 23 - W7/U37/A5 - P3"}'

argv[50]: 'j24'

argv[51]: '{"desc":"Job # 24 - W7/U37/A5 - P3"}'

argv[52]: 'j25'

argv[53]: '{"desc":"Job # 25 - W7/U37/A5 - P3"}'

argv[54]: 'j26'

argv[55]: '{"desc":"Job # 26 - W7/U37/A5 - P3"}'

argv[56]: 'j27'

argv[57]: '{"desc":"Job # 27 - W7/U37/A5 - P3"}'

argv[58]: 'j28'

argv[59]: '{"desc":"Job # 28 - W7/U37/A5 - P3"}'

argv[60]: 'j29'

argv[61]: '{"desc":"Job # 29 - W7/U37/A5 - P3"}'

argv[62]: 'j30'

argv[63]: '{"desc":"Job # 30 - W7/U37/A5 - P3"}'

argv[64]: 'j31'

argv[65]: '{"desc":"Job # 31 - W7/U37/A5 - P3"}'

argv[66]: 'j32'

argv[67]: '{"desc":"Job # 32 - W7/U37/A5 - P3"}'

argv[68]: 'j33'

argv[69]: '{"desc":"Job # 33 - W7/U37/A5 - P3"}'

argv[70]: 'j34'

argv[71]: '{"desc":"Job # 34 - W7/U37/A5 - P3"}'

argv[72]: 'j35'

argv[73]: '{"desc":"Job # 35 - W7/U37/A5 - P3"}'

argv[74]: 'j36'

argv[75]: '{"desc":"Job # 36 - W7/U37/A5 - P3"}'

argv[76]: 'j37'

argv[77]: '{"desc":"Job # 37 - W7/U37/A5 - P3"}'

argv[78]: 'j38'

argv[79]: '{"desc":"Job # 38 - W7/U37/A5 - P3"}'

argv[80]: 'j39'

argv[81]: '{"desc":"Job # 39 - W7/U37/A5 - P3"}'

argv[82]: 'j40'

argv[83]: '{"desc":"Job # 40 - W7/U37/A5 - P3"}'

argv[84]: 'j41'

argv[85]: '{"desc":"Job # 41 - W7/U37/A5 - P3"}'

argv[86]: 'j42'

argv[87]: '{"desc":"Job # 42 - W7/U37/A5 - P3"}'

argv[88]: 'j43'

argv[89]: '{"desc":"Job # 43 - W7/U37/A5 - P3"}'

argv[90]: 'j44'

argv[91]: '{"desc":"Job # 44 - W7/U37/A5 - P3"}'

argv[92]: 'j45'

argv[93]: '{"desc":"Job # 45 - W7/U37/A5 - P3"}'

argv[94]: 'j46'

argv[95]: '{"desc":"Job # 46 - W7/U37/A5 - P3"}'

argv[96]: 'j47'

argv[97]: '{"desc":"Job # 47 - W7/U37/A5 - P3"}'

argv[98]: 'j48'

argv[99]: '{"desc":"Job # 48 - W7/U37/A5 - P3"}'

argv[100]: 'j49'

argv[101]: '{"desc":"Job # 49 - W7/U37/A5 - P3"}'

argv[102]: 'j50'

argv[103]: '{"desc":"Job # 50 - W7/U37/A5 - P3"}'

argv[104]: 'j51'

argv[105]: '{"desc":"Job # 51 - W7/U37/A5 - P3"}'

argv[106]: 'j52'

argv[107]: '{"desc":"Job # 52 - W7/U37/A5 - P3"}'

argv[108]: 'j53'

argv[109]: '{"desc":"Job # 53 - W7/U37/A5 - P3"}'

argv[110]: 'j54'

argv[111]: '{"desc":"Job # 54 - W7/U37/A5 - P3"}'

argv[112]: 'j55'

argv[113]: '{"desc":"Job # 55 - W7/U37/A5 - P3"}'

argv[114]: 'j56'

argv[115]: '{"desc":"Job # 56 - W7/U37/A5 - P3"}'

argv[116]: 'j57'

argv[117]: '{"desc":"Job # 57 - W7/U37/A5 - P3"}'

argv[118]: 'j58'

argv[119]: '{"desc":"Job # 58 - W7/U37/A5 - P3"}'

argv[120]: 'j59'

argv[121]: '{"desc":"Job # 59 - W7/U37/A5 - P3"}'

argv[122]: 'j60'

argv[123]: '{"desc":"Job # 60 - W7/U37/A5 - P3"}'

argv[124]: 'j61'

argv[125]: '{"desc":"Job # 61 - W7/U37/A5 - P3"}'

argv[126]: 'j62'

argv[127]: '{"desc":"Job # 62 - W7/U37/A5 - P3"}'

argv[128]: 'j63'

argv[129]: '{"desc":"Job # 63 - W7/U37/A5 - P3"}'

argv[130]: 'j64'

argv[131]: '{"desc":"Job # 64 - W7/U37/A5 - P3"}'

argv[132]: 'j65'

argv[133]: '{"desc":"Job # 65 - W7/U37/A5 - P3"}'

argv[134]: 'j66'

argv[135]: '{"desc":"Job # 66 - W7/U37/A5 - P3"}'

argv[136]: 'j67'

argv[137]: '{"desc":"Job # 67 - W7/U37/A5 - P3"}'

argv[138]: 'j68'

argv[139]: '{"desc":"Job # 68 - W7/U37/A5 - P3"}'

argv[140]: 'j69'

argv[141]: '{"desc":"Job # 69 - W7/U37/A5 - P3"}'

argv[142]: 'j70'

argv[143]: '{"desc":"Job # 70 - W7/U37/A5 - P3"}'

argv[144]: 'j71'

argv[145]: '{"desc":"Job # 71 - W7/U37/A5 - P3"}'

argv[146]: 'j72'

argv[147]: '{"desc":"Job # 72 - W7/U37/A5 - P3"}'

argv[148]: 'j73'

argv[149]: '{"desc":"Job # 73 - W7/U37/A5 - P3"}'

argv[150]: 'j74'

argv[151]: '{"desc":"Job # 74 - W7/U37/A5 - P3"}'

argv[152]: 'j75'

argv[153]: '{"desc":"Job # 75 - W7/U37/A5 - P3"}'

argv[154]: 'j76'

argv[155]: '{"desc":"Job # 76 - W7/U37/A5 - P3"}'

argv[156]: 'j77'

argv[157]: '{"desc":"Job # 77 - W7/U37/A5 - P3"}'

argv[158]: 'j78'

argv[159]: '{"desc":"Job # 78 - W7/U37/A5 - P3"}'

argv[160]: 'j79'

argv[161]: '{"desc":"Job # 79 - W7/U37/A5 - P3"}'

argv[162]: 'j80'

argv[163]: '{"desc":"Job # 80 - W7/U37/A5 - P3"}'

argv[164]: 'j81'

argv[165]: '{"desc":"Job # 81 - W7/U37/A5 - P3"}'

argv[166]: 'j82'

argv[167]: '{"desc":"Job # 82 - W7/U37/A5 - P3"}'

argv[168]: 'j83'

argv[169]: '{"desc":"Job # 83 - W7/U37/A5 - P3"}'

argv[170]: 'j84'

argv[171]: '{"desc":"Job # 84 - W7/U37/A5 - P3"}'

argv[172]: 'j85'

argv[173]: '{"desc":"Job # 85 - W7/U37/A5 - P3"}'

argv[174]: 'j86'

argv[175]: '{"desc":"Job # 86 - W7/U37/A5 - P3"}'

argv[176]: 'j87'

argv[177]: '{"desc":"Job # 87 - W7/U37/A5 - P3"}'

argv[178]: 'j88'

argv[179]: '{"desc":"Job # 88 - W7/U37/A5 - P3"}'

argv[180]: 'j89'

argv[181]: '{"desc":"Job # 89 - W7/U37/A5 - P3"}'

argv[182]: 'j90'

argv[183]: '{"desc":"Job # 90 - W7/U37/A5 - P3"}'

argv[184]: 'j91'

argv[185]: '{"desc":"Job # 91 - W7/U37/A5 - P3"}'

argv[186]: 'j92'

argv[187]: '{"desc":"Job # 92 - W7/U37/A5 - P3"}'

argv[

188]: 'j93'

argv[189]: '{"desc":"Job # 93 - W7/U37/A5 - P3"}'

argv[190]: 'j94'

argv[191]: '{"desc":"Job # 94 - W7/U37/A5 - P3"}'

argv[192]: 'j95'

argv[193]: '{"desc":"Job # 95 - W7/U37/A5 - P3"}'

argv[194]: 'j96'

argv[195]: '{"desc":"Job # 96 - W7/U37/A5 - P3"}'

argv[196]: 'j97'

argv[197]: '{"desc":"Job # 97 - W7/U37/A5 - P3"}'

argv[198]: 'j98'

argv[199]: '{"desc":"Job # 98 - W7/U37/A5 - P3"}'

argv[200]: 'j99'

argv[201]: '{"desc":"Job # 99 - W7/U37/A5 - P3"}'


------ REGISTERS ------

1:21:M 10 Nov 2020 00:28:08.216 #

RAX:00007f09603ba6c8 RBX:00007f09603ba6c8

RCX:00007f0940000000 RDX:000055df0a7d9140

RDI:0000000000000000 RSI:00007f095b7fcb00

RBP:00007f095b7faaf0 RSP:00007f095b7faab0

R8 :0000000000000077 R9 :00000000000002f8

R10:00007f095b7fcab8 R11:000000000000005e

R12:0000048700000000 R13:0000048700000000

R14:00007f0958c49030 R15:0000000000000000

RIP:00007f0962d8232a EFL:0000000000010202

CSGSFS:002b000000000033

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faabf) -> 00007f0958c730c8

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faabe) -> 00007f0958c49000

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faabd) -> 0000000000000000

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faabc) -> 0000048700000000

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faabb) -> 00007f0958c73170

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faaba) -> 00007f0958c730c8

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab9) -> 00007f096355e067

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab8) -> 00007f095b7fab30

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab7) -> 0000000000000000

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab6) -> 00007f094c009438

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab5) -> 0000000000000000

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab4) -> 0000048700000000

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab3) -> 00007f0958c49000

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab2) -> 00007f0958c73040

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab1) -> 00007f0962de2ed5

1:21:M 10 Nov 2020 00:28:08.216 # (00007f095b7faab0) -> 00007f095b7faad0


------ MODULES INFO OUTPUT ------


------ FAST MEMORY TEST ------

1:21:M 10 Nov 2020 00:28:08.216 # Bio thread for job type #0 terminated

1:21:M 10 Nov 2020 00:28:08.216 # Bio thread for job type #1 terminated

1:21:M 10 Nov 2020 00:28:08.217 # Bio thread for job type #2 terminated

*** Preparing to test memory region 48700000000 (49152 bytes)

*** Preparing to test memory region 48700040000 (4096 bytes)

*** Preparing to test memory region 48700080000 (4096 bytes)

*** Preparing to test memory region 48708080000 (577536 bytes)

*** Preparing to test memory region 48708140000 (4096 bytes)

*** Preparing to test memory region 48708180000 (675840 bytes)

*** Preparing to test memory region 48708240000 (135168 bytes)

*** Preparing to test memory region 48708280000 (524288 bytes)

*** Preparing to test memory region 55df0aa22000 (2281472 bytes)

*** Preparing to test memory region 55df0afb2000 (700416 bytes)

*** Preparing to test memory region 7f094c000000 (135168 bytes)

*** Preparing to test memory region 7f0950000000 (135168 bytes)

*** Preparing to test memory region 7f0954000000 (135168 bytes)

*** Preparing to test memory region 7f0958800000 (2097152 bytes)

*** Preparing to test memory region 7f0958bff000 (2097152 bytes)

*** Preparing to test memory region 7f0958e00000 (8388608 bytes)

*** Preparing to test memory region 7f0959600000 (2097152 bytes)

*** Preparing to test memory region 7f0959a00000 (8388608 bytes)

*** Preparing to test memory region 7f095a200000 (4194304 bytes)

*** Preparing to test memory region 7f095a7fe000 (8388608 bytes)

*** Preparing to test memory region 7f095afff000 (8388608 bytes)

*** Preparing to test memory region 7f095b800000 (8388608 bytes)

*** Preparing to test memory region 7f095c000000 (135168 bytes)

*** Preparing to test memory region 7f0960156000 (4194304 bytes)

*** Preparing to test memory region 7f0960557000 (8388608 bytes)

*** Preparing to test memory region 7f0960d58000 (8388608 bytes)

*** Preparing to test memory region 7f0961559000 (8388608 bytes)

*** Preparing to test memory region 7f0961d5a000 (8388608 bytes)

*** Preparing to test memory region 7f0963c9a000 (114688 bytes)

*** Preparing to test memory region 7f0963ebe000 (8388608 bytes)

*** Preparing to test memory region 7f09648ca000 (24576 bytes)

*** Preparing to test memory region 7f0964ae8000 (8192 bytes)

*** Preparing to test memory region 7f0964f00000 (17825792 bytes)

*** Preparing to test memory region 7f0966234000 (188416 bytes)

*** Preparing to test memory region 7f096656a000 (4096 bytes)

*** Preparing to test memory region 7f09667b4000 (4096 bytes)

*** Preparing to test memory region 7f0967240000 (4096 bytes)

*** Preparing to test memory region 7f096776f000 (4096 bytes)

*** Preparing to test memory region 7f09680be000 (4096 bytes)

*** Preparing to test memory region 7f0968734000 (8192 bytes)

*** Preparing to test memory region 7f0968d76000 (4096 bytes)

*** Preparing to test memory region 7f0969a9d000 (4096 bytes)

*** Preparing to test memory region 7f096a497000 (8192 bytes)

*** Preparing to test memory region 7f096b33d000 (16384 bytes)

*** Preparing to test memory region 7f096b55c000 (16384 bytes)

*** Preparing to test memory region 7f096be9b000 (16384 bytes)

*** Preparing to test memory region 7f096c367000 (12288 bytes)

*** Preparing to test memory region 7f096d091000 (114688 bytes)

*** Preparing to test memory region 7f096d0b2000 (4096 bytes)

.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.