Skip to content

Auto defragmentation not working for 4.0.12 #9773

@liuhuang9492

Description

@liuhuang9492

@oranagra
hi, I'm running redis 4.0.12 in CentOS Linux release 7.4.1708 (Core). I have enabled active-defrag but it doesn't seem to do anything.
can you help me to find out why active-defrag doesn't run?

the follower is some example about the

info memory

used_memory:9823369872
used_memory_human:9.15G
used_memory_rss:27904212992
used_memory_rss_human:25.99G
used_memory_peak:27399710848
used_memory_peak_human:25.52G
used_memory_peak_perc:35.85%
used_memory_overhead:4061865096
used_memory_startup:3066944
used_memory_dataset:5761504776
used_memory_dataset_perc:58.67%
total_system_memory:404141654016
total_system_memory_human:376.39G
used_memory_lua:37888
used_memory_lua_human:37.00K
maxmemory:32212254720
maxmemory_human:30.00G
maxmemory_policy:volatile-lru
mem_fragmentation_ratio:2.84
mem_allocator:jemalloc-4.0.3
active_defrag_running:75

config

1) "active-defrag-threshold-lower"
2) "1"
3) "active-defrag-threshold-upper"
4) "100"
5) "active-defrag-ignore-bytes"
6) "1048576"
7) "active-defrag-cycle-min"
8) "25"
9) "active-defrag-cycle-max"
10) "75"
11) "activedefrag"
12) "yes"

debug log

59047:S 12 Nov 16:51:37.134 . allocated=9824517792, active=27259707392, resident=27925131264, frag=177% (184% rss), frag_bytes=17435189600 (18100613472% rss)
59047:S 12 Nov 16:51:38.876 . allocated=9824527664, active=27259756544, resident=27925131264, frag=177% (184% rss), frag_bytes=17435228880 (18100603600% rss)
59047:S 12 Nov 16:51:40.619 . allocated=9824527664, active=27259756544, resident=27925131264, frag=177% (184% rss), frag_bytes=17435228880 (18100603600% rss)

cat proc smaps info

01825000-01846000 rw-p 00000000 00:00 0 [heap]
Size: 132 kB
Rss: 56 kB
Pss: 56 kB
Shared_Clean: 0 kB
Shared_Dirty: 0 kB
Private_Clean: 0 kB
Private_Dirty: 56 kB
Referenced: 56 kB
Anonymous: 56 kB
AnonHugePages: 0 kB
Swap: 0 kB
KernelPageSize: 4 kB
MMUPageSize: 4 kB
Locked: 0 kB
VmFlags: rd wr mr mw me ac sd
7f6b4ae00000-7f71e3c00000 rw-p 00000000 00:00 0
Size: 27670528 kB
Rss: 27243196 kB
Pss: 27243196 kB
Shared_Clean: 0 kB
Shared_Dirty: 0 kB
Private_Clean: 0 kB
Private_Dirty: 27243196 kB
Referenced: 27243196 kB
Anonymous: 27243196 kB
AnonHugePages: 0 kB
Swap: 0 kB
KernelPageSize: 4 kB
MMUPageSize: 4 kB
Locked: 0 kB
VmFlags: rd wr mr mw me ac sd

memory malloc-stats

127.0.0.1:11101> MEMORY MALLOC-STATS
___ Begin jemalloc statistics ___
Version: 4.0.3-0-ge9192eacf8935e29fc62fddc2701f7942b1cc02c
Assertions disabled
Run-time option settings:
opt.abort: false
opt.lg_chunk: 21
opt.dss: "secondary"
opt.narenas: 128
opt.lg_dirty_mult: 3 (arenas.lg_dirty_mult: 3)
opt.stats_print: false
opt.junk: "false"
opt.quarantine: 0
opt.redzone: false
opt.zero: false
opt.tcache: true
opt.lg_tcache_max: 15
CPUs: 32
Arenas: 128
Pointer size: 8
Quantum size: 8
Page size: 4096
Min active:dirty page ratio per arena: 8:1
Maximum thread-cached size class: 32768
Chunk size: 2097152 (2^21)
Allocated: 9824657832, active: 27259772928, metadata: 666136320, resident: 27925217280, mapped: 28343009280
Current active ceiling: 27260878848

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions