Skip to content

Optimized select_support_mcl in sdsl-lite for faster loading with mmap#532

Merged
karasikov merged 2 commits intomasterfrom
mk/mmap_opt
Sep 29, 2025
Merged

Optimized select_support_mcl in sdsl-lite for faster loading with mmap#532
karasikov merged 2 commits intomasterfrom
mk/mmap_opt

Conversation

@karasikov
Copy link
Member

@karasikov karasikov commented Sep 24, 2025

This saves ~5 sec for loading ~30GB indexes. Now they load practically instantly.

Before:

	User time (seconds): 1.16
	System time (seconds): 4.00
	Percent of CPU this job got: 99%
	Elapsed (wall clock) time (h:mm:ss or m:ss): 0:05.17
	Maximum resident set size (kbytes): 257280

After:

	User time (seconds): 0.16
	System time (seconds): 0.33
	Percent of CPU this job got: 76%
	Elapsed (wall clock) time (h:mm:ss or m:ss): 0:00.64
	Maximum resident set size (kbytes): 584448

(for command: DIR=$(echo /scratch/0008); /usr/bin/time -v ./metagraph query -a $DIR/annotation.clean.row_diff_brwt.annodbg -i $DIR/graph.primary.small.dbg /scratch/query.fa --mmap -v)

@karasikov karasikov merged commit f6eff80 into master Sep 29, 2025
17 checks passed
@karasikov karasikov deleted the mk/mmap_opt branch September 29, 2025 08:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant