Skip to content

an few more benchmarks #799

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
lemire merged 3 commits into from
Aug 21, 2025
Merged

an few more benchmarks #799

lemire merged 3 commits into from
Aug 21, 2025

Conversation

@mkeskells
Copy link
Contributor

@mkeskells mkeskells commented Aug 21, 2025

SUMMARY

followup to #797

Automated Checks

  • I have run ./gradlew test and made sure that my PR does not break any unit test.

I missed a commit :-(. added comments and then didnt push the updates cos I lost connectivity

from running
java -jar jmh/build/libs/benchmarks.jar -f 1 -r2 -i 5 -w 2 -wi 2 'org.roaringbitmap.longlong.*'

the values are not so interesting, but this shows the spread of parameters

Benchmark                                          (addedSize)  (count)  (initialSize)  (ordered)  (orderedAdd)  (pos)   (size)   Mode  Cnt          Score           Error  Units
AddRoaring64.AddExistingState.addAllExisting             10000      N/A          10000        N/A          true    N/A      N/A  thrpt    5       3932.510 ┬▒       136.842  ops/s
AddRoaring64.AddExistingState.addAllExisting             10000      N/A          10000        N/A         false    N/A      N/A  thrpt    5       4382.218 ┬▒        28.232  ops/s
AddRoaring64.AddExistingState.addAllExisting             10000      N/A         100000        N/A          true    N/A      N/A  thrpt    5       1435.385 ┬▒       198.959  ops/s
AddRoaring64.AddExistingState.addAllExisting             10000      N/A         100000        N/A         false    N/A      N/A  thrpt    5       2008.613 ┬▒        41.096  ops/s
AddRoaring64.AddExistingState.addAllExisting             10000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5        869.570 ┬▒       132.874  ops/s
AddRoaring64.AddExistingState.addAllExisting             10000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5       1104.556 ┬▒       164.428  ops/s
AddRoaring64.AddExistingState.addAllExisting            100000      N/A         100000        N/A          true    N/A      N/A  thrpt    5        298.022 ┬▒         9.523  ops/s
AddRoaring64.AddExistingState.addAllExisting            100000      N/A         100000        N/A         false    N/A      N/A  thrpt    5        298.597 ┬▒        11.247  ops/s
AddRoaring64.AddExistingState.addAllExisting            100000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5         34.896 ┬▒         2.108  ops/s
AddRoaring64.AddExistingState.addAllExisting            100000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5         72.945 ┬▒         1.874  ops/s
AddRoaring64.AddExistingState.addAllExisting           1000000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5         29.336 ┬▒         0.337  ops/s
AddRoaring64.AddExistingState.addAllExisting           1000000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5         29.817 ┬▒         0.358  ops/s
AddRoaring64.AddExistingState.addAllMissing              10000      N/A          10000        N/A          true    N/A      N/A  thrpt    5       3870.460 ┬▒       103.509  ops/s
AddRoaring64.AddExistingState.addAllMissing              10000      N/A          10000        N/A         false    N/A      N/A  thrpt    5       2813.566 ┬▒        65.400  ops/s
AddRoaring64.AddExistingState.addAllMissing              10000      N/A         100000        N/A          true    N/A      N/A  thrpt    5       2140.889 ┬▒        53.997  ops/s
AddRoaring64.AddExistingState.addAllMissing              10000      N/A         100000        N/A         false    N/A      N/A  thrpt    5       1676.564 ┬▒        15.150  ops/s
AddRoaring64.AddExistingState.addAllMissing              10000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5       1516.801 ┬▒        87.140  ops/s
AddRoaring64.AddExistingState.addAllMissing              10000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5       1154.995 ┬▒       104.063  ops/s
AddRoaring64.AddExistingState.addAllMissing             100000      N/A         100000        N/A          true    N/A      N/A  thrpt    5        216.285 ┬▒         9.701  ops/s
AddRoaring64.AddExistingState.addAllMissing             100000      N/A         100000        N/A         false    N/A      N/A  thrpt    5         99.928 ┬▒        43.609  ops/s
AddRoaring64.AddExistingState.addAllMissing             100000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5        106.731 ┬▒         3.465  ops/s
AddRoaring64.AddExistingState.addAllMissing             100000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5         53.733 ┬▒         3.647  ops/s
AddRoaring64.AddExistingState.addAllMissing            1000000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5         25.739 ┬▒         1.015  ops/s
AddRoaring64.AddExistingState.addAllMissing            1000000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5          3.597 ┬▒         0.135  ops/s
AddRoaring64.AddExistingState.addEachExisting            10000      N/A          10000        N/A          true    N/A      N/A  thrpt    5       3762.726 ┬▒       116.024  ops/s
AddRoaring64.AddExistingState.addEachExisting            10000      N/A          10000        N/A         false    N/A      N/A  thrpt    5       4064.387 ┬▒        66.639  ops/s
AddRoaring64.AddExistingState.addEachExisting            10000      N/A         100000        N/A          true    N/A      N/A  thrpt    5       1471.512 ┬▒        77.324  ops/s
AddRoaring64.AddExistingState.addEachExisting            10000      N/A         100000        N/A         false    N/A      N/A  thrpt    5       2014.650 ┬▒        40.140  ops/s
AddRoaring64.AddExistingState.addEachExisting            10000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5        861.736 ┬▒       237.434  ops/s
AddRoaring64.AddExistingState.addEachExisting            10000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5       1133.587 ┬▒        82.337  ops/s
AddRoaring64.AddExistingState.addEachExisting           100000      N/A         100000        N/A          true    N/A      N/A  thrpt    5        301.677 ┬▒        11.181  ops/s
AddRoaring64.AddExistingState.addEachExisting           100000      N/A         100000        N/A         false    N/A      N/A  thrpt    5        299.001 ┬▒         9.270  ops/s
AddRoaring64.AddExistingState.addEachExisting           100000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5         34.348 ┬▒         2.507  ops/s
AddRoaring64.AddExistingState.addEachExisting           100000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5         72.185 ┬▒         1.149  ops/s
AddRoaring64.AddExistingState.addEachExisting          1000000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5         27.274 ┬▒         1.076  ops/s
AddRoaring64.AddExistingState.addEachExisting          1000000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5         27.984 ┬▒         1.831  ops/s
AddRoaring64.AddExistingState.addEachMissing             10000      N/A          10000        N/A          true    N/A      N/A  thrpt    5       3867.195 ┬▒        51.703  ops/s
AddRoaring64.AddExistingState.addEachMissing             10000      N/A          10000        N/A         false    N/A      N/A  thrpt    5       3102.123 ┬▒        76.003  ops/s
AddRoaring64.AddExistingState.addEachMissing             10000      N/A         100000        N/A          true    N/A      N/A  thrpt    5       2116.688 ┬▒        95.294  ops/s
AddRoaring64.AddExistingState.addEachMissing             10000      N/A         100000        N/A         false    N/A      N/A  thrpt    5       1603.826 ┬▒       392.975  ops/s
AddRoaring64.AddExistingState.addEachMissing             10000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5       1402.647 ┬▒       534.728  ops/s
AddRoaring64.AddExistingState.addEachMissing             10000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5       1268.652 ┬▒        64.677  ops/s
AddRoaring64.AddExistingState.addEachMissing            100000      N/A         100000        N/A          true    N/A      N/A  thrpt    5        219.244 ┬▒        15.140  ops/s
AddRoaring64.AddExistingState.addEachMissing            100000      N/A         100000        N/A         false    N/A      N/A  thrpt    5        107.581 ┬▒        53.497  ops/s
AddRoaring64.AddExistingState.addEachMissing            100000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5        118.859 ┬▒         6.273  ops/s
AddRoaring64.AddExistingState.addEachMissing            100000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5         57.299 ┬▒         9.762  ops/s
AddRoaring64.AddExistingState.addEachMissing           1000000      N/A        1000000        N/A          true    N/A      N/A  thrpt    5         27.273 ┬▒         1.136  ops/s
AddRoaring64.AddExistingState.addEachMissing           1000000      N/A        1000000        N/A         false    N/A      N/A  thrpt    5          3.981 ┬▒         0.672  ops/s
BuildFromEmpty.addArray                                    N/A      N/A            N/A       true           N/A    N/A    10000   avgt    5     507402.801 ┬▒     83357.610  ns/op
BuildFromEmpty.addArray                                    N/A      N/A            N/A       true           N/A    N/A   100000   avgt    5    5488799.490 ┬▒   1307045.514  ns/op
BuildFromEmpty.addArray                                    N/A      N/A            N/A       true           N/A    N/A  1000000   avgt    5  122133122.526 ┬▒ 148422225.810  ns/op
BuildFromEmpty.addArray                                    N/A      N/A            N/A      false           N/A    N/A    10000   avgt    5     651811.911 ┬▒     41143.100  ns/op
BuildFromEmpty.addArray                                    N/A      N/A            N/A      false           N/A    N/A   100000   avgt    5    7956140.614 ┬▒    368207.228  ns/op
BuildFromEmpty.addArray                                    N/A      N/A            N/A      false           N/A    N/A  1000000   avgt    5  265892953.056 ┬▒  55589842.385  ns/op
BuildFromEmpty.addLong                                     N/A      N/A            N/A       true           N/A    N/A    10000   avgt    5     512808.235 ┬▒    125461.685  ns/op
BuildFromEmpty.addLong                                     N/A      N/A            N/A       true           N/A    N/A   100000   avgt    5    5381379.941 ┬▒    494736.458  ns/op
BuildFromEmpty.addLong                                     N/A      N/A            N/A       true           N/A    N/A  1000000   avgt    5  103103234.150 ┬▒  36203470.584  ns/op
BuildFromEmpty.addLong                                     N/A      N/A            N/A      false           N/A    N/A    10000   avgt    5     636411.212 ┬▒     40955.398  ns/op
BuildFromEmpty.addLong                                     N/A      N/A            N/A      false           N/A    N/A   100000   avgt    5    8202295.868 ┬▒    432734.947  ns/op
BuildFromEmpty.addLong                                     N/A      N/A            N/A      false           N/A    N/A  1000000   avgt    5  272096218.333 ┬▒  88844179.670  ns/op
BuildFromEmpty.bitmapOf                                    N/A      N/A            N/A       true           N/A    N/A    10000   avgt    5     495158.857 ┬▒     68549.418  ns/op
BuildFromEmpty.bitmapOf                                    N/A      N/A            N/A       true           N/A    N/A   100000   avgt    5    5250895.964 ┬▒    507784.027  ns/op
BuildFromEmpty.bitmapOf                                    N/A      N/A            N/A       true           N/A    N/A  1000000   avgt    5  102327003.612 ┬▒  27101759.677  ns/op
BuildFromEmpty.bitmapOf                                    N/A      N/A            N/A      false           N/A    N/A    10000   avgt    5     610630.037 ┬▒     99512.415  ns/op
BuildFromEmpty.bitmapOf                                    N/A      N/A            N/A      false           N/A    N/A   100000   avgt    5    8104207.726 ┬▒   1292396.320  ns/op
BuildFromEmpty.bitmapOf                                    N/A      N/A            N/A      false           N/A    N/A  1000000   avgt    5  265362659.008 ┬▒  81693402.750  ns/op
FindRoaring64.findMissing                                  N/A      N/A            N/A       true           N/A    N/A    10000   avgt    5     101929.873 ┬▒      5348.790  ns/op
FindRoaring64.findMissing                                  N/A      N/A            N/A       true           N/A    N/A   100000   avgt    5    3407398.048 ┬▒    143623.943  ns/op
FindRoaring64.findMissing                                  N/A      N/A            N/A       true           N/A    N/A  1000000   avgt    5   73827665.582 ┬▒   4674673.323  ns/op
FindRoaring64.findMissing                                  N/A      N/A            N/A      false           N/A    N/A    10000   avgt    5     100204.215 ┬▒      2444.343  ns/op
FindRoaring64.findMissing                                  N/A      N/A            N/A      false           N/A    N/A   100000   avgt    5    3178257.487 ┬▒    612262.646  ns/op
FindRoaring64.findMissing                                  N/A      N/A            N/A      false           N/A    N/A  1000000   avgt    5   73466042.646 ┬▒   3625955.893  ns/op
FindRoaring64.findPresent                                  N/A      N/A            N/A       true           N/A    N/A    10000   avgt    5     158266.949 ┬▒      1949.514  ns/op
FindRoaring64.findPresent                                  N/A      N/A            N/A       true           N/A    N/A   100000   avgt    5    2562890.936 ┬▒    134693.061  ns/op
FindRoaring64.findPresent                                  N/A      N/A            N/A       true           N/A    N/A  1000000   avgt    5   25334448.940 ┬▒   2119151.595  ns/op
FindRoaring64.findPresent                                  N/A      N/A            N/A      false           N/A    N/A    10000   avgt    5     192587.831 ┬▒      6307.206  ns/op
FindRoaring64.findPresent                                  N/A      N/A            N/A      false           N/A    N/A   100000   avgt    5    5012811.488 ┬▒    421244.096  ns/op
FindRoaring64.findPresent                                  N/A      N/A            N/A      false           N/A    N/A  1000000   avgt    5  138962870.702 ┬▒  16589007.867  ns/op
ShiftLeftFromSpecifiedPositionBenchmark.optimized          N/A        1            N/A        N/A           N/A      0      N/A   avgt    5          1.757 ┬▒         0.017  ns/op
ShiftLeftFromSpecifiedPositionBenchmark.optimized          N/A        1            N/A        N/A           N/A      2      N/A   avgt    5          1.753 ┬▒         0.066  ns/op
ShiftLeftFromSpecifiedPositionBenchmark.optimized          N/A        2            N/A        N/A           N/A      0      N/A   avgt    5          1.761 ┬▒         0.040  ns/op
ShiftLeftFromSpecifiedPositionBenchmark.optimized          N/A        2            N/A        N/A           N/A      2      N/A   avgt    5          1.757 ┬▒         0.030  ns/op
ShiftLeftFromSpecifiedPositionBenchmark.original           N/A        1            N/A        N/A           N/A      0      N/A   avgt    5          5.632 ┬▒         0.229  ns/op
ShiftLeftFromSpecifiedPositionBenchmark.original           N/A        1            N/A        N/A           N/A      2      N/A   avgt    5          5.577 ┬▒         0.148  ns/op
ShiftLeftFromSpecifiedPositionBenchmark.original           N/A        2            N/A        N/A           N/A      0      N/A   avgt    5          7.951 ┬▒         0.421  ns/op

@mkeskells
Copy link
Contributor Author

mkeskells commented Aug 21, 2025

not sure why addAllMissing is misreported as from AddExistingState in the report

@lemire lemire merged commit aa5bf0b into RoaringBitmap:master Aug 21, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@mkeskells @lemire