graphql-alt: scan transactions api by henryachen · Pull Request #24900 · MystenLabs/sui

henryachen · 2026-01-12T22:51:59Z

Description

Adds a new transactionsScan query that scans checkpoints using bloom filters to find transactions matching filter criteria.

Changes

GraphQL (sui-indexer-alt-graphql)

New transactionsScan query endpoint
maxScanLimit service config to limit checkpoints scanned per query
Transaction filter and scan logic in scan.rs

Schema (sui-indexer-alt-schema)

bloom_contains SQL function for checking probe membership in bloom filters

Reader (sui-indexer-alt-reader)

cp_blooms loader for batch-loading bloom filter data

Test plan

cargo nextest run -p sui-indexer-alt-graphql graphql_scan_limit_tests
cargo nextest run -p sui-indexer-alt-graphql
cargo nextest run -p sui-indexer-alt
cargo nextest run -p sui-indexer-alt-schema

Query Plan:

Limit  (cost=1911.69..1358704.33 rows=62 width=8) (actual time=14.454..14.836 rows=62 loops=1)
  Buffers: shared hit=7287
  CTE block_bit_probes
    ->  ProjectSet  (cost=0.00..8.20 rows=1635 width=18) (actual time=0.004..0.431 rows=1635 loops=1)
          ->  Result  (cost=0.00..0.01 rows=1 width=0) (actual time=0.001..0.001 rows=1 loops=1)
  ->  Nested Loop  (cost=1903.49..1358696.13 rows=62 width=8) (actual time=14.453..14.830 rows=62 loops=1)
        Buffers: shared hit=7287
        ->  Limit  (cost=1903.06..1903.22 rows=62 width=24) (actual time=14.411..14.414 rows=1 loops=1)
              Buffers: shared hit=6976
              CTE block_lookup
                ->  Nested Loop Left Join  (cost=41.30..1723.38 rows=200 width=131) (actual time=0.654..2.899 rows=327 loops=1)
                      Buffers: shared hit=1348
                      ->  HashAggregate  (cost=40.88..42.88 rows=200 width=10) (actual time=0.620..0.682 rows=327 loops=1)
                            Group Key: block_bit_probes_1.cp_block_index, block_bit_probes_1.bloom_idx
                            Batches: 1  Memory Usage: 61kB
                            ->  CTE Scan on block_bit_probes block_bit_probes_1  (cost=0.00..32.70 rows=1635 width=10) (actual time=0.000..0.159 rows=1635 loops=1)
                      ->  Index Scan using cp_bloom_blocks_pkey on cp_bloom_blocks bb  (cost=0.42..8.40 rows=1 width=131) (actual time=0.006..0.006 rows=1 loops=327)
                            Index Cond: ((cp_block_index = block_bit_probes_1.cp_block_index) AND (bloom_block_index = block_bit_probes_1.bloom_idx))
                            Buffers: shared hit=1343
              ->  Sort  (cost=179.69..180.17 rows=192 width=24) (actual time=14.410..14.412 rows=1 loops=1)
                    Sort Key: ((block_bit_probes.cp_block_index * '1000'::bigint))
                    Sort Method: quicksort  Memory: 25kB
                    Buffers: shared hit=6976
                    ->  Hash Right Anti Join  (cost=48.29..173.01 rows=192 width=24) (actual time=14.392..14.400 rows=5 loops=1)
                          Hash Cond: (p.cp_block_index = block_bit_probes.cp_block_index)
                          Buffers: shared hit=6976
                          ->  Hash Join  (cost=7.00..129.78 rows=8 width=8) (actual time=3.224..12.355 rows=1011 loops=1)
                                Hash Cond: ((p.cp_block_index = bl.cp_block_index) AND (p.bloom_idx = bl.bloom_idx))
                                Join Filter: ((bl.bloom_filter IS NULL) OR (p.bit_mask <> get_byte(bl.bloom_filter, (p.byte_pos % length(bl.bloom_filter)))))
                                Rows Removed by Join Filter: 624
                                Buffers: shared hit=6976
                                ->  CTE Scan on block_bit_probes p  (cost=0.00..32.70 rows=1635 width=18) (actual time=0.000..0.211 rows=1635 loops=1)
                                ->  Hash  (cost=4.00..4.00 rows=200 width=42) (actual time=3.142..3.142 rows=327 loops=1)
                                      Buckets: 1024  Batches: 1  Memory Usage: 93kB
                                      Buffers: shared hit=1348
                                      ->  CTE Scan on block_lookup bl  (cost=0.00..4.00 rows=200 width=42) (actual time=0.656..3.060 rows=327 loops=1)
                                            Buffers: shared hit=1348
                          ->  Hash  (cost=38.79..38.79 rows=200 width=8) (actual time=1.773..1.774 rows=327 loops=1)
                                Buckets: 1024  Batches: 1  Memory Usage: 21kB
                                ->  HashAggregate  (cost=36.79..38.79 rows=200 width=8) (actual time=1.668..1.717 rows=327 loops=1)
                                      Group Key: block_bit_probes.cp_block_index
                                      Batches: 1  Memory Usage: 61kB
                                      ->  CTE Scan on block_bit_probes  (cost=0.00..32.70 rows=1635 width=8) (actual time=0.007..1.162 rows=1635 loops=1)
        ->  Index Scan using cp_blooms_pkey on cp_blooms cb  (cost=0.43..21883.74 rows=1 width=8) (actual time=0.040..0.408 rows=62 loops=1)
              Index Cond: ((cp_sequence_number >= ((block_bit_probes.cp_block_index * '1000'::bigint))) AND (cp_sequence_number <= ((((block_bit_probes.cp_block_index * '1000'::bigint) + '1000'::bigint) - 1))))
              Filter: (((get_byte(bloom_filter, (208 % length(bloom_filter))) & 8) = 8) AND ((get_byte(bloom_filter, (5988 % length(bloom_filter))) & 32) = 32) AND ((get_byte(bloom_filter, (8084 % length(bloom_filter))) & 32) = 32) AND ((get_byte(bloom_filter, (15059 % length(bloom_filter))) & 32) = 32) AND ((get_byte(bloom_filter, (8330 % length(bloom_filter))) & 64) = 64) AND ((get_byte(bloom_filter, (10313 % length(bloom_filter))) & 4) = 4))
              Rows Removed by Filter: 318
              Buffers: shared hit=311
Planning:
  Buffers: shared hit=78
Planning Time: 2.181 ms
Execution Time: 15.060 ms

Stack:

#24788
#24900 👈
#25097

Release notes

Check each box that your changes affect. If none of the boxes relate to your changes, release notes aren't required.

For each box you select, include information after the relevant heading that describes the impact of your changes that a user might notice and any actions they must take to implement updates.

vercel · 2026-01-12T22:52:03Z

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
sui-docs	Ready	Preview, Comment	Mar 5, 2026 4:43am

2 Skipped Deployments

Project	Deployment	Actions	Updated (UTC)
multisig-toolkit	Ignored	Preview	Mar 5, 2026 4:43am
sui-kiosk	Ignored	Preview	Mar 5, 2026 4:43am

crates/sui-indexer-alt-graphql/src/lib.rs

…ing sql and e2e scan tests

… the page limit

## Description - Added scanEvent GraphQL query endpoint for scanning events using bloom filters - Reuse existing scan infrastructure (bloom querying, pagination) from Transaction Scanning - Added e2e tests covering filtering by sender, module, type, and pagination ## Test plan ``` cargo nextest run -p sui-indexer-alt-graphql cargo nextest run -p sui-indexer-alt-graphql -- schema_sdl cargo nextest run -p sui-indexer-alt-graphql --features staging -- schema_sdl cargo nextest run -p sui-indexer-alt-e2e-tests -- graphql/ ``` ## Stack: #24788 #24900 #25097 👈 --- ## Release notes Check each box that your changes affect. If none of the boxes relate to your changes, release notes aren't required. For each box you select, include information after the relevant heading that describes the impact of your changes that a user might notice and any actions they must take to implement updates. - [ ] Protocol: - [ ] Nodes (Validators and Full nodes): - [ ] gRPC: - [ ] JSON-RPC: - [ ] GraphQL: - [ ] CLI: - [ ] Rust SDK: - [ ] Indexing Framework:

This reverts commit 97e246f.

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 12, 2026 22:52 — with GitHub Actions Inactive

henryachen mentioned this pull request Jan 12, 2026

graphql-alt: scanning api bloom filter pipelines #24788

Merged

8 tasks

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 13, 2026 06:54 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs January 13, 2026 06:56 View deployment

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 13, 2026 20:23 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs January 13, 2026 20:25 View deployment

henryachen commented Jan 13, 2026

View reviewed changes

crates/sui-indexer-alt-graphql/src/lib.rs Outdated Show resolved Hide resolved

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 13, 2026 22:46 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs January 13, 2026 22:48 View deployment

henryachen force-pushed the hc/dvx-1290-scanning-api-write branch from b1ce241 to 7a0f2d4 Compare January 14, 2026 06:10

henryachen force-pushed the hc/dvx-1290-read_txns branch from 5e90814 to d4f7290 Compare January 16, 2026 01:41

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 16, 2026 01:41 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs January 16, 2026 01:45 View deployment

henryachen force-pushed the hc/dvx-1290-scanning-api-write branch from 7076022 to 06df5b0 Compare January 26, 2026 01:59

henryachen force-pushed the hc/dvx-1290-read_txns branch from d4f7290 to e2071f3 Compare January 26, 2026 03:55

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 26, 2026 03:55 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs January 26, 2026 03:57 View deployment

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 26, 2026 05:55 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs January 26, 2026 05:56 View deployment

henryachen mentioned this pull request Jan 26, 2026

graphql-alt: add event scanning #25097

Merged

8 tasks

henryachen marked this pull request as ready for review January 26, 2026 07:41

henryachen requested a review from a team as a code owner January 26, 2026 07:41

henryachen requested review from amnn, emmazzz, evan-wall-mysten, nickvikeras, tpham-mysten and wlmyng January 26, 2026 07:41

henryachen temporarily deployed to sui-typescript-aws-kms-test-env January 26, 2026 07:41 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs March 4, 2026 18:57 View deployment

henryachen and others added 20 commits March 4, 2026 17:55

graphql-alt: scan transactions api

f039191

tests: update staging schema

080ef77

fixup: remove redundant const

59c34d0

remove unused dataloader, fixup scan limit off by one

f0e9e03

removed unecessary closure in filter matching

4bd78a0

update probes for blocked and standard blooms

0759719

address comments

7a0cd09

handle empty filters gracefully

39c2f13

Move scan module under transaction namespace and simplify bloom scann…

24e2f78

…ing sql and e2e scan tests

update scanning error message

cbdd8a2

Add materialized CTEs

951fc68

use cross lateral joins to enforce scanning by block then by cp up to…

47715c9

… the page limit

consolidate modules and simplify scan result construction

d51bc3c

Improve candidate_cps sql query and consolidate modules

3091f32

doc comment cleanup

9b12b18

clean up scan limit tests

5204d5e

address comments

cb94115

Scan validator check for filters and fix sql bug

e7bf2b3

Fix bug in pagination and panic when limits are missing in configs

6af2c41

henryachen force-pushed the hc/dvx-1290-read_txns branch from 9c831b9 to 46bfc33 Compare March 5, 2026 04:38

henryachen temporarily deployed to sui-typescript-aws-kms-test-env March 5, 2026 04:38 — with GitHub Actions Inactive

vercel bot deployed to Preview – sui-docs March 5, 2026 04:43 View deployment

henryachen merged commit 97e246f into main Mar 5, 2026
63 of 64 checks passed

henryachen deleted the hc/dvx-1290-read_txns branch March 5, 2026 05:55

henryachen added a commit that referenced this pull request Mar 5, 2026

Revert "graphql-alt: scan apis (#24900)"

866c5f2

This reverts commit 97e246f.

henryachen restored the hc/dvx-1290-read_txns branch March 5, 2026 16:17

henryachen added a commit that referenced this pull request Mar 5, 2026

Revert "graphql-alt: scan apis (#24900)"

42112eb

This reverts commit 97e246f.

henryachen mentioned this pull request Mar 5, 2026

graphql-alt: scan apis #25717

Open

16 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

graphql-alt: scan transactions api#24900

graphql-alt: scan transactions api#24900
henryachen merged 20 commits intomainfrom
hc/dvx-1290-read_txns

henryachen commented Jan 12, 2026 •

edited

Loading

Uh oh!

vercel bot commented Jan 12, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

henryachen commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Test plan

Stack:

#24788 #24900 👈 #25097

Release notes

Uh oh!

vercel bot commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

henryachen commented Jan 12, 2026 •

edited

Loading

#24788
#24900 👈
#25097

vercel bot commented Jan 12, 2026 •

edited

Loading