Skip to content

Cleanup non-generic assertions in our deploy test suite#90894

Merged
ijjk merged 10 commits intocanaryfrom
ijjk/adapters-cleanup
Mar 4, 2026
Merged

Cleanup non-generic assertions in our deploy test suite#90894
ijjk merged 10 commits intocanaryfrom
ijjk/adapters-cleanup

Conversation

@ijjk
Copy link
Member

@ijjk ijjk commented Mar 4, 2026

This makes sure we don't have assertions that will only pass in one environment e.g. these should work for running against bun and not just node or against a local metadata URL not just a deployed https fully qualified domain. Ensures others can leverage this test suite for their own verification easily.

@nextjs-bot nextjs-bot added created-by: Next.js team PRs by the Next.js team. tests labels Mar 4, 2026
@ijjk ijjk marked this pull request as ready for review March 4, 2026 22:28
@ijjk ijjk requested review from feedthejim and ztanner March 4, 2026 22:31
// the custom 404 only shows inside of the basePath so this
// could be a platform default 404 page on deploy
if (!isNextDeploy) {
expect(text).toContain('This page could not be found')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe skip this entire assertion in deploy mode? since we're not testing what it's saying

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the above assertion could still fail if it passes through instead of rendering a 404 or similar. We just can't assert what the 404 content can be since not Next.js specific

@nextjs-bot
Copy link
Collaborator

Stats from current PR

✅ No significant changes detected

📊 All Metrics
📖 Metrics Glossary

Dev Server Metrics:

  • Listen = TCP port starts accepting connections
  • First Request = HTTP server returns successful response
  • Cold = Fresh build (no cache)
  • Warm = With cached build artifacts

Build Metrics:

  • Fresh = Clean build (no .next directory)
  • Cached = With existing .next directory

Change Thresholds:

  • Time: Changes < 50ms AND < 10%, OR < 2% are insignificant
  • Size: Changes < 1KB AND < 1% are insignificant
  • All other changes are flagged to catch regressions

⚡ Dev Server

Metric Canary PR Change Trend
Cold (Listen) 914ms 963ms ▇▁▁█▁
Cold (Ready in log) 920ms 922ms ▇▁▁█▂
Cold (First Request) 1.673s 1.677s ▇▁▃█▃
Warm (Listen) 965ms 964ms ▇▁▁█▁
Warm (Ready in log) 932ms 930ms ▇▁▁█▁
Warm (First Request) 718ms 725ms ▆▁▂█▁
📦 Dev Server (Webpack) (Legacy)

📦 Dev Server (Webpack)

Metric Canary PR Change Trend
Cold (Listen) 455ms 456ms ▁▁▁▁▁
Cold (Ready in log) 436ms 436ms ▄▂▁▃▃
Cold (First Request) 1.845s 1.853s ▂▁▁▁▂
Warm (Listen) 455ms 455ms ▁▁▁▁▁
Warm (Ready in log) 435ms 435ms ▃▂▁▃▂
Warm (First Request) 1.843s 1.863s ▂▁▁▁▂

⚡ Production Builds

Metric Canary PR Change Trend
Fresh Build 6.348s 6.431s ▆▁▁█▁
Cached Build 6.394s 6.161s ▆▁▁█▁
📦 Production Builds (Webpack) (Legacy)

📦 Production Builds (Webpack)

Metric Canary PR Change Trend
Fresh Build 13.877s 13.901s ▂▁▁▁▁
Cached Build 14.024s 13.977s ▂▁▁▁▁
node_modules Size 475 MB 475 MB ▁▁▁▁▁
📦 Bundle Sizes

Bundle Sizes

⚡ Turbopack

Client

Main Bundles: **401 kB** → **401 kB** ✅ -15 B

80 files with content-based hashes (individual files not comparable between builds)

Server

Middleware
Canary PR Change
middleware-b..fest.js gzip 765 B 765 B
Total 765 B 765 B
Build Details
Build Manifests
Canary PR Change
_buildManifest.js gzip 452 B 452 B
Total 452 B 452 B

📦 Webpack

Client

Main Bundles
Canary PR Change
5528-HASH.js gzip 5.54 kB N/A -
6280-HASH.js gzip 59.4 kB N/A -
6335.HASH.js gzip 169 B N/A -
912-HASH.js gzip 4.59 kB N/A -
e8aec2e4-HASH.js gzip 62.6 kB N/A -
framework-HASH.js gzip 59.7 kB 59.7 kB
main-app-HASH.js gzip 256 B 254 B
main-HASH.js gzip 39.1 kB 39.1 kB
webpack-HASH.js gzip 1.68 kB 1.68 kB
262-HASH.js gzip N/A 4.59 kB -
2889.HASH.js gzip N/A 169 B -
5602-HASH.js gzip N/A 5.55 kB -
6948ada0-HASH.js gzip N/A 62.6 kB -
9544-HASH.js gzip N/A 60.2 kB -
Total 233 kB 234 kB ⚠️ +731 B
Polyfills
Canary PR Change
polyfills-HASH.js gzip 39.4 kB 39.4 kB
Total 39.4 kB 39.4 kB
Pages
Canary PR Change
_app-HASH.js gzip 194 B 194 B
_error-HASH.js gzip 183 B 180 B 🟢 3 B (-2%)
css-HASH.js gzip 331 B 330 B
dynamic-HASH.js gzip 1.81 kB 1.81 kB
edge-ssr-HASH.js gzip 256 B 256 B
head-HASH.js gzip 351 B 352 B
hooks-HASH.js gzip 384 B 383 B
image-HASH.js gzip 580 B 581 B
index-HASH.js gzip 260 B 260 B
link-HASH.js gzip 2.51 kB 2.51 kB
routerDirect..HASH.js gzip 320 B 319 B
script-HASH.js gzip 386 B 386 B
withRouter-HASH.js gzip 315 B 315 B
1afbb74e6ecf..834.css gzip 106 B 106 B
Total 7.98 kB 7.98 kB ✅ -1 B

Server

Edge SSR
Canary PR Change
edge-ssr.js gzip 125 kB 125 kB
page.js gzip 254 kB 254 kB
Total 378 kB 379 kB ⚠️ +702 B
Middleware
Canary PR Change
middleware-b..fest.js gzip 618 B 616 B
middleware-r..fest.js gzip 156 B 155 B
middleware.js gzip 43.6 kB 43.6 kB
edge-runtime..pack.js gzip 842 B 842 B
Total 45.2 kB 45.2 kB ✅ -29 B
Build Details
Build Manifests
Canary PR Change
_buildManifest.js gzip 715 B 718 B
Total 715 B 718 B ⚠️ +3 B
Build Cache
Canary PR Change
0.pack gzip 4.04 MB 4.04 MB 🔴 +7.82 kB (+0%)
index.pack gzip 103 kB 103 kB
index.pack.old gzip 103 kB 103 kB
Total 4.24 MB 4.25 MB ⚠️ +7.76 kB

🔄 Shared (bundler-independent)

Runtimes
Canary PR Change
app-page-exp...dev.js gzip 321 kB 321 kB
app-page-exp..prod.js gzip 170 kB 170 kB
app-page-tur...dev.js gzip 321 kB 321 kB
app-page-tur..prod.js gzip 170 kB 170 kB
app-page-tur...dev.js gzip 318 kB 318 kB
app-page-tur..prod.js gzip 168 kB 168 kB
app-page.run...dev.js gzip 318 kB 318 kB
app-page.run..prod.js gzip 168 kB 168 kB
app-route-ex...dev.js gzip 70.3 kB 70.3 kB
app-route-ex..prod.js gzip 48.6 kB 48.6 kB
app-route-tu...dev.js gzip 70.4 kB 70.4 kB
app-route-tu..prod.js gzip 48.7 kB 48.7 kB
app-route-tu...dev.js gzip 69.9 kB 69.9 kB
app-route-tu..prod.js gzip 48.4 kB 48.4 kB
app-route.ru...dev.js gzip 69.9 kB 69.9 kB
app-route.ru..prod.js gzip 48.4 kB 48.4 kB
dist_client_...dev.js gzip 324 B 324 B
dist_client_...dev.js gzip 326 B 326 B
dist_client_...dev.js gzip 318 B 318 B
dist_client_...dev.js gzip 317 B 317 B
pages-api-tu...dev.js gzip 43.2 kB 43.2 kB
pages-api-tu..prod.js gzip 32.9 kB 32.9 kB
pages-api.ru...dev.js gzip 43.2 kB 43.2 kB
pages-api.ru..prod.js gzip 32.9 kB 32.9 kB
pages-turbo....dev.js gzip 52.6 kB 52.6 kB
pages-turbo...prod.js gzip 38.5 kB 38.5 kB
pages.runtim...dev.js gzip 52.6 kB 52.6 kB
pages.runtim..prod.js gzip 38.5 kB 38.5 kB
server.runti..prod.js gzip 61.8 kB 61.8 kB
Total 2.83 MB 2.83 MB ⚠️ +1 B
📎 Tarball URL
https://vercel-packages.vercel.app/next/commits/f7f1171f7eb4d67ddeca326808468a8b9be56c1a/next

@nextjs-bot
Copy link
Collaborator

Failing test suites

Commit: d462e0f | About building and testing Next.js

pnpm test-start-turbo test/production/deterministic-build/deployment-id.test.ts (turbopack) (job)

  • deterministic build - changing deployment id > build output API - cacheComponents builder > should produce identical build outputs even when changing deployment id (DD)
Expand output

● deterministic build - changing deployment id › build output API - cacheComponents builder › should produce identical build outputs even when changing deployment id

expect(received).toBe(expected) // Object.is equality

Expected: 0
Received: 1

  123 |   // First build
  124 |   next.env['NEXT_DEPLOYMENT_ID'] = 'foo-dpl-id'
> 125 |   expect((await next.build()).exitCode).toBe(0)
      |                                         ^
  126 |   let run1 = await readFiles(next)
  127 |
  128 |   // Second build

  at toBe (production/deterministic-build/deployment-id.test.ts:125:41)
  at Object.<anonymous> (production/deterministic-build/deployment-id.test.ts:263:30)

@ijjk ijjk merged commit da6fb31 into canary Mar 4, 2026
156 of 158 checks passed
@ijjk ijjk deleted the ijjk/adapters-cleanup branch March 4, 2026 23:59
sokra pushed a commit that referenced this pull request Mar 6, 2026
This makes sure we don't have assertions that will only pass in one
environment e.g. these should work for running against bun and not just
node or against a local metadata URL not just a deployed https fully
qualified domain. Ensures others can leverage this test suite for their
own verification easily.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

created-by: Next.js team PRs by the Next.js team. tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants