Skip to content

Creates test scenarios and test zones for test cases Delegation01, -02 and -03#1305

Merged
matsduf merged 20 commits into
zonemaster:developfrom
matsduf:create-test-scenario-delegation01-02-03
Dec 3, 2024
Merged

Creates test scenarios and test zones for test cases Delegation01, -02 and -03#1305
matsduf merged 20 commits into
zonemaster:developfrom
matsduf:create-test-scenario-delegation01-02-03

Conversation

@matsduf

@matsduf matsduf commented Nov 1, 2024

Copy link
Copy Markdown
Contributor

Purpose

This PR defines test scenarios and create test zones for test cases

  • Delegation01
  • Delegation02
  • Delegation03

New unit tests bases in this work have been created in zonemaster/zonemaster-engine#1395.

The implementation of Delegation02 also outputs tags SAME_IP_ADDRESS or DISTINCT_IP_ADDRESS. Those are however not defined in the test case specification, and they are disregarded for the scenarios. They do not seem to add any information to the result.

The unit tests created from these scenarios will replace legacy unit tests.

Context

zonemaster/zonemaster-engine#1395

How to test this PR

Review.

@matsduf matsduf force-pushed the create-test-scenario-delegation01-02-03 branch from b2fb2f0 to 06bfa47 Compare November 4, 2024 15:55
@matsduf matsduf force-pushed the create-test-scenario-delegation01-02-03 branch from 06bfa47 to 90d16eb Compare November 6, 2024 15:55
@matsduf matsduf changed the title Creates test scenarios for test cases Delegation01, -02 and -03 Creates test scenarios and test zones for test cases Delegation01, -02 and -03 Nov 6, 2024
@matsduf matsduf marked this pull request as ready for review November 6, 2024 15:58
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation02.md
@matsduf matsduf requested a review from tolvmannen November 11, 2024 15:23
@matsduf matsduf modified the milestones: v2025.1, v2024.2 Nov 12, 2024
@matsduf

matsduf commented Nov 13, 2024

Copy link
Copy Markdown
Contributor Author

@mattias-p, @marc-vanderwal, @tolvmannen, @tgreenx -- please review.

@mattias-p mattias-p left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've only read through the markdown files and noted things I saw as I passed by. It's a big PR, but if you want I can go through it again more thoroughly.

Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread test-zone-data/Delegation-TP/delegation01/README.md Outdated
@matsduf matsduf requested a review from mattias-p November 14, 2024 16:50

@mattias-p mattias-p left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I looked through the documentation again. I found a bunch of details to comment on, but overall it looks really good.

Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Missing glue, only IPv4 on ns1 and only IPv6 on ns2.

* Zone: mismatch-delegation-child-1.delegation01.xa
* Both ns1 and ns2 in delegation.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could this item be removed? It changes nothing compared to ENOUGH-1, right?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True.

The zone has only IPv4 on ns1 and only IPv6 on ns2.

* Zone: mismatch-delegation-child-2.delegation01.xa
* Both ns1 and ns2 in zone.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could this item be removed? It changes nothing compared to ENOUGH-1, right?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True.

Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation02.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation02.md Outdated
addresses, respectively.
* ns1a and ns1b have distinct addresses in the zone (IPv4 and IPv6,
respectively).
* Undelegated data:

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure how to interpret this item. Maybe I've missed something or maybe it could use a few more words of explanation.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have added a section to the "test scenario README file" referred to from this file. The update is included in this PR.

Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation02.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
@matsduf matsduf requested a review from mattias-p November 15, 2024 19:33
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation02.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread docs/public/specifications/test-zones/README.md Outdated
matsduf and others added 2 commits November 21, 2024 20:19
Co-authored-by: Marc van der Wal <103426270+marc-vanderwal@users.noreply.github.com>
@matsduf

matsduf commented Nov 22, 2024

Copy link
Copy Markdown
Contributor Author

@marc-vanderwal, please re-review.

marc-vanderwal
marc-vanderwal previously approved these changes Nov 25, 2024

@tgreenx tgreenx left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The file docs/public/SUMMARY.md should be updated too.

Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation01.md Outdated
* All addresses are distinct
* All required glue are present in the delegation.
* There is no actual zone or zone file, only a delegation.
* For this test, that the zone is missing is disregarded.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure of the intended meaning here for my suggestion, but it surely needs a rephrase.

Suggested change
* For this test, that the zone is missing is disregarded.
* For this test, that the missing zone is disregarded.

Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread docs/public/specifications/test-zones/Delegation-TP/delegation03.md Outdated
Comment thread docs/public/specifications/test-zones/README.md Outdated
matsduf and others added 2 commits November 27, 2024 10:01
Co-authored-by: tgreenx <96772376+tgreenx@users.noreply.github.com>
@matsduf

matsduf commented Nov 27, 2024

Copy link
Copy Markdown
Contributor Author

Resolved conflict that was created when #1294 was merged.

@tgreenx and @marc-vanderwal, please review/approve.

@matsduf matsduf merged commit 0c3fe5a into zonemaster:develop Dec 3, 2024
@matsduf matsduf deleted the create-test-scenario-delegation01-02-03 branch December 3, 2024 10:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants