Skip to content

test: add basic end-to-end test cases#5450

Merged
mergify[bot] merged 3 commits intomasterfrom
erik/e2e-test-cases
Oct 5, 2020
Merged

test: add basic end-to-end test cases#5450
mergify[bot] merged 3 commits intomasterfrom
erik/e2e-test-cases

Conversation

@erikgrinaker
Copy link
Contributor

@erikgrinaker erikgrinaker commented Oct 2, 2020

Partial fix for #5291.

This adds a basic set of test cases for core network invariants. Although small, it is sufficient to replace and extend the current set of P2P tests. Further test cases can be added later.

@erikgrinaker erikgrinaker added the T:test Type: Tests that need love label Oct 2, 2020
@erikgrinaker erikgrinaker self-assigned this Oct 2, 2020
@codecov
Copy link

codecov bot commented Oct 2, 2020

Codecov Report

Merging #5450 into master will decrease coverage by 1.94%.
The diff coverage is 54.17%.

@@            Coverage Diff             @@
##           master    #5450      +/-   ##
==========================================
- Coverage   63.29%   61.35%   -1.95%     
==========================================
  Files         181      259      +78     
  Lines       19080    23456    +4376     
==========================================
+ Hits        12077    14391    +2314     
- Misses       5973     7611    +1638     
- Partials     1030     1454     +424     
Impacted Files Coverage Δ
abci/client/client.go 40.00% <ø> (ø)
abci/client/grpc_client.go 0.00% <0.00%> (ø)
abci/client/local_client.go 0.00% <0.00%> (ø)
abci/types/pubkey.go 0.00% <0.00%> (ø)
abci/types/util.go 0.00% <0.00%> (ø)
behaviour/reporter.go 46.42% <ø> (-2.06%) ⬇️
blockchain/v1/reactor_fsm.go 70.81% <0.00%> (-3.62%) ⬇️
blockchain/v2/io.go 0.00% <0.00%> (ø)
blockchain/v2/processor_context.go 68.00% <0.00%> (+4.84%) ⬆️
cmd/tendermint/commands/run_node.go 0.00% <0.00%> (ø)
... and 299 more

Base automatically changed from erik/e2e-tests to master October 5, 2020 09:35
@mergify mergify bot requested a review from tac0turtle as a code owner October 5, 2020 09:35
Copy link
Contributor

@tac0turtle tac0turtle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

utACK

Copy link
Contributor

@melekes melekes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@erikgrinaker erikgrinaker added the S:automerge Automatically merge PR when requirements pass label Oct 5, 2020
@mergify mergify bot merged commit 090afe3 into master Oct 5, 2020
@mergify mergify bot deleted the erik/e2e-test-cases branch October 5, 2020 10:23
lovincyrus added a commit that referenced this pull request Oct 5, 2020
* docs: specify TM version in go tutorials (#5427)

Closes #5425

* privval: allow passing options to NewSignerDialerEndpoint (#5434)

Required for #5291 to set timeouts for remote signers.

* config: set statesync.rpc_servers when generating config file (#5433)

Required for #5291, to generate configuration files with state sync RPC servers.

* consensus: check block parts don't exceed maximum block bytes (#5431)

* ci: docker remvoe circleci and add github action (#5420)

* privval: fix ping message encoding (#5441)

Fixes #5371.

* docs: revise ADR 56, documenting short term decision around amnesia evidence  (#5440)

* light: expand on errors and docs (#5443)

* test: add end-to-end testing framework (#5435)

Partial fix for #5291. For details, see [README.md](https://github.com/tendermint/tendermint/blob/erik/e2e-tests/test/e2e/README.md) and [RFC-001](https://github.com/tendermint/tendermint/blob/master/docs/rfc/rfc-001-end-to-end-testing.md).

This only includes a single test case under `test/e2e/tests/`, as a proof of concept - additional test cases will be submitted separately. A randomized testnet generator will also be submitted separately, there a currently just a handful of static testnets under `test/e2e/networks/`. This will eventually replace the current P2P tests and run in CI.

* changelog: add missing date to v0.33.5 release, fix indentation (#5454)

I forgot to add the date when we cut 0.33.5. This fixes that. It also fixes a header indentation issue for 0.33.8.

* test: add basic end-to-end test cases (#5450)

Partial fix for #5291.

This adds a basic set of test cases for core network invariants. Although small, it is sufficient to replace and extend the current set of P2P tests. Further test cases can be added later.

* test: add GitHub action for end-to-end tests (#5452)

Partial fix for #5291.

* fix RPC blockresults reutrn (#5459)

## Description

In blocks_results we use the proto definition of abciResponses: https://github.com/tendermint/tendermint/blob/2672b91ab099b8b02f3afabae4a0a745acd93c3f/rpc/core/blocks.go#L152-L155, this leads to the use of the proto definition of the pubkey which is an interface in go (oneof). The interface must be registered with the JSON encoder to have it work correctly.

A clearer divide between proto types and native types is needed.

Closes: #XXX

* circleci: remove Gitian reproducible_builds job (#5462)

* docs: fix links to adr 56 (#5464)

## Description

fix broken link from a previous change

* test: remove P2P tests (#5453)

Co-authored-by: Anton Kaliaev <anton.kalyaev@gmail.com>
Co-authored-by: Erik Grinaker <erik@interchain.berlin>
Co-authored-by: Callum Waters <cmwaters19@gmail.com>
Co-authored-by: Marko <marbar3778@yahoo.com>
Co-authored-by: Tess Rinearson <tess.rinearson@gmail.com>
melekes pushed a commit that referenced this pull request Oct 9, 2020
Partial fix for #5291.

This adds a basic set of test cases for core network invariants. Although small, it is sufficient to replace and extend the current set of P2P tests. Further test cases can be added later.
erikgrinaker added a commit that referenced this pull request Oct 20, 2020
Partial fix for #5291.

This adds a basic set of test cases for core network invariants. Although small, it is sufficient to replace and extend the current set of P2P tests. Further test cases can be added later.
erikgrinaker added a commit that referenced this pull request Oct 22, 2020
Partial fix for #5291.

This adds a basic set of test cases for core network invariants. Although small, it is sufficient to replace and extend the current set of P2P tests. Further test cases can be added later.
erikgrinaker added a commit that referenced this pull request Oct 22, 2020
Partial fix for #5291.

This adds a basic set of test cases for core network invariants. Although small, it is sufficient to replace and extend the current set of P2P tests. Further test cases can be added later.
erikgrinaker added a commit that referenced this pull request Oct 22, 2020
Partial fix for #5291.

This adds a basic set of test cases for core network invariants. Although small, it is sufficient to replace and extend the current set of P2P tests. Further test cases can be added later.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

S:automerge Automatically merge PR when requirements pass T:test Type: Tests that need love

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants