Skip to content

EPIC: Speed up development with improved integration testing tooling (no more shell scripts or flakiness) #1368

@laurentsenta

Description

@laurentsenta

eta: 2023-01

It looks like we have 2 ways to run integration tests:

  1. https://github.com/testground/testground/tree/master/pkg/cmd/itest
  2. https://github.com/testground/testground/tree/master/integration_tests

Some of these are testing the same commands.
The itest package makes go test -v ./pkg/... is annoying to use because integration tests are creating a lot of noise amongts unit tests.

We should merge all these tests to a single, clearer location.

A few notes:

  • Using go instead of shell make sense here, the header.sh script is already quite complex.
  • We need to take into account the fact that some integration tests require setup (k8s)
  • Bonus point for parallelizing tests, we might be able to use a github action's matrix.

Design

Tasks

  • Create a integration_tests package that relies on [golang's testing tools]
  • port test-integ-local-exec
    • Port the shell scripts to go
  • port test-integ-local-docker
    • Port the shell scripts to go
  • port test-integ-examples
    • Port the shell scripts to go

Metadata

Metadata

Assignees

No one assigned

    Labels

    starmapshttps://www.starmaps.app/

    Type

    No type

    Projects

    Status

    In Progress

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions