This is an umbrella issue to capture all of the tasks needed in order for a e2e test rebuilld.

Introduction

Our e2e tests currently take very long to run - about 30 minutes to 1 hour each run. Half of this time is composed of the actual build of the e2e test image, while the other half are the full suite to be ran.

This causes imense labor for a single PR to be reviewed, as it needs to be looked at in two different times.

Furthermore frequently a flaky test not related to the changes causes the e2e to fail, which makes this extremely hard to figure out if the PR has issues or not.

Goals

We should rewrite our e2e tests with the following goals in mind:

• does not need to be rebuilt after every run - only when changes to e2e/*.go are done (and only once)
• does not need to run the full suite when a given set of changes happen locally;
• can be easily ran locally without needing to build/ setup / run on a cluster.

As part of this umbrella issue, the following tasks should be done:

• Design Proposal on what are the chhanges needed and how will they be executed;
• Implementation of e2e Code changes as needed by the proposal
• Implementation of CI changes as needed by the proposal.

Issues

Add them as they are discussed in here