Skip to content

Move tests, create makefile action to run tests on examples#433

Merged
pww217 merged 16 commits intopyscript:mainfrom
marimeireles:marimeireles/infra-ex
May 26, 2022
Merged

Move tests, create makefile action to run tests on examples#433
pww217 merged 16 commits intopyscript:mainfrom
marimeireles:marimeireles/infra-ex

Conversation

@marimeireles
Copy link
Copy Markdown
Contributor

This allows tests to run on a examples directory created just for this end.
The examples created by the make examples command have their path to pyscript dependencies altered so they can run with the local build.

I ran the test and they all failed to me in the 2nd step:

>           assert pyodide_loading  # nosec
E           assert False

I wonder if I'm doing something wrong... Or if they're just not working?
If they should be working locally I'll look into what's up with them tomorrow!

@pww217
Copy link
Copy Markdown
Contributor

pww217 commented May 20, 2022

FYI small changes to makefile and such in #418, would probably merge in main.

@fpliger
Copy link
Copy Markdown
Contributor

fpliger commented May 23, 2022

@marimeireles is this one ready for review?

@pww217
Copy link
Copy Markdown
Contributor

pww217 commented May 24, 2022

This is on a forked branch so I can't edit it too easily, but @marimeireles if you could integrate some of the extra changes from #435 into this I'd appreciate it. Tag me for review when you can.

@marimeireles
Copy link
Copy Markdown
Contributor Author

@pww217 I'll look into it right now :)
Should have something in the next few hours.

@marimeireles marimeireles force-pushed the marimeireles/infra-ex branch from 83377c3 to 0c08e44 Compare May 24, 2022 23:21
@marimeireles marimeireles force-pushed the marimeireles/infra-ex branch from 0c08e44 to a710d4d Compare May 24, 2022 23:23
@marimeireles marimeireles force-pushed the marimeireles/infra-ex branch from a710d4d to 3edd5a4 Compare May 24, 2022 23:24
@marimeireles
Copy link
Copy Markdown
Contributor Author

marimeireles commented May 25, 2022

Some points:

  • In order to test pyscript I need to build it first

So I ask myself if we should just remove the the build step from the CI.
I think it's better than removing it from the make test from the Makefile because if we don't remove, means we can test everything with one command.
Not sure! whats the best to do. I'll leave it to you. =)

  • I don't think these tests failing are related to this PR?

@marimeireles marimeireles force-pushed the marimeireles/infra-ex branch from bf87188 to 80636a2 Compare May 25, 2022 14:41
@pww217
Copy link
Copy Markdown
Contributor

pww217 commented May 25, 2022

Not sure I fully understand. You basically mean you're integrating the build process into your examples testing?

So long as the build artifact exists and is ready to be shipped, we can do it in whatever order we want.

I think for clarity I'd rather see these separated out into distinct make commands, but put in a logic order.

So it seems like we're want it to look like this:

make example
make build
make test
sync

Then assuming the build itself is still where it usually is at examples/build/pyscript.js, etc. we can copy it to S3 as a deployment. Does that make sense?

@pww217
Copy link
Copy Markdown
Contributor

pww217 commented May 25, 2022

The failing tests may have to do with the fact that we lose some files by moving the examples dir, but I'm not sure why we lose them.

@marimeireles
Copy link
Copy Markdown
Contributor Author

marimeireles commented May 25, 2022

The failing tests may have to do with the fact that we lose some files by moving the examples dir, but I'm not sure why we lose them.

I thought I saw it failing on other PRs too, but no.
I'll investigate =) Thanks.

And I see what you mean, I agree. Will change.

@fpliger
Copy link
Copy Markdown
Contributor

fpliger commented May 25, 2022

On the question about removing build from CI. I think it's fine to say that we have to build it locally to test locally and CI can do the same. It actually ensures that the build works in different achitectures.

Copy link
Copy Markdown
Contributor

@fpliger fpliger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎉 yay!!

@pww217 pww217 merged commit a9470ed into pyscript:main May 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants