Write a script to run e2e test

[nprizal]

Description

We now have four runners supported in bktec. Since we have sample projects for each test runner that we use for unit and integration tests, I thought it would be great to use those sample projects to run end-to-end tests. This PR adds a script that runs bktec (using go run …) against a sample project located in internal/runner/testdata.

To run the e2e test:

#.bin/e2e <runner> <parallel-job>
.bin/e2e rspec 0

[nprizal]

I added this so we can run bktec from this project using the default command bundle exec rspec ...

[wooly]

I've been testing this this morning and think it could maybe use some automation/instruction around bootstrapping.

I'm getting an error relating to bundle install not being run for the rspec test suite, and a module not found error when trying to run it for playwright.

[niceking]

I like this! This just enables running the tests for each language in the bktec repo yeah?

One comment on the usage interface:

#.bin/e2e <runner> <parallel-job>
.bin/e2e rspec 0

I understand why we'd wanna specify the framework as a top level argument into the script here, but I'm less convinced that the script should mandate passing in a parallel job? What possible variance do you see in this argument? IMO if parallel job count has a default then its fine that parallel job has one too

[nprizal]

I like this! This just enables running the tests for each language in the bktec repo yeah?

Yes, that's right

One comment on the usage interface:

#.bin/e2e <runner> <parallel-job>
.bin/e2e rspec 0

I understand why we'd wanna specify the framework as a top level argument into the script here, but I'm less convinced that the script should mandate passing in a parallel job? What possible variance do you see in this argument? IMO if parallel job count has a default then its fine that parallel job has one too

That's a good point. I've removed parallel job from the arg. You can still set that variable manually as

BUILDKITE_PARALLEL_JOB=1 bin/e2e

[nprizal]

I've been testing this this morning and think it could maybe use some automation/instruction around bootstrapping.

I'm getting an error relating to bundle install not being run for the rspec test suite, and a module not found error when trying to run it for playwright.

@wooly I created a bin/setup to install all dependencies for sample projects. This will be useful for engineers contributing to this repo as well.