Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: astonishing sophisticated system testing testcase, untested #421

Draft
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

Ray-Eldath
Copy link

test: astonishing sophisticated system testing testcase, untested
misc: create .editorconfig to enforce code styles (especially imports sorting & grouping rules)


the system testing testcase only relies on test-infra sdk and temporaily be placed here, we'll created a new ad-hoc repo if necessary, as already discussed with @cosven.

misc: create .editorconfig to enforce code styles (especially imports sorting & grouping rules)
@Ray-Eldath
Copy link
Author

I'll test this once I wake up. now I have to go for sleep. 😪

I have to say that, it's pretty frustrating to see that the complexity with regard to the automation of system testing is much beyond my expection. I think the planned ad-hoc framework need a very careful design, and will be a big project.

@Ray-Eldath
Copy link
Author

Ray-Eldath commented Jun 17, 2021

yeah this piece of code should really be moved into another repo. Makefile and CI and all other stuff are just completely irrelevant.

and as regard to the new framework, there're several ideas just came out of my mind and imho really worth investigating.

test: tested metrics & constraints for sdk-ticase-4885.
@mahjonp
Copy link
Contributor

mahjonp commented Jun 19, 2021

Seems that the data on s3://tpcc/br-2t is broken.

[2021-06-19 02:17:31] execute run failed, err exec SELECT d_street_1, d_street_2, d_city, d_state, d_zip, d_name FROM district WHERE d_w_id = ? AND d_id = ? failed sql: no rows in result set
execute run failed, err exec SELECT d_street_1, d_street_2, d_city, d_state, d_zip, d_name FROM district WHERE d_w_id = ? AND d_id = ? failed sql: no rows in result set
[2021-06-19 02:17:31] execute run failed, err exec SELECT c_discount, c_last, c_credit, w_tax FROM customer, warehouse WHERE w_id = ? AND c_w_id = w_id AND c_d_id = ? AND c_id = ?(wID=3,dID=10,cID=974) failed sql: no rows in result set
execute run failed, err exec SELECT c_discount, c_last, c_credit, w_tax FROM customer, warehouse WHERE w_id = ? AND c_w_id = w_id AND c_d_id = ? AND c_id = ?(wID=3,dID=10,cID=974) failed sql: no rows in result set
[2021-06-19 02:17:31] execute run failed, err exec SELECT d_street_1, d_street_2, d_city, d_state, d_zip, d_name FROM district WHERE d_w_id = ? AND d_id = ? failed sql: no rows in result set
execute run failed, err exec SELECT d_street_1, d_street_2, d_city, d_state, d_zip, d_name FROM district WHERE d_w_id = ? AND d_id = ? failed sql: no rows in result set
[2021-06-19 02:17:31] execute run failed, err exec SELECT d_street_1, d_street_2, d_city, d_state, d_zip, d_name FROM district WHERE d_w_id = ? AND d_id = ? failed sql: no rows in result set
execute run failed, err exec SELECT d_street_1, d_street_2, d_city, d_state, d_zip, d_name FROM district WHERE d_w_id = ? AND d_id = ? failed sql: no rows in result set
Finished
[Summary] NEW_ORDER_ERR - Takes(s): 0.0, Count: 4, TPM: 13531.1, Sum(ms): 22.2, Avg(ms): 5.5, 50th(ms): 3.1, 90th(ms): 11.5, 95th(ms): 11.5, 99th(ms): 11.5, 99.9th(ms): 11.5, Max(ms): 11.5
[Summary] PAYMENT_ERR - Takes(s): 0.0, Count: 4, TPM: 14865.9, Sum(ms): 32.0, Avg(ms): 8.1, 50th(ms): 6.8, 90th(ms): 12.1, 95th(ms): 12.1, 99th(ms): 12.1, 99.9th(ms): 12.1, Max(ms): 12.1

… I YET AGAIN ran into very bizarre and GRUELLING networking problems. :-((((((
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants