Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Design and document baselines for size and time ratings of Mutators #4

Open
6 of 7 tasks
capnspacehook opened this issue Sep 13, 2018 · 1 comment
Open
6 of 7 tasks
Assignees
Labels
enhancement New feature or request

Comments

@capnspacehook
Copy link
Member

capnspacehook commented Sep 13, 2018

We need an empirical method and scale on which to measure the size and time ratings of Mutators. @cpbarker and I drafted a scale for size ratings, but time ratings have proved to be more difficult. The size scale that @cpbarker and I came up with needs to be documented, and agreed upon by the team. An automated script would be very handy for measuring time ratings, and after enough data from existed Mutators is gathered, a scale for time ratings needs be created and documented as well.

  • Re-write time & size measuring script in python (currently in bash)
  • Set up a box for time testing
  • Automate graphing (makes it easier to determine growth rate and assign a rating)
  • Implement arguments (Number of repeats and mutator to test)
  • Document time growth rate testing and assignment procedure
  • Document size growth rate testing and assignment procedure
  • Automate assigning time and size ratings based off of data
@capnspacehook capnspacehook added the enhancement New feature or request label Sep 13, 2018
@cpbarker
Copy link
Contributor

@capnspacehook to set up a bench marking box. Folder and file glob data depends on disk write speeds, and we need a consistent platform to test them on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants