Skip to content

Latest commit

 

History

History
29 lines (26 loc) · 1.59 KB

todo.md

File metadata and controls

29 lines (26 loc) · 1.59 KB
Raw

TODO list

  • support other languages

  • json schema to possible_values.yaml

  • handle errors:

    • when no values exist
    • when files does not exist

  • fix remove approved file

  • use golang rather than filesystem commands

  • use config file. this allows testing in different languages

  • id should be reserved input key. Maybe change the structure of yaml template ?

  • error when min > max

  • parallel execution in sandboxed env until one of go routines increment mutation score:

    • if more than test increments mutation score. they should be re-executed in parallel like the traditional way
    • tests that does not increment mutation score should be deleted
    • then update test_cases.yaml file and then create go routines again
    • parallel execution should be optional. for some cases, parallel tests are not possible

  • sandboxed env should be optional

    • test_cases.yaml can be passed as env variable

  • BAD use map to store combos. combos hash is the key

    • map keys are not ordered every time

  • get value args should return only the value. extracting value from output should be within commands

  • store the state of initial config file as hash and current result of selected combos. if the hash of the config file is the same no need to calculate anything

    • store combos in file and load them so that the process may be stopped and continued

  • get number of cpu cores and launch concurrent jobs based on that number

  • optional config: toleratednumber or toleratedpercent. if value of remaining testcases is less or equal stop testing and return current testcases

  • cli to input config