Marketplace Launch Release TODOs List

[PauliusKu]

MLR must haves:

Quality

• ADE: review failing Whitespace test cases. Fix all major issues @darkeris345 Stability testing with ADE repo #238
• Try Whitespace testing with a few different code bases @darkeris345
• Introduce Compilation testing @PauliusJaskutelis Compilation testing framework #74
• Introduce Idempotence testing @PauliusJaskutelis Testing Formatter Idempotence #200
• No P0 or P1 bugs (tree-sitter and ours) @eglekaz . List those bugs here:
• ...

User testing

• Test on at least 3 different project codebases @eglekaz @PauliusKu @gustason

Features

• Expression formatting @gustason Expression formatter #49
• Preprocessor directives @eglekaz &IF, &THEN, &ELSEIF, &ELSE, and &ENDIF preprocessor directives get parsed as errors #217
• OnSave formatting settings @PauliusKu Separate configuration to enable only some features to work when formatting on save #277

Settings:

• Create Questionnaire @eglekaz
• Review Questionnaire's answers @eglekaz
• Default values @eglekaz
• Review descriptions @darkeris345
• Combine some settings @darkeris345

Other

• V1 code cleanup @PauliusJaskutelis Move code files out of v2 directory #190
• Update readme #280 @PauliusKu
• Write dev guidelines @darkeris345
• Extension Name

QA strategy

Name	Level	Metric	Objective
Telemetry	Product	Telemetry Data (e.g., crash reports, latency, settings configuration)	Stability, performance, real-world usage
Compilation	Formatter	Number of Compilation Errors After Formatting divided by the number of code files	Measure the correctness and reliability of the formatter
Whitespace	Formatter	Number of Non-Whitespace Changes in a given code base	Measure the correctness and reliability of the formatter
Idempotence	Formatter	Percentage of source files changed after 2nd formatting attempt	Formatter idempotence
Parser errors	Parser	Number of Parser Errors divided by the number of tree nodes	Measure the correctness of the parser
Functional	Function	Percentage of Passing Functional Test Cases	Ensure broad feature support and correct parsing behavior

1. Telemetry - TODO
2. Compilation - TODO
3. Whitespace - IN PROGRESS
4. Idempotence - TODO
5. Parser errors - IN PROGRESS
6. Functional - DONE