Skip to content

Commit

Permalink
Add browser key and mention on how to interpret certain failures (#270
Browse files Browse the repository at this point in the history
)

* Add `browser` key and mention on how to interpret certain failures

* Update ts-036-browser_web.md
  • Loading branch information
hellais authored Jan 16, 2023
1 parent bfb7d57 commit 22c74f2
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion nettests/ts-036-browser_web.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,7 @@ fail and appear to be a result of blocking.
Firefox users should be asked, if they have strict enhanced tracking protection
enabled, to add a whitelist rule for the website hosting the experiment,
however this is not a guarantee that they will run the test with it on.
If a site is deemed inaccessible as a result of specific settings the user has in their browser, the `load_time_ms` will generally be significantly lower than a truly blocked website. When interpreting the data this should be taken into account.

# Expected output

Expand All @@ -89,6 +90,7 @@ where:
while it will be `error` in the case of a failure;
* `load_time_ms` (`float`) indicates the number of milliseconds it took to load
the requested resource.
* `browser` (`string`) indicates the name of the browser used to run the experiment (ex. `firefox` or `chrome`)

## Possible conclusions

Expand All @@ -114,7 +116,8 @@ user.
"test_runtime": 0.4044000000059605,
"test_keys": {
"result": "ok",
"load_time_ms": 404.40000000596046
"load_time_ms": 404.40000000596046,
"browser": "chrome"
}
}
```

0 comments on commit 22c74f2

Please sign in to comment.