Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/benchmarking #802

Merged
merged 85 commits into from
Nov 28, 2024
+2,951 −76
Merged

Feature/benchmarking #802

Changes from 1 commit
Commits
Show all changes
85 commits
Select commit Hold shift + click to select a range
1dffbc6
Initial commit for benchmarking
qh681248 Oct 9, 2024
54f0daa
Replaced `small_dataset` with `train_data_jax`
qh681248 Oct 10, 2024
055206b
Added copyright and documentation
qh681248 Oct 10, 2024
78cd2e0
added docstring to `__init__.py`
qh681248 Oct 10, 2024
9f799bf
Added documentation on benchmark/__init__.py
qh681248 Oct 10, 2024
5269d1c
Added `main` function on mnist_benchmark.py
qh681248 Oct 10, 2024
b84ff03
Added main() function on mnist_benchmark.py
qh681248 Oct 11, 2024
650fcdc
Added linestyle to custom_misc.txt
qh681248 Oct 14, 2024
41f4f09
Wrapped mnist_benchmark_visualiser.py on the main function
qh681248 Oct 14, 2024
5d0a8e2
feat(benchmark): add main function to all new benchmark scripts
qh681248 Oct 17, 2024
4180f52
feat(benchmark): add main function to all new benchmark scripts
qh681248 Oct 17, 2024
9e7891a
Merge remote-tracking branch 'remotes/origin/main' into feature/bench…
qh681248 Oct 17, 2024
e6baad2
feat: add blobs_benchmark_visualiser.py for benchmark result visualis…
qh681248 Oct 17, 2024
52e7869
feat: Add benchmark/blobs_benchmark_visualiser.py
qh681248 Oct 17, 2024
db3d3ee
feat: renamed json files
qh681248 Oct 17, 2024
b912461
feat: Add docstrings on blobs_benchmark.py and mnist_benchmark.py exp…
qh681248 Oct 17, 2024
e94aed0
Merge remote-tracking branch 'remotes/origin/main' into feature/bench…
qh681248 Oct 18, 2024
1df2237
:build: add pytorch, torchvision to dependencies
qh681248 Oct 23, 2024
09b6077
:docs: fixed docstrings
qh681248 Oct 24, 2024
4cef166
chore: Updated uv.lock after adding additional dependencies.
qh681248 Oct 24, 2024
a86b09f
feat: Added unit/test_benchmark.py
qh681248 Oct 25, 2024
4860981
fix: Fix merge conflict due to uv.lock
qh681248 Oct 25, 2024
4196727
fix: Fix merge conflict due to uv.lock
qh681248 Oct 25, 2024
4b36684
Merge remote-tracking branch 'remotes/origin/main' into feature/bench…
qh681248 Oct 25, 2024
f679a57
ci: remove macos-13 test from continuous integration test
qh681248 Oct 25, 2024
00f069e
refactor: use base directory for json path
qh681248 Oct 25, 2024
6102918
refactor: use base directory for json path
qh681248 Oct 25, 2024
606c2b9
refactor: use base directory for json path
qh681248 Oct 25, 2024
a2f45d3
refactor: use base directory for json path
qh681248 Oct 25, 2024
28fe378
chore: Added `torch` to `library_terms.txt`
qh681248 Oct 30, 2024
880711e
Merge remote-tracking branch 'remotes/origin/main' into feature/bench…
qh681248 Oct 30, 2024
0da26bd
chore: merge main to branch to resolve merge conflict
qh681248 Oct 30, 2024
058e816
feat: increase block size to 128 to run on more powerful machine
qh681248 Oct 30, 2024
65d5ddf
Merge branch 'main' into feature/benchmarking
qh681248 Nov 5, 2024
109a36a
chore: update packages
qh681248 Nov 5, 2024
27a283b
feat: Removed block sizes to run on large gpu instance
qh681248 Nov 6, 2024
7921f7d
chore: obtain mnist benchmark results on large gpu
qh681248 Nov 6, 2024
53bdddb
chore: Added ylabel to custom_misc.txt
qh681248 Nov 8, 2024
6b95f28
docs: Added typehints and changed variable names
qh681248 Nov 8, 2024
dbbc0e2
chore: add delaxes, hspace and wspace to custom_misc.txt
qh681248 Nov 8, 2024
f4eb6f5
chore: Add British spellings
qh681248 Nov 8, 2024
9380d24
feat: Added both time and accuracy plot
qh681248 Nov 8, 2024
e5b482f
Merge remote-tracking branch 'origin/main' into feature/benchmarking
qh681248 Nov 11, 2024
76ae31a
feat: Use log scale for visualisation
qh681248 Nov 11, 2024
4211435
chore: Resolve uv lock error.
qh681248 Nov 11, 2024
6c41219
Merge branch 'main' into feature/benchmarking
qh681248 Nov 11, 2024
fe599e3
chore: fixed pre-commit
qh681248 Nov 11, 2024
91d9a53
chore: fixed (hopefully) uv lock issue
qh681248 Nov 11, 2024
b885c4e
chore: Address comments on mnist_benchmark.py
qh681248 Nov 15, 2024
1419a29
chore: fix documentation
qh681248 Nov 15, 2024
220be8e
chore: fix typehints
qh681248 Nov 15, 2024
b0cbed6
merge main into current branch
qh681248 Nov 15, 2024
9950c7b
chore: fix typehints
qh681248 Nov 15, 2024
be6f710
Merge remote-tracking branch 'refs/remotes/origin/main' into feature/…
qh681248 Nov 15, 2024
06a06cf
Merge branch 'feature/benchmarking' of github.com:gchq/coreax into fe…
qh681248 Nov 15, 2024
c205a8f
merge main into current branch
qh681248 Nov 18, 2024
0f9c410
merge main into current branch
qh681248 Nov 18, 2024
89d92e4
merge main into current branch
qh681248 Nov 18, 2024
592ccfe
merge main into current branch
qh681248 Nov 18, 2024
a919d69
merge main into current branch
qh681248 Nov 18, 2024
51c10b9
chore: Combine two assert statements into one
qh681248 Nov 18, 2024
3b68414
chore: sync requirements-doc.txt with uv lock and pyproject.toml
qh681248 Nov 18, 2024
48bf42b
feat: Add benchmarking to Changelog
qh681248 Nov 20, 2024
9062820
chore: remove log scale from plots
qh681248 Nov 20, 2024
e04f4c8
chore: add script to generate time taken for coreset generation on gp…
qh681248 Nov 20, 2024
562f9cd
chore: add new words to custom_misc.txt
qh681248 Nov 20, 2024
2b68782
chore: add a new line at the end of the file mnist_time_results.json
qh681248 Nov 20, 2024
fd666ca
Upload mnist_time_results from gpu
qh681248 Nov 20, 2024
22c678e
chore: renamed delete_me.py to mnist_benchmark_coresets_only.py
qh681248 Nov 20, 2024
4ca7640
chore: renamed delete_me.py to mnist_benchmark_coresets_only.py
qh681248 Nov 20, 2024
d807e4e
chore: add new line on mnist_time_results.json
qh681248 Nov 20, 2024
de14425
chore: Add the type of device the benchmark is run on
qh681248 Nov 20, 2024
28ec977
chore: Update docstrings for mnist_benchmark_coresets_only.py
qh681248 Nov 20, 2024
177bc4b
fix: Change numbers of samples for score matching to 300 from 1000
qh681248 Nov 20, 2024
37fae4f
chore: add a new line at the end of the file mnist_time_results.json
qh681248 Nov 25, 2024
4f31ea0
run tests on gpu
qh681248 Nov 25, 2024
66ce9bd
doc: change reference to PCA to reference to UMAP
qh681248 Nov 27, 2024
5d067df
chore: run the coreset generation time script on gpu
qh681248 Nov 27, 2024
33031e2
chore(deps): autoupdate pre-commit hooks
gchq-write-contents-and-pr[bot] Nov 17, 2024
a3f5d2c
chore(deps): autoupdate uv.lock
gchq-write-contents-and-pr[bot] Nov 24, 2024
9220a2c
chore(deps): autoupdate pre-commit hooks
gchq-write-contents-and-pr[bot] Nov 24, 2024
eaf1dd4
chore: add a new line at the end of the file mnist_time_results.json
qh681248 Nov 27, 2024
3b2205c
chore: merge main into current branch
qh681248 Nov 27, 2024
be7cf4f
Merge branch 'main' into feature/benchmarking
qh681248 Nov 27, 2024
d92880d
chore: sync requirements-doc.txt with uv.lock
qh681248 Nov 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Added linestyle to custom_misc.txt
@qh681248
qh681248 committed Oct 14, 2024

Verified

This commit was signed with the committer’s verified signature.
qh681248
SSH Key Fingerprint: Jh8MQ6PSeidvnOdj2K8FLC5G7Vss2QAUifgc4MOevHE
Verified
Learn about vigilant mode
commit 650fcdc25f7922ce3ac489f8169d6c877ff186ee
1 change: 1 addition & 0 deletions .cspell/custom_misc.txt
View file
Original file line number Diff line number Diff line change
@@ -25,6 +25,7 @@ kdtree
kernelised
kernelized
KSD
linestyle
linewidth
mapsto
Matern