Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
DOC: enhanced description and comment here includes result of testremote
testremote took almost 2h to complete!!! So this thing is quite ineffecient,
but interestingly eyeballing top from time to time showed that nothing really
is busy -- neither git or git-annex. And to that attests zsh reported (at the
bottom) times:
git annex testremote go 51.37s user 13.49s system 1% cpu 1:45:27.44 total
so there was only a minute of user + system time consumed, while total run was
1h 45 min. So, it seems that git-annex, git and interaction between the two
might be the explanation for datalad often not being that busy -- something else
(absent flushes?) hinders efficient interaction with (or within) git or git-annex.
Here is a full dump of testremote, which is all green:
(git-annex)lena:~/.tmp/dl-KbGRwgI/b[master]git-annex
$> git annex testremote go
testremote go (generating test keys...) Remote Tests
unavailable remote
removeKey: git-annex: Cannot run git-annex-remote-!dne! -- It is not installed in PATH (/usr/lib/git-annex.linux/bin:/usr/lib/git-core:/home/yoh/proj/datalad/datalad-master/sandbox:/home/yoh/proj/datalad/datalad-master/venvs/dev3/bin:/home/yoh/gocode/bin:/home/yoh/gocode/bin:/home/yoh/bin:/home/yoh/.local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/sbin:/usr/sbin:/usr/local/sbin:/usr/lib/git-annex.linux/extra)
OK
storeKey: Cannot run git-annex-remote-!dne! -- It is not installed in PATH (/usr/lib/git-annex.linux/bin:/usr/lib/git-core:/home/yoh/proj/datalad/datalad-master/sandbox:/home/yoh/proj/datalad/datalad-master/venvs/dev3/bin:/home/yoh/gocode/bin:/home/yoh/gocode/bin:/home/yoh/bin:/home/yoh/.local/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/sbin:/usr/sbin:/usr/local/sbin:/usr/lib/git-annex.linux/extra)
OK
checkPresent: OK
retrieveKeyFile: OK
retrieveKeyFileCheap: OK
key size Just 1048576; NoChunks; encryption none
removeKey when not present: OK (0.05s)
present False: OK
storeKey: OK (0.27s)
present True: OK (0.02s)
storeKey when already present: OK (0.10s)
present True: OK
retrieveKeyFile: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.13s)
fsck downloaded object: OK
removeKey when present: OK (0.08s)
present False: OK (0.01s)
key size Just 1048576; NoChunks; encryption shared
removeKey when not present: OK (0.08s)
present False: OK (0.01s)
storeKey: OK (0.23s)
present True: OK (0.01s)
storeKey when already present: OK (0.09s)
present True: OK
retrieveKeyFile: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.12s)
fsck downloaded object: OK
removeKey when present: OK (0.06s)
present False: OK
key size Just 1048576; UnpaddedChunks 10485; encryption none
removeKey when not present: OK (0.05s)
present False: OK
storeKey: OK (15.19s)
present True: OK (1.27s)
storeKey when already present: OK (1.11s)
present True: OK (0.98s)
retrieveKeyFile: OK (3.78s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (2.85s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (4.25s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.06s)
fsck downloaded object: OK
removeKey when present: OK (12.85s)
present False: OK
key size Just 1048576; UnpaddedChunks 10485; encryption shared
removeKey when not present: OK (0.04s)
present False: OK
storeKey: OK (15.56s)
present True: OK (1.00s)
storeKey when already present: OK (1.10s)
present True: OK (0.94s)
retrieveKeyFile: OK (4.44s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (2.95s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (4.03s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.17s)
fsck downloaded object: OK
removeKey when present: OK (12.24s)
present False: OK (0.03s)
key size Just 1048576; UnpaddedChunks 1048; encryption none
removeKey when not present: OK (0.09s)
present False: OK
storeKey: OK (174.10s)
present True: OK (21.51s)
storeKey when already present: OK (22.83s)
present True: OK (21.18s)
retrieveKeyFile: OK (63.28s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (43.86s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (62.58s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.13s)
fsck downloaded object: OK
removeKey when present: OK (132.33s)
present False: OK (0.03s)
key size Just 1048576; UnpaddedChunks 1048; encryption shared
removeKey when not present: OK (0.08s)
present False: OK
storeKey: OK (170.94s)
present True: OK (19.43s)
storeKey when already present: OK (19.41s)
present True: OK (19.52s)
retrieveKeyFile: OK (63.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (41.13s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (62.31s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.11s)
fsck downloaded object: OK
removeKey when present: OK (133.82s)
present False: OK (0.03s)
key size Just 1048576; UnpaddedChunks 1048576; encryption none
removeKey when not present: OK (0.08s)
present False: OK
storeKey: OK (0.17s)
present True: OK
storeKey when already present: OK (0.07s)
present True: OK
retrieveKeyFile: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.13s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.02s)
fsck downloaded object: OK
removeKey when present: OK (0.15s)
present False: OK (0.03s)
key size Just 1048576; UnpaddedChunks 1048576; encryption shared
removeKey when not present: OK (0.08s)
present False: OK
storeKey: OK (0.28s)
present True: OK (0.02s)
storeKey when already present: OK (0.10s)
present True: OK
retrieveKeyFile: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.04s)
fsck downloaded object: OK
removeKey when present: OK (0.15s)
present False: OK (0.03s)
key size Just 1048577; NoChunks; encryption none
removeKey when not present: OK (0.05s)
present False: OK (0.04s)
storeKey: OK (0.29s)
present True: OK (0.03s)
storeKey when already present: OK (0.09s)
present True: OK
retrieveKeyFile: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.13s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.13s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.12s)
fsck downloaded object: OK
removeKey when present: OK (0.08s)
present False: OK (0.04s)
key size Just 1048577; NoChunks; encryption shared
removeKey when not present: OK (0.06s)
present False: OK (0.04s)
storeKey: OK (0.29s)
present True: OK (0.03s)
storeKey when already present: OK (0.08s)
present True: OK
retrieveKeyFile: OK (0.13s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.14s)
fsck downloaded object: OK
removeKey when present: OK (0.13s)
present False: OK (0.04s)
key size Just 1048577; UnpaddedChunks 10485; encryption none
removeKey when not present: OK (0.02s)
present False: OK (0.02s)
storeKey: OK (16.50s)
present True: OK (1.19s)
storeKey when already present: OK (1.07s)
present True: OK (1.06s)
retrieveKeyFile: OK (4.54s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (2.71s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (4.09s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.17s)
fsck downloaded object: OK
removeKey when present: OK (13.58s)
present False: OK
key size Just 1048577; UnpaddedChunks 10485; encryption shared
removeKey when not present: OK (0.02s)
present False: OK (0.02s)
storeKey: OK (15.19s)
present True: OK (0.99s)
storeKey when already present: OK (0.96s)
present True: OK (0.98s)
retrieveKeyFile: OK (3.48s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (2.93s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (4.18s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.08s)
fsck downloaded object: OK
removeKey when present: OK (13.67s)
present False: OK (0.01s)
key size Just 1048577; UnpaddedChunks 1048; encryption none
removeKey when not present: OK (0.03s)
present False: OK (0.02s)
storeKey: OK (169.48s)
present True: OK (20.06s)
storeKey when already present: OK (20.17s)
present True: OK (20.56s)
retrieveKeyFile: OK (60.89s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (40.28s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (60.72s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.13s)
fsck downloaded object: OK
removeKey when present: OK (126.60s)
present False: OK (0.03s)
key size Just 1048577; UnpaddedChunks 1048; encryption shared
removeKey when not present: OK (0.03s)
present False: OK (0.01s)
storeKey: OK (177.55s)
present True: OK (22.13s)
storeKey when already present: OK (20.77s)
present True: OK (23.11s)
retrieveKeyFile: OK (64.77s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (50.85s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (78.25s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.18s)
fsck downloaded object: OK
removeKey when present: OK (138.85s)
present False: OK
key size Just 1048577; UnpaddedChunks 1048576; encryption none
removeKey when not present: OK (0.02s)
present False: OK (0.01s)
storeKey: OK (0.34s)
present True: OK (0.02s)
storeKey when already present: OK (0.05s)
present True: OK (0.06s)
retrieveKeyFile: OK (0.24s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.15s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.14s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.14s)
fsck downloaded object: OK
removeKey when present: OK (0.19s)
present False: OK
key size Just 1048577; UnpaddedChunks 1048576; encryption shared
removeKey when not present: OK (0.02s)
present False: OK (0.02s)
storeKey: OK (0.43s)
present True: OK (0.04s)
storeKey when already present: OK (0.06s)
present True: OK (0.03s)
retrieveKeyFile: OK (0.14s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.16s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.13s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.12s)
fsck downloaded object: OK
removeKey when present: OK (0.42s)
present False: OK (0.03s)
key size Just 1048575; NoChunks; encryption none
removeKey when not present: OK (0.05s)
present False: OK (0.04s)
storeKey: OK (0.31s)
present True: OK (0.02s)
storeKey when already present: OK (0.10s)
present True: OK
retrieveKeyFile: OK (0.13s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.12s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.15s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.13s)
fsck downloaded object: OK
removeKey when present: OK (0.13s)
present False: OK (0.03s)
key size Just 1048575; NoChunks; encryption shared
removeKey when not present: OK (0.05s)
present False: OK (0.03s)
storeKey: OK (0.24s)
present True: OK
storeKey when already present: OK (0.10s)
present True: OK (0.02s)
retrieveKeyFile: OK (0.14s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.17s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.20s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.15s)
fsck downloaded object: OK
removeKey when present: OK (0.13s)
present False: OK (0.04s)
key size Just 1048575; UnpaddedChunks 10485; encryption none
removeKey when not present: OK (0.04s)
present False: OK (0.02s)
storeKey: OK (17.91s)
present True: OK (1.17s)
storeKey when already present: OK (1.19s)
present True: OK (1.11s)
retrieveKeyFile: OK (4.39s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (3.08s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (4.10s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.06s)
fsck downloaded object: OK
removeKey when present: OK (12.92s)
present False: OK (0.02s)
key size Just 1048575; UnpaddedChunks 10485; encryption shared
removeKey when not present: OK (0.03s)
present False: OK (0.02s)
storeKey: OK (17.08s)
present True: OK (1.18s)
storeKey when already present: OK (1.21s)
present True: OK (1.20s)
retrieveKeyFile: OK (8.39s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (4.82s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (6.68s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.06s)
fsck downloaded object: OK
removeKey when present: OK (13.41s)
present False: OK (0.01s)
key size Just 1048575; UnpaddedChunks 1048; encryption none
removeKey when not present: OK (0.02s)
present False: OK (0.02s)
storeKey: OK (175.84s)
present True: OK (23.90s)
storeKey when already present: OK (22.34s)
present True: OK (30.02s)
retrieveKeyFile: OK (71.93s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (51.49s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (69.60s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.20s)
fsck downloaded object: OK
removeKey when present: OK (124.76s)
present False: OK (0.03s)
key size Just 1048575; UnpaddedChunks 1048; encryption shared
removeKey when not present: OK (0.03s)
present False: OK (0.01s)
storeKey: OK (172.63s)
present True: OK (23.85s)
storeKey when already present: OK (21.36s)
present True: OK (22.80s)
retrieveKeyFile: OK (67.66s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (52.88s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (74.71s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.12s)
fsck downloaded object: OK
removeKey when present: OK (94.81s)
present False: OK
key size Just 1048575; UnpaddedChunks 1048576; encryption none
removeKey when not present: OK (0.02s)
present False: OK
storeKey: OK (0.16s)
present True: OK
storeKey when already present: OK (0.06s)
present True: OK
retrieveKeyFile: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.12s)
fsck downloaded object: OK
removeKey when present: OK (0.07s)
present False: OK
key size Just 1048575; UnpaddedChunks 1048576; encryption shared
removeKey when not present: OK (0.01s)
present False: OK
storeKey: OK (0.20s)
present True: OK
storeKey when already present: OK (0.07s)
present True: OK
retrieveKeyFile: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.11s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.12s)
fsck downloaded object: OK
removeKey when present: OK (0.07s)
present False: OK
key size Just 2097152; NoChunks; encryption none
removeKey when not present: OK (0.01s)
present False: OK
storeKey: OK (0.32s)
present True: OK
storeKey when already present: OK (0.12s)
present True: OK
retrieveKeyFile: OK (0.19s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.19s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.19s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.22s)
fsck downloaded object: OK
removeKey when present: OK (0.07s)
present False: OK
key size Just 2097152; NoChunks; encryption shared
removeKey when not present: OK (0.01s)
present False: OK (0.01s)
storeKey: OK (0.25s)
present True: OK
storeKey when already present: OK (0.10s)
present True: OK
retrieveKeyFile: OK (0.19s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.21s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.22s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.20s)
fsck downloaded object: OK
removeKey when present: OK (0.06s)
present False: OK
key size Just 2097152; UnpaddedChunks 10485; encryption none
removeKey when not present: OK
present False: OK
storeKey: OK (25.56s)
present True: OK (2.69s)
storeKey when already present: OK (2.51s)
present True: OK (2.49s)
retrieveKeyFile: OK (8.90s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (5.45s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (8.68s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.10s)
fsck downloaded object: OK
removeKey when present: OK (14.72s)
present False: OK
key size Just 2097152; UnpaddedChunks 10485; encryption shared
removeKey when not present: OK (0.02s)
present False: OK (0.01s)
storeKey: OK (30.21s)
present True: OK (2.62s)
storeKey when already present: OK (2.53s)
present True: OK (2.57s)
retrieveKeyFile: OK (8.67s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (6.02s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (9.39s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.06s)
fsck downloaded object: OK
removeKey when present: OK (27.43s)
present False: OK (0.03s)
key size Just 2097152; UnpaddedChunks 1048; encryption none
removeKey when not present: OK (0.03s)
present False: OK (0.01s)
storeKey: OK (448.65s)
present True: OK (81.19s)
storeKey when already present: OK (75.92s)
present True: OK (65.11s)
retrieveKeyFile: OK (153.52s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (101.38s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (149.97s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.10s)
fsck downloaded object: OK
removeKey when present: OK (266.04s)
present False: OK (0.01s)
key size Just 2097152; UnpaddedChunks 1048; encryption shared
removeKey when not present: OK (0.03s)
present False: OK (0.02s)
storeKey: OK (383.40s)
present True: OK (71.05s)
storeKey when already present: OK (82.93s)
present True: OK (62.78s)
retrieveKeyFile: OK (147.62s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (101.16s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (153.19s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.11s)
fsck downloaded object: OK
removeKey when present: OK (260.77s)
present False: OK (0.03s)
key size Just 2097152; UnpaddedChunks 1048576; encryption none
removeKey when not present: OK (0.05s)
present False: OK (0.02s)
storeKey: OK (0.65s)
present True: OK (0.04s)
storeKey when already present: OK (0.04s)
present True: OK (0.03s)
retrieveKeyFile: OK (0.24s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.23s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.23s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.03s)
fsck downloaded object: OK
removeKey when present: OK (0.34s)
present False: OK (0.04s)
key size Just 2097152; UnpaddedChunks 1048576; encryption shared
removeKey when not present: OK (0.04s)
present False: OK (0.02s)
storeKey: OK (0.61s)
present True: OK (0.05s)
storeKey when already present: OK (0.04s)
present True: OK (0.03s)
retrieveKeyFile: OK (0.25s)
fsck downloaded object: OK
retrieveKeyFile resume from 33%: OK (0.22s)
fsck downloaded object: OK
retrieveKeyFile resume from 0: OK (0.23s)
fsck downloaded object: OK
retrieveKeyFile resume from end: OK (0.05s)
fsck downloaded object: OK
removeKey when present: OK (0.26s)
present False: OK (0.04s)
All 517 tests passed (6326.50s)
ok
(recording state in git...)
git annex testremote go 51.37s user 13.49s system 1% cpu 1:45:27.44 total- Loading branch information
1 parent
e15c657
commit 11a265c