Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

error while copying with a local xrootd server (due to hash?) #21

Open
kiderrien opened this issue Jul 3, 2020 · 2 comments
Open

error while copying with a local xrootd server (due to hash?) #21

kiderrien opened this issue Jul 3, 2020 · 2 comments

Comments

@kiderrien
Copy link

kiderrien commented Jul 3, 2020

I generated a local server with an adler32 checksum. When copying a file, this type of error is obtained :

client:

[userxroot@resticrclone3 rclone]$ rclone -vv copy /tmp/back2/adler xrootd:back2/p --checksum
2020/07/03 10:13:47 DEBUG : large: Hash:path= /tmp/back2/p/large
panic: mux: cannot find data waiter for id [0 0]

goroutine 187 [running]:
go-hep.org/x/hep/xrootd.(*cliSession).consume(0xc0002a4c30)
        /home/userxroot/go/pkg/mod/go-hep.org/x/[email protected]/xrootd/session.go:258 +0x3f7
created by go-hep.org/x/hep/xrootd.newSession
        /home/userxroot/go/pkg/mod/go-hep.org/x/[email protected]/xrootd/session.go:103 +0x2c6

Server :

00703 10:13:47 21170 XrootdXeq: .21345:25@localhost unbind 0:00:00
200703 10:13:47 21170 XrdPoll: Unable to exclude fd 25 during disc (0) event; link .21345:25@localhost; no such file or directory
200703 10:13:47 21170 XrootdXeq: .21345:31@localhost unbind 0:00:00
200703 10:13:47 21168 XrootdXeq: .21345:34@localhost disc 0:00:00
200703 10:13:47 21087 XrdLink: Unable to receive from .21345:19@localhost; connection reset by peer
200703 10:13:47 21172 XrdLink: Unable to receive from .21345:24@localhost; connection reset by peer
200703 10:13:47 21087 XrootdXeq: .21345:19@localhost disc 0:00:00 (link read error)
200703 10:13:47 21087 XrdPoll: Unable to exclude fd 19 during disc (0) event; link .21345:19@localhost; no such file or directory
200703 10:13:47 21172 XrootdXeq: .21345:24@localhost disc 0:00:00 (link read error)
200703 10:13:47 21172 XrootdXeq: .21345:23@localhost unbind 0:00:00
200703 10:13:47 21172 XrootdXeq: .21345:29@localhost unbind 0:00:00
200703 10:13:47 21172 XrdPoll: Unable to exclude fd 24 during disc (0) event; link .21345:24@localhost; no such file or directory

This error seems to come from the hash function.

When copying for a file only it works but there is a hash problem:

2020/07/03 11:09:12 DEBUG : test3: Using hash function with hash.Type= Adler32Hash
2020/07/03 11:09:12 DEBUG : test3: Hash:path= /tmp/back2/p/test3
2020/07/03 11:09:12 DEBUG : test3: Hash: o.Hash=  && Data=  �XJob scheduled.

Data= �XJob scheduled
Normally Data = adler32 224d3ec3
This is the same problem with a local xrootd server configured with the md5 checksum

However the copy works well with the remote xrootd server using adler32.

@kiderrien
Copy link
Author

kiderrien commented Jul 3, 2020

It does not seem to succeed in finding the file that the path indicates when copying to the local server while the remote does not have this problem during a copy.
The request for the checksum returns "�XJob scheduled" when it does not find the file.

@kiderrien
Copy link
Author

ok. the issue is that currently go-hep/xrootd doesn't handle async responses (ie: kXR_attn server responses) at all.

See here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant