Error when downloading all refseq bacteria genome and protein sequence

[Xinpeng021001]

To whom it may concern,

Thank you for developing this excellent tool! It is really helpful to download data from NCBI. Recently I've been using it to download all RefSeq bacteria genomes and protein sequences with the command:

datasets download genome taxon 2 --include genome,protein --assembly-source RefSeq --dehydrated --filename Refseq.zip

However, it shows me errors during the downloading part:

Collecting 399,396 genome records [================================================] 100% 399396/399396
Downloading: Refseq.zip 10.7MB 9.33kB/s
Error: Download error: http2: server sent GOAWAY and closed the connection; LastStreamID=2147483647, ErrCode=NO_ERROR, debug=""

I guess it is caused by the large dataset. I also applied my API but it does not work as well. Could you please give me some suggestions for downloading those datasets? Besides, could you please consider adding a function to show the progress of downloading when using "--dehydrated"

Thank you for your help!

Best Regards,
Xinpeng

[olearyna]

Hi Xinpeng021001,

Thank you for reporting this bug. We're looking into and will let you know when we have a fix.

Regards,
Nuala

[Xinpeng021001]

Hi Xinpeng021001,

Thank you for reporting this bug. We're looking into and will let you know when we have a fix.

Regards, Nuala

Dear Nuala,

Sorry for the late reply. Is there any update on this issue? Thank you for your help!

Best Regards,
Xinpeng

[olearyna]

Hi Xinpeng021001,

We're continuing to work on a fix and hope to have something in the next two weeks.

Thank you,
Nuala O'Leary