-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
反向代理镜像站下载大文件总是失败 #198
Comments
感谢反馈。
nginx不太适合反向代理大文件。 比如有用户访问A文件(大小1GB),那么在整个请求过程中nginx就会占用服务器1GB的存储空间。 如果用户下载时间很长,或者有大量这类并发请求,就会快速耗尽服务器的缓冲空间。 这还会带来另一个问题——网络波动。 由于反向代理服务器到上游的速度比较快(约20MB/s),会占满出国隧道的带宽,导致其他服务(如light)的网速出现较大幅度的波动。 个人建议: 对于大文件,从上游下载时每次只下载一小块,等用户取回后再下载下一块。以提升缓冲空间的利用效率。 |
或者参考下nginx官方文档 https://www.nginx.com/blog/nginx-caching-guide/ 我按照这个文档的优化建议,启用 |
测试命令:
curl -O https://cloudera.proxy.ustclug.org/cm5/ubuntu/xenial/amd64/cm/pool/contrib/e/enterprise/cloudera-manager-daemons_5.13.1-1.cm5131.p0.2~xenial-cm5_all.deb % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 701M 0 1567k 0 0 216k 0 0:55:16 0:00:07 0:55:09 241k curl: (18) transfer closed with 734423739 bytes remaining to read
当下载文件容量比较大的时候,就时不时随机出现这种错误。
The text was updated successfully, but these errors were encountered: