Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Uploading larger layers fails #52

Open
timlinux opened this issue May 13, 2016 · 9 comments · May be fixed by #294
Open

Uploading larger layers fails #52

timlinux opened this issue May 13, 2016 · 9 comments · May be fixed by #294

Comments

@timlinux
Copy link

timlinux commented May 13, 2016

I tried to upload these files:

-rw-r--r--  1 timlinux  staff    63M Feb 23 11:05 buildings.dbf
-rw-r--r--  1 timlinux  staff   282B Feb 23 11:05 buildings.keywords
-rw-r--r--  1 timlinux  staff   596B Feb 23 11:05 buildings.license
-rw-r--r--  1 timlinux  staff   257B Feb 23 11:05 buildings.prj
-rw-r--r--  1 timlinux  staff    22K Feb 26 16:12 buildings.qml
-rw-r--r--  1 timlinux  staff    12M Feb 23 11:05 buildings.shp
-rw-r--r--  1 timlinux  staff   699K Feb 23 11:05 buildings.shx
-rw-r--r--  1 timlinux  staff    13K Feb 26 16:28 buildings.xml

Uploading failed with:

413 Request Entity Too Large
@timlinux timlinux assigned ismailsunni and lucernae and unassigned ismailsunni May 13, 2016
@timlinux timlinux added the ready label May 13, 2016
lucernae referenced this issue in lucernae/geonode May 16, 2016
related with issue:
#36 #58 #52 #53 #54 #55 #56
@lucernae
Copy link
Collaborator

lucernae commented Jun 6, 2016

I increased the size of

client_max_body_size 500M

in geonode.kartoza.nginx.conf

@timlinux timlinux closed this as completed Jun 6, 2016
@timlinux timlinux removed the ready label Jun 6, 2016
@felix-yew
Copy link

Hi @timlinux and mas @lucernae

I try to upload the training data to the geonode.inasafe.org, but some data failed to upload. Failed because entity too large.
error upload buildings_entity too large
This totally size of building data 71.1 MB

And, then I find failed upload when I try to upload the raster population.
error object upload large data like raster pop
I check to the layer but there is no raster population layer has been uploaded. This totally size of raster population data are 149 MB

increased the size of
client_max_body_size 500M
in geonode.kartoza.nginx.conf

this max size also support to the geonode.inasafe.org or not?

  • If yes, why the data that under 500M size can not upload properly?
  • If no, please make it happy 😄

@Gustry Gustry reopened this Mar 27, 2017
@ismailsunni
Copy link

Hi @felix-yew
The one that @lucernae changed is the one for geonode.kartoza. It's different instance of geonode, and has different setting. I will see if I can set it to 500 MB also for geonode.inasafe.org.

@lucernae
Copy link
Collaborator

It's this one:
https://github.com/kartoza/docker-geosafe/blob/develop/deployment/docker-nginx/nginx.conf#L49
If you have any nginx reverse, modify accordingly.

Also, this issue is not related with this repo, I think.
Can you move this issue somewhere @ismailsunni and close it once it's done.
Perhaps to docker-geosafe, and make PR there.

@cchristelis
Copy link

Let's chunk the files during upload to avoid this problem.

@cchristelis cchristelis assigned euclidian and unassigned lucernae May 19, 2017
@gubuntu gubuntu changed the title Uploading larger layers fail Uploading larger layers fails May 23, 2017
@gubuntu
Copy link

gubuntu commented Jun 21, 2017

@cchristelis @euclidian how is progress with chunking (using AT approach?)

Will this be applied to raster and vector uploads?

@cchristelis
Copy link

@gubuntu, yeah, the same approach. @euclidian seems to be having some difficulty finding his feet with the JS.

@euclidian euclidian linked a pull request Jul 11, 2017 that will close this issue
@gubuntu
Copy link

gubuntu commented Sep 21, 2017

@NyakudyaA didn't you test demo.geonode.org and it doesn't fail with large file uploads? Did you come to any conclusions?

@NyakudyaA
Copy link
Collaborator

@gubuntu I tested the demo site and they have issues with uploading big datasets as well. I saw on the geonode list the geonode guys have it on their to-do list as well.

@gubuntu gubuntu added this to the Mozambique milestone May 8, 2018
@gubuntu gubuntu removed this from the Mozambique milestone Oct 10, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

9 participants