PySpark fails to start Binder instance #3074
Comments
HyukjinKwon
added a commit
to apache/spark
that referenced
this issue
Aug 27, 2024
### What changes were proposed in this pull request? This PR proposes to fix Binder integration by using `Dockerfile` directly. ### Why are the changes needed? Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. ### Does this PR introduce _any_ user-facing change? Yes. This should recover the Binder integration. ### How was this patch tested? Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb ### Was this patch authored or co-authored using generative AI tooling? No. Closes #47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
HyukjinKwon
added a commit
to apache/spark
that referenced
this issue
Aug 27, 2024
This PR proposes to fix Binder integration by using `Dockerfile` directly. Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. Yes. This should recover the Binder integration. Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb No. Closes #47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 9fc1e05) Signed-off-by: Hyukjin Kwon <[email protected]>
HyukjinKwon
added a commit
to apache/spark
that referenced
this issue
Aug 27, 2024
This PR proposes to fix Binder integration by using `Dockerfile` directly. Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. Yes. This should recover the Binder integration. Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb No. Closes #47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 9fc1e05) Signed-off-by: Hyukjin Kwon <[email protected]>
HyukjinKwon
added a commit
to apache/spark
that referenced
this issue
Aug 27, 2024
This PR proposes to fix Binder integration by using `Dockerfile` directly. Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. Yes. This should recover the Binder integration. Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb No. Closes #47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 9fc1e05) Signed-off-by: Hyukjin Kwon <[email protected]>
HyukjinKwon
added a commit
to apache/spark
that referenced
this issue
Aug 27, 2024
This PR proposes to fix Binder integration by using `Dockerfile` directly. Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. Yes. This should recover the Binder integration. Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb No. Closes #47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 9fc1e05) Signed-off-by: Hyukjin Kwon <[email protected]>
HyukjinKwon
added a commit
to apache/spark
that referenced
this issue
Aug 27, 2024
This PR proposes to fix Binder integration by using `Dockerfile` directly. Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. Yes. This should recover the Binder integration. Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb No. Closes #47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 9fc1e05) Signed-off-by: Hyukjin Kwon <[email protected]>
|
This has been closed in apache/spark@9fc1e05. |
HyukjinKwon
added a commit
to apache/spark
that referenced
this issue
Aug 28, 2024
This PR proposes to fix Binder integration by using `Dockerfile` directly. Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. Yes. This should recover the Binder integration. Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb No. Closes #47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 9fc1e05) Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 69acd26) Signed-off-by: Hyukjin Kwon <[email protected]>
IvanK-db
pushed a commit
to IvanK-db/spark
that referenced
this issue
Sep 20, 2024
### What changes were proposed in this pull request? This PR proposes to fix Binder integration by using `Dockerfile` directly. ### Why are the changes needed? Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. ### Does this PR introduce _any_ user-facing change? Yes. This should recover the Binder integration. ### How was this patch tested? Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
szehon-ho
pushed a commit
to szehon-ho/spark
that referenced
this issue
Sep 24, 2024
This PR proposes to fix Binder integration by using `Dockerfile` directly. Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. Yes. This should recover the Binder integration. Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb No. Closes apache#47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit 9fc1e05) Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit d53e035)
attilapiros
pushed a commit
to attilapiros/spark
that referenced
this issue
Oct 4, 2024
### What changes were proposed in this pull request? This PR proposes to fix Binder integration by using `Dockerfile` directly. ### Why are the changes needed? Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. ### Does this PR introduce _any_ user-facing change? Yes. This should recover the Binder integration. ### How was this patch tested? Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
himadripal
pushed a commit
to himadripal/spark
that referenced
this issue
Oct 19, 2024
### What changes were proposed in this pull request? This PR proposes to fix Binder integration by using `Dockerfile` directly. ### Why are the changes needed? Binder integration is broken now (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb):  This seems to be related to the size of the repository (jupyterhub/mybinder.org-deploy#3074). I tried all the ways out but could not find the way except using `Dockerfile`. ### Does this PR introduce _any_ user-facing change? Yes. This should recover the Binder integration. ### How was this patch tested? Manually tested within my fork: https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test1?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#47883 from HyukjinKwon/binder-test1. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Launching Binder for PySpark (https://github.com/apache/spark) is stuck (https://mybinder.org/v2/gh/apache/spark/bb7846dd487?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb) with "Using PythonBuildPack builder".
I tried to remove unrelated files in the project, and started the Binder again (https://mybinder.org/v2/gh/HyukjinKwon/spark/binder-test?filepath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb), and it seems working:
Seems like the size of the project matters, and it fails to launch the Binder instance.
Were there related changes before? I would appreciate any help on this.
The text was updated successfully, but these errors were encountered: