Access Spark Web GUI

[arjun289]

First of all thanks for creating such an amazing workspace. Kudos 🚀

When we install spark by default it exposes a GUI at http://:4040 Is it possible to add it to this project?
If you people guide me a bit I will be happy to create a PR for the same. I think it could be value addition for people trying to learn spark and visualise the DAGs that are being generated as well as how resources are being consumed.

[michaelchanwahyan]

hi @arjun289

sorry for missing out your proposal.
I have been on a very tight schedule recently and shall be busy for another 2 months.

probably I would do as as follow:
make the installation of spark ui monitor to be altogether with the spark installation section in the Dockerfile.

I shall view this proposal when I hv time.

PR is also possible, although I hv few exp with it.

thx , shall get back asap