Skip to content

Commit

Permalink
DSP-15832: Use home dir for Spark JobServer data and logs
Browse files Browse the repository at this point in the history
  • Loading branch information
jacek-lewandowski committed Apr 20, 2018
1 parent 0c5b322 commit a8e6851
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 7 deletions.
4 changes: 1 addition & 3 deletions job-server/config/dse.sh
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,6 @@ fi
DEPLOY_HOSTS="localhost"

INSTALL_DIR="$DSE_COMPONENTS_ROOT/spark/spark-jobserver"
LOG_DIR=/var/log/spark/job-server
LOG_DIR="${LOG_DIR:-"$HOME/.spark-jobserver"}"

PIDFILE=spark-jobserver.pid

SPARK_CONF_DIR=${SPARK_CONF_DIR:-"$SPARK_HOME/conf"}
8 changes: 4 additions & 4 deletions job-server/src/main/resources/application.conf
Original file line number Diff line number Diff line change
Expand Up @@ -33,13 +33,13 @@ spark {
cache-on-upload = true

filedao {
rootdir = /tmp/spark-jobserver/filedao/data
rootdir = ${HOME}/.spark-jobserver/filedao/data
}

datadao {
# storage directory for files that are uploaded to the server
# via POST/data commands
rootdir = /tmp/spark-jobserver/upload
rootdir = ${HOME}/.spark-jobserver/upload
}

cassandra {
Expand All @@ -64,12 +64,12 @@ spark {
jdbc-driver = org.h2.Driver

# Directory where default H2 driver stores its data. Only needed for H2.
rootdir = /tmp/spark-jobserver/sqldao/data
rootdir = ${HOME}/.spark-jobserver/sqldao/data

# Full JDBC URL / init string, along with username and password. Sorry, needs to match above.
# Substitutions may be used to launch job-server, but leave it out here in the default or tests won't pass
jdbc {
url = "jdbc:h2:file:/tmp/spark-jobserver/sqldao/data/h2-db"
url = "jdbc:h2:file:"${HOME}"/.spark-jobserver/sqldao/data/h2-db"
user = ""
password = ""
}
Expand Down

0 comments on commit a8e6851

Please sign in to comment.