An Apache OODT-powered Science Data System (SDS) for COAL.
coal-sds is an end-to-end SDS capable of managing the data lifecycle (aquisition, cataloging, archival, retrieval, processing, etc.) required for COAL. The Apache OODT-poweredSDS itself consists of several components which when run as services, allow users to really explore COAL in its entirety.
- Java Development Kit (JDK) 1.8+
- JAVA_HOME set
- MAVEN and Prerequisite POM File
Place the complete coal-sds file inside of your EC2 instance.
$ mvn clean package -Pfm-solr-catalog -DskipTests
Typically efficient and effective cataloguing is achieved by passing the -Pfm-solr-catalog option
as this allows all data flowing into the SDS to be persisted into Apache Solr.
$ mkdir /usr/local/coal-sds-deploy
$ tar -zxvf distribution/target/coal-sds-distribution-*-bin.tar.gz -C /usr/local/coal-sds-deploy/
If you experience issues with permissions, you may need to include sudo in front of those commands.
NOTE: For other build configurations, add the following arguments: (default) : bin, crawler, data, extensions, filemgr (Lucene), logs, pcs, resmgr, tomcat, workflow, pge
-Pfm-solr-catalog : default components, filemgr (Solr), solr, tomcat/webapps/solr
See Basic File Management COAL SDS
coal-sds is licensed permissively under the Apache License v2.0 a copy of which ships with this code.