Skip to content

Project-Sustain/sustain-kNN-dataIngestor

Repository files navigation

sustain-kNN-dataInjestor

Primary purpose of this project is to read required query conditions from a property file named config.properties and connect to sustain-dht. Next, extract relevant sketches, format them in required format and save to the MongoDB.

Currently, config.properties file can hold below properties:

  • host=lattice-80.cs.colostate.edu

  • port=9091

  • dataset=noaa_2015_jan

  • geohashes=9x, 9y8b9

  • fromTimestamp=2015-01-01 00:00

  • toTimestamp=2015-01-08 23:59

  • intermediate.output.file=./data/

  • mongodb.host=pierre.cs.colostate.edu

  • mongodb.port=27023

  • mongodb.db=noaadb

  • mongodb.collection=noaa_test1

  • mongodb.shardkey=GeoHash

Adding any new properties will require code changes in sustain.kNN.utility.PropertyLoader class. Further, the values of these properties will be used to populate the query to extract sketches from the storage.

On the other hand, features of extracted sketches should be loaded from a metadata server and use the feature names appropriately in Documents to be stored in MongoDB .

To run this, execute; (make sure config.properties file is in the same directory as the jar) java -jar sustain-kNN-1.0-SNAPSHOT.jar config.properties

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages