Skip to content

Commit

Permalink
Add sharddivide export properties to sample property file
Browse files Browse the repository at this point in the history
  • Loading branch information
tokee committed Jan 4, 2024
1 parent dc961f0 commit 0b8d218
Showing 1 changed file with 26 additions and 0 deletions.
26 changes: 26 additions & 0 deletions src/test/resources/properties/solrwayback_unittest.properties
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,32 @@ url.normaliser=normal
# Optional list of Solr-params. Format is key1=value1;key2=value2,...
#solr.search.params=f.url_norm.qf=url

#------- sharddivide export ------------------
# Pre-SolrWayback 5.0, export always used standard Solr cursorMark for export.
# Solr cursorMark issues some redundant requests that scales with the number of shards in a Solr setup.
# sharddivide avoids redundant requests at the cost of SolrWayback memory overhead, speeding up export
# for multi-shard setups.

# Whether or not to use sharddivide. See subsequent properties when using 'auto'
# Possible values: always, never, auto (default)
solr.export.sharddivide.default=auto

# When solr.export.sharddivide.default == auto, the backing Solr must have at least this number of shards
# for sharddivide to be activated.
# Default: 2
solr.export.sharddivide.autolimit.shards.default=2

# When solr.export.sharddivide.default == auto, the export query must have at least this number of hits
# for sharddivide to be activated.
# Default: 5000
solr.export.sharddivide.autolimit.hits.default=5000

# If sharddivide is used, SolrWayback will issue at most this number of concurrent requests to shards.
# Default: 20
solr.export.sharddivide.concurrent.max=20

#-------------------------------------------------------

#------- Generate preview screenshots ------------------
#Used for preview screenshots shown on the page resources overview. Is not required.
#Chrome must be installed on the OS and headless chrome is used to generate the screenshots.
Expand Down

0 comments on commit 0b8d218

Please sign in to comment.