v2.2.0: Merge pull request #19 from mavroudo/v2

Preprocess is working in a separate process.
Created a new docker-compose with all the different components

v2.1.1

• Hotfix in indexing process for Cassandra and S3
• Introduce partitions for LastChecked to handle incremental indexing
• Simpler way to extract pairs and not n-tuples

Execute the preprocess component using API

• Added FastAPI to submit preprocessing jobs using api calls
• Extensive documentation to the entire project

The documentation for the latest version of the preprocess component can be accessed from here. Otherwise, they are located in the docs/ folder and you can access it by opening the index.html in a browser.

Support for S3 and incremental indexing capabilities

• Implement efficient incremental indexing, utilizing the previously indexed traces/pairs
• Connection with S3, as an alternative to Cassandra
• Optimize storage space, utilizing compression algorithms and avoiding storing timestamps

Original SIESTA implementation

Building the appropriate inverted indices to support efficient pattern detection
Evaluate different indexing schemas
Integration of Signature method
Integration of Set-Containment method
Connection with Cassandra, where indices are stored