elasticsearch_multisouce_searchengine

the idea:

• no longer need to know the individual locations of the information you are looking for

• no need to understand the data model, if given

• no need to know the query syntax of the different source systems

• only one location and one query language

preparations:

• you need docker
• and docker-compose

here is a example procedure to explore our searchengine:

• example procedure

architecture:

supporting links used to build this system:

• https://www.docker.com/get-started
• https://docs.docker.com/compose/
• https://kb.objectrocket.com/postgresql/generate-postgres-test-data-with-python-part-1-1252
• https://kb.objectrocket.com/postgresql/generate-postgres-test-data-with-python-part-2-1253
• https://hub.docker.com/_/postgres
• https://medium.com/analytics-vidhya/getting-started-with-postgresql-using-docker-compose-34d6b808c47c
• https://towardsdatascience.com/how-to-synchronize-elasticsearch-with-mysql-ed32fc57b339
• https://medium.com/@emreceylan/how-to-sync-postgresql-data-to-elasticsearch-572af15845ad
• https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-overview.html
• https://medium.com/codemonday/docker-your-first-postgresql-connection-in-10-mins-90627a199f87
• https://www.geeksforgeeks.org/how-to-run-a-python-script-using-docker/
• https://www.postgresqltutorial.com/postgresql-python/create-tables/
• https://docs.docker.com/compose/startup-order/
• https://towardsdatascience.com/getting-started-with-elasticsearch-in-python-c3598e718380
• https://medium.com/naukri-engineering/elasticsearch-tutorial-for-beginners-using-python-b9cb48edcedc
• https://designers-inn.de/blindtexte/