[docker] container or composition of services for e2e processing

[jastier]

Implement interprocess communication within Docker

The SKEMA architecture (.pdf and .graffle files) are on a Google drive here

• Create branch 'docker_integration' (done)
• Create network service 'skema_net'. docker-compose.yml will create this network if needed (done)
• Add this service to existing compose files (done)
• Test REST API comms end to end (skema-rs, skema-py servers are active on skema_net)

When building images to push to DockerHub, use the following naming convention from Issue ml4ai/skema#221:

• lumai/askem-skema-py
• lumai/askem-skema-rs
• lumai/askem-skema-text-reading
• lumai/askem-skema-img2mml

Tasks

Beta Give feedback

1. [docker] publish skema images to lumai namespace on dockerhub #221
   Integration +1
   
2. [docker] Jupyter notebook demonstrating integration workflows ASKEM-TA1-DockerVM#19
   2 of 2
   Integration documentation +2
   

[myedibleenso]

Let's use this issue to document our conversation around service orchestration.

[enoriega]

Hi guys. The TA-1 orchestration repository lives at https://github.com/ml4ai/ASKEM-TA1-DockerVM/

This is where Chunwei and I have started work to consolidate our TR apis.

Should we use that repository to manage the orchestration of the rest of the Skema images too?

[myedibleenso]

Are all of our compose files for service orchestration going to live in https://github.com/ml4ai/ASKEM-TA1-DockerVM/ for the time being? Do we want to do the same with example notebooks?

[enoriega]

It is my understanding that yes, that is the current agreement. https://mlbayes.slack.com/archives/C05AD8860S2/p1686162741083959

The notebooks should live on the same place as the compose file, as they're the documentation on how to use them for TA-4

[enoriega]

One additional repo has a docker image part of this integration project. The image is currently hand built and pushed into my personal hub account. @myedibleenso can you help replicate the config to do it automatically to our organization's hub?

ml4ai/ASKEM-TA1-DataModel#15

[jastier]

I believe this was completed for the June 28 Uncharted demo and was never closed out.

[myedibleenso]

Completed prior to start of hackathon.