start of the k8s cluster

[jmikedupont2]

• Description: Start of k8s deployment
• Issue: deployment of swarms to k8s/faas
• Dependencies: adding submodules to vendors
  cc @kyegomez
• Twitter handle: @introsp3ctor
  Work in progress, please dont merge

[github-actions]

Hello there, thank you for opening an PR ! 🙏🏻 The team was notified and they will get back to you asap.

[jmikedupont2]

todo, add https://github.com/nozaq/terraform-aws-remote-state-s3-backend
https://github.com/im2nguyen/rover for visualization
https://github.com/JamesWoolfenden/pike to determine the least permissions
https://github.com/iann0036/iamlive to monitor the used permissions
https://github.com/kishaningithub/tf-import-gen to generate imports
https://github.com/nozaq/terraform-aws-remote-state-s3-backend for the creation of the s3 bucket

[jmikedupont2]

Using terraformer to import, then

upgrade the generated state with
tofu state replace-provider registry.opentofu.org/-/aws hashicorp/aws

then generate imports with
tf-import-gen

[jmikedupont2]

Apply worked.

[jmikedupont2]

next I will make sure the service is reachable,
also we will want to build the docker image from github actions or aws codebuild,
and we also want to slim down the docker image and also add in the health checks

[jmikedupont2]

@kyegomez now in the pr you have the k8s cluster, the docker compose test, a test routine, a deploy routine, some readme how I built it, and it fails to run the application code just like locally.

[jmikedupont2]

return await dependant.call(**values)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/api.py", line 148, in agent_completions
    completions=ChatCompletionResponse(
                ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/pydantic/main.py", line 193, in __init__
    self.__pydantic_validator__.validate_python(data, self_instance=self)
pydantic_core._pydantic_core.ValidationError: 4 validation errors for ChatCompletionResponse
model
  Field required [type=missing, input_value={'choices': [{'index': 0,...2, completion_tokens=1)}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.8/v/missing
object
  Field required [type=missing, input_value={'choices': [{'index': 0,...2, completion_tokens=1)}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.8/v/missing
choices.0.ChatCompletionResponseChoice.message.role
  Input should be 'assistant' [type=literal_error, input_value='Swarm Agent', input_type=str]
    For further information visit https://errors.pydantic.dev/2.8/v/literal_error
choices.0.ChatCompletionResponseStreamChoice.delta
  Field required [type=missing, input_value={'index': 0, 'message': {...ent': '', 'name': None}}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.8/v/missing