Enable running custom scripts before executing a component

[RobbeSneyders]

Some components require running a custom script before executing the component (e.g. model compilation at runtime).
This works fine for the local runner since we can change the entrypoint from:

ENTRYPOINT ["fondant", "execute", "main"]

to

ENTRYPOINT ["entrypoint.sh"]

where entrypoint.sh can contains the following:

# Example of custom script
/bin/bash ./build.sh

# Component execution 
echo "Executing command: fondant execute main.py $@"
fondant execute main.py "$@"

However, the entrypoint command is currently hardcoded for kubeflow and should be custom

b617ef4

We should find a way to force the running of a custom script before executing the component

[PhilippeMoussalli]

I am not sure if we should provide a generic way of implementing this, you could still copy over the bash script and execute it either at at the beginning of the file

import os

script_path = 'script.sh'

os.system(f'bash {script_path}')

or the __init__/ transform method of the component depending on whether it's a one time or recurring script per partition (will probably only be at the __init__ level)

import os

class customComponent(PandasTransformComponent):
        os.system( 'script.sh'')
                   

This has the advantage that the user does not need to know that they would to have to execute fondant execute main.py "$@" after the bash script is executed