Help in setting parameter allow_pickle for a function that returns numpy arrays

[sakthi-tech4th]

Hi,

I'm new to Flyte. I've created a task that returns two numpy arrays. However, I'm getting an error that says that the parameter allow_pickle has been set to False and should be set to True. However, that parameter is set when using numpy.load or numpy.save. My function uses neither. This is the output error message:

My understanding is that Flyte task internally stores the return values and retrieves it. And it requires the parameter allow_pickle=True. However, I couldn't find any documentation on how to set this parameter.

I greatly appreciate, any help in this regard.

Hope to hear soon from you,
Thanks

[samhita-alla]

@sakthi-tech4th, pickling isn't recommended by NumPy for security reasons: https://numpy.org/doc/stable/reference/generated/numpy.load.html. However, I can work on adding support for NumPy annotation with which you can set allow_pickle to True. np.ndarray without an object dtype is a valid Flyte type, though.