No module named dask when running flyte dask task


Getting the following error trying to run flyte + dask task. Apparently my custom build image is missing dask.  

[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes. [f7ff659ca25e040d89db-n0-0] terminated with exit code (1). Reason [Error]. Message: otstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/root/workflows/hellodask.py", line 7, in <module> from dask import array as da ModuleNotFoundError: No module named 'dask'

All you need to do is ensure, your requirements.txt is updated.


flytekit>=1.2.7
pandas
scikit-learn
dask
flytekitplugins-dask

Rebuild your image and re-run your workflow. 


 

Comments

Post a Comment

Popular posts from this blog

The specified initialization vector (IV) does not match the block size for this algorithm

Image
If you're getting  exception when trying to assigned key to a symmetric key and getting error message below :- The specified initialization vector (IV) does not match the block size for this algorithm And your code probably look like something below :- Then you need to go into debug mode and start looking into the supported size for IV as shown in diagram below :- As you can see, IV is 16 bytes, so you need to provide 16 bytes. The same goes for Key field too, if you're adding anything to it. As long as you provide a valid key size, then we're good and you're code will be ready.
Read more