Nano_LLM module not found

[bjoshi-bit]

Hi, I am currently having issue with running my ros2 node and it not seeing the nano_llm module. Thank you in advance.

jetson-containers run $(autotag nano_llm:humble) /
    ros2 launch ros2_nanollm camera_input_example.launch.py
Namespace(packages=['nano_llm:humble'], prefer=['local', 'registry', 'build'], disable=[''], user='dustynv', output='/tmp/autotag', quiet=False, verbose=False)
-- L4T_VERSION=36.4.0  JETPACK_VERSION=6.1  CUDA_VERSION=12.6
-- Finding compatible container image for ['nano_llm:humble']
nano_llm:humble-r36.4.0-opencv
V4L2_DEVICES:  --device /dev/video0  --device /dev/video1 
### DISPLAY environmental variable is already set: ":1"
localuser:root being added to access control list
+ docker run --runtime nvidia -it --rm --network host --shm-size=8g --volume /tmp/argus_socket:/tmp/argus_socket --volume /etc/enctune.conf:/etc/enctune.conf --volume /etc/nv_tegra_release:/etc/nv_tegra_release --volume /tmp/nv_jetson_model:/tmp/nv_jetson_model --volume /var/run/dbus:/var/run/dbus --volume /var/run/avahi-daemon/socket:/var/run/avahi-daemon/socket --volume /var/run/docker.sock:/var/run/docker.sock --volume /media/ubu/msdcard/jetson-containers/data:/data -v /etc/localtime:/etc/localtime:ro -v /etc/timezone:/etc/timezone:ro --device /dev/snd -e PULSE_SERVER=unix:/run/user/1000/pulse/native -v /run/user/1000/pulse:/run/user/1000/pulse --device /dev/bus/usb -e DISPLAY=:1 -v /tmp/.X11-unix/:/tmp/.X11-unix -v /tmp/.docker.xauth:/tmp/.docker.xauth -e XAUTHORITY=/tmp/.docker.xauth --device /dev/video0 --device /dev/video1 --device /dev/i2c-0 --device /dev/i2c-1 --device /dev/i2c-2 --device /dev/i2c-3 --device /dev/i2c-4 --device /dev/i2c-5 --device /dev/i2c-6 --device /dev/i2c-7 --device /dev/i2c-8 --device /dev/i2c-9 --device /dev/ttyACM0 --name jetson_container_20241212_162014 nano_llm:humble-r36.4.0-opencv /
docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "/": is a directory: unknown: permission denied.
[INFO] [launch]: All log files can be found below /home/ubu/.ros/log/2024-12-12-16-20-15-059370-ubuntu-9108
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [cam2image-1]: process started with pid [9109]
[INFO] [nano_llm_py-2]: process started with pid [9111]
[nano_llm_py-2] Traceback (most recent call last):
[nano_llm_py-2]   File "/home/ubu/ros2_workspace/install/ros2_nanollm/lib/ros2_nanollm/nano_llm_py", line 33, in <module>
[nano_llm_py-2]     sys.exit(load_entry_point('ros2-nanollm', 'console_scripts', 'nano_llm_py')())
[nano_llm_py-2]   File "/home/ubu/ros2_workspace/install/ros2_nanollm/lib/ros2_nanollm/nano_llm_py", line 25, in importlib_load_entry_point
[nano_llm_py-2]     return next(matches).load()
[nano_llm_py-2]   File "/usr/lib/python3.10/importlib/metadata/__init__.py", line 171, in load
[nano_llm_py-2]     module = import_module(match.group('module'))
[nano_llm_py-2]   File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
[nano_llm_py-2]     return _bootstrap._gcd_import(name[level:], package, level)
[nano_llm_py-2]   File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
[nano_llm_py-2]   File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
[nano_llm_py-2]   File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
[nano_llm_py-2]   File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
[nano_llm_py-2]   File "<frozen importlib._bootstrap_external>", line 883, in exec_module
[nano_llm_py-2]   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
[nano_llm_py-2]   File "/home/ubu/ros2_workspace/build/ros2_nanollm/ros2_nanollm/nano_llm_py.py", line 22, in <module>
[nano_llm_py-2]     from nano_llm import NanoLLM, ChatHistory
[nano_llm_py-2] ModuleNotFoundError: No module named 'nano_llm'
[ERROR] [nano_llm_py-2]: process has died [pid 9111, exit code 1, cmd '/home/ubu/ros2_workspace/install/ros2_nanollm/lib/ros2_nanollm/nano_llm_py --ros-args --params-file /tmp/launch_params_ddqipw4w'].
[cam2image-1] [ WARN:0] global ./modules/videoio/src/cap_gstreamer.cpp (1100) open OpenCV | GStreamer warning: Cannot query video position: status=0, value=-1, duration=-1
[cam2image-1] [INFO] [1734038417.151921920] [cam2image]: Publishing image #1
[cam2image-1] [INFO] [1734038417.184627488] [cam2image]: Publishing image #2
[cam2image-1] [INFO] [1734038417.217605568] [cam2image]: Publishing image #3
[cam2image-1] [INFO] [1734038417.251563072] [cam2image]: Publishing image #4
[cam2image-1] [INFO] [1734038417.301092448] [cam2image]: Publishing image #5
[cam2image-1] [INFO] [1734038417.351772000] [cam2image]: Publishing image #6
[cam2image-1] [INFO] [1734038417.399567200] [cam2image]: Publishing image #7
[cam2image-1] [INFO] [1734038417.451637856] [cam2image]: Publishing image #8
[cam2image-1] [INFO] [1734038417.499619840] [cam2image]: Publishing image #9
[cam2image-1] [INFO] [1734038417.535613824] [cam2image]: Publishing image #10
[cam2image-1] [INFO] [1734038417.567565760] [cam2image]: Publishing image #11
[cam2image-1] [INFO] [1734038417.599690464] [cam2image]: Publishing image #12
[cam2image-1] [INFO] [1734038417.635651584] [cam2image]: Publishing image #13
[cam2image-1] [INFO] [1734038417.667636384] [cam2image]: Publishing image #14
[cam2image-1] [INFO] [1734038417.699631360] [cam2image]: Publishing image #15
[cam2image-1] [INFO] [1734038417.735517280] [cam2image]: Publishing image #16
[cam2image-1] [INFO] [1734038417.767671136] [cam2image]: Publishing image #17
[cam2image-1] [INFO] [1734038417.799548576] [cam2image]: Publishing image #18
[cam2image-1] [INFO] [1734038417.835737536] [cam2image]: Publishing image #19
[cam2image-1] [INFO] [1734038417.867591712] [cam2image]: Publishing image #20
^C[WARNING] [launch]: user interrupted with ctrl-c (SIGINT)
[cam2image-1] [INFO] [1734038417.877783648] [rclcpp]: signal_handler(signum=2)
[cam2image-1] [INFO] [1734038417.899655264] [cam2image]: Publishing image #21
[INFO] [cam2image-1]: process has finished cleanly [pid 9109]