RAG example not working..

[guytamir]

Flow in RAG example does not work..

I'll be following the instructions as in here: https://github.com/intel/intel-extension-for-transformers/tree/main/intel_extension_for_transformers/neural_chat/examples/quick_start/rag
intel-extension-for-transformers/intel_extension_for_transformers/neural_chat/examples/quick_start/rag at main · intel/intel-extension-for-transformers

And when got this message:
[09:28] Tamir, Guy
(itrex-rag) intel@intel-NUC12SNKi72:~/itrex$ pip install -v .

Using pip 23.3.1 from /home/intel/anaconda3/envs/itrex-rag/lib/python3.9/site-packages/pip (python 3.9)

Processing /home/intel/itrex

Running command python setup.py egg_info

Traceback (most recent call last):

File "<string>", line 2, in <module>

File "<pip-setuptools-caller>", line 34, in <module>

File "/home/intel/itrex/setup.py", line 56, in <module>

  if ipex_available and (get_gpu_family() != "no_gpu"):

File "/home/intel/itrex/setup.py", line 26, in get_gpu_family

  import torch

File "/home/intel/anaconda3/envs/itrex-rag/lib/python3.9/site-packages/torch/__init__.py", line 235, in <module>

  from torch._C import *  # noqa: F403

ImportError: /home/intel/anaconda3/envs/itrex-rag/lib/python3.9/site-packages/torch/lib/libtorch_cpu.so: undefined symbol: iJIT_NotifyEvent

error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.

│ exit code: 1

╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

full command: /home/intel/anaconda3/envs/itrex-rag/bin/python -c '

exec(compile('"'"''"'"''"'"'

This is -- a caller that pip uses to run setup.py

- It imports setuptools before invoking setup.py, to enable projects that directly

import from distutils.core to work with newer packaging standards.

- It provides a clear error message when setuptools is not installed.

- It sets sys.argv[0] to the underlying setup.py, when invoking setup.py so

setuptools doesn'"'"'t think the script is -c. This avoids the following warning:

manifest_maker: standard file '"'"'-c'"'"' not found".

- It generates a shim setup.py, for handling setup.cfg-only projects.

import os, sys, tokenize

try:

  import setuptools

except ImportError as error:

  print(

      "ERROR: Can not execute `setup.py` since setuptools is not available in "

      "the build environment.",

      file=sys.stderr,

  )

  sys.exit(1)

file = %r

sys.argv[0] = file

if os.path.exists(file):

  filename = __file__

  with tokenize.open(__file__) as f:

      setup_py_code = f.read()

else:

  filename = "<auto-generated setuptools caller>"

  setup_py_code = "from setuptools import setup; setup()"

exec(compile(setup_py_code, filename, "exec"))

'"'"''"'"''"'"' % ('"'"'/home/intel/itrex/setup.py'"'"',), "", "exec"))' egg_info --egg-base /tmp/pip-pip-egg-info-3lcxp8hp

cwd: /home/intel/itrex/

Preparing metadata (setup.py) ... error

error: metadata-generation-failed

× Encountered error while generating package metadata.

╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.

hint: See above for details.

---

Running on Ubuntu 22, trying to make it work for A770

[xiguiw]

@guytamir

This error was caused during build ITREX packge from source code.
Please note oneAPI 2024.0 is required.
It seemed your environment is oneAPI 2024.1.

I'll change the example to use a released ITREX package instead of build it.
Will submit PR to update the example.