error when running an API using fastAPI for a Machine Learning model

[hugodrf88]

Select Topic Area

Question

Body

Hello,
I am trying to develop for the first time an API for a ML model but unfortunately it does not work at runtime with
uvicorn api:app --host 127.0.0.1 --port 8000I get the following error:

(venv) PS C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7> uvicorn api:app --host 127.0.0.1 --port 8000
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Scripts\uvicorn.exe\__main__.py", line 7, in <module>
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\click\core.py", line 1130, in __call__
  return self.main(*args, **kwargs)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\click\core.py", line 1055, in main
  rv = self.invoke(ctx)
       ^^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\click\core.py", line 1404, in invoke
  return ctx.invoke(self.callback, **ctx.params)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\click\core.py", line 760, in invoke
  return __callback(*args, **kwargs)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\uvicorn\main.py", line 410, in main
  run(
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\uvicorn\main.py", line 578, in run
  server.run()
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\uvicorn\server.py", line 61, in run
  return asyncio.run(self.serve(sockets=sockets))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\asyncio\runners.py", line 190, in run
  return runner.run(main)
         ^^^^^^^^^^^^^^^^
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\asyncio\runners.py", line 118, in run
  return self._loop.run_until_complete(task)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\asyncio\base_events.py", line 653, in run_until_complete
  return future.result()
         ^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\uvicorn\server.py", line 68, in serve
  config.load()
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\uvicorn\config.py", line 473, in load
  self.loaded_app = import_from_string(self.app)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\uvicorn\importer.py", line 21, in import_from_string
  module = importlib.import_module(module_str)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\importlib\__init__.py", line 126, in import_module
  return _bootstrap._gcd_import(name[level:], package, level)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<frozen importlib._bootstrap>", line 1206, in _gcd_import
File "<frozen importlib._bootstrap>", line 1178, in _find_and_load
File "<frozen importlib._bootstrap>", line 1149, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 940, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\api.py", line 48, in <module>
  model_logreg = joblib.load('./models/logreg_model.pkl')
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\joblib\numpy_pickle.py", line 658, in load
  obj = _unpickle(fobj, filename, mmap_mode)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\OCR\exos\Projet 7\OCRProjet7\venv\Lib\site-packages\joblib\numpy_pickle.py", line 577, in _unpickle
  obj = unpickler.load()
        ^^^^^^^^^^^^^^^^
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\pickle.py", line 1213, in load
  dispatch[key[0]](self)
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\pickle.py", line 1538, in load_stack_global
  self.append(self.find_class(module, name))
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\pickle.py", line 1582, in find_class
  return _getattribute(sys.modules[module], name)[0]
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hugo\AppData\Local\Programs\Python\Python311\Lib\pickle.py", line 331, in _getattribute
  raise AttributeError("Can't get attribute {!r} on {!r}"
AttributeError: Can't get attribute 'fill_num' on <module '__main__' from 'C:\\Users\\hugo\\OCR\\exos\\Projet 7\\OCRProjet7\\venv\\Scripts\\uvicorn.exe\\__main__.py'>

Here is the corresponding api file:
FILE api.py

model_logreg = joblib.load('./models/logreg_model.pkl')

logging.basicConfig(level=logging.DEBUG)





app = FastAPI()


class PredictionRequest(BaseModel):
    NAME_CONTRACT_TYPE: object
    CODE_GENDER: object
    ...(there is 120 variables)


class PredictionResponse(BaseModel):
    prediction: float



@app.get("/")
def read_root():
    print("Hello, World!")
    return {"message": "Hello, World!"}

@app.post('/prediction', response_model=PredictionResponse)
def prediction(request: PredictionRequest):
    logging.basicConfig(level=logging.DEBUG)

    logging.debug("Votre message de débogage ici")
    dict_values = {
    "NAME_CONTRACT_TYPE": request.NAME_CONTRACT_TYPE,
    "CODE_GENDER": request.CODE_GENDER,
    "FLAG_OWN_CAR": request.FLAG_OWN_CAR,
    ...
    }



    df_values=pd.DataFrame(dict_values,index=[0])
    prediction_result=model_logreg.predict_proba(df_values)
    prediction_result=prediction_result[0][1]
   # prediction_result=str(prediction_result.round(2))



    return PredictionResponse(prediction=prediction_result)


if __name__ == '__main__':


    uvicorn.run(app, host='127.0.0.1', port=8000)

I should point out that I trained the model in a python file and exported it as follows:
joblib.dump(model,"./models/logreg_model.pkl") ((the model uses two functions fill_num, fill_cat to replace missing values))

And I tried it to do a prediction in a python file and it worked perfectly :

import joblib
import pandas as pd
import category_encoders

from functions.functions import fill_cat,fill_num

model_logreg = joblib.load('./models/logreg_model.pkl')

dict={"NAME_CONTRACT_TYPE": "Cash loans",
"CODE_GENDER": "F",
"FLAG_OWN_CAR": "N",
...,}

df=pd.DataFrame(dict,index=[0])
print(df)

pred=model_logreg.predict_proba(df)
print(pred[0][1])

OUTPUT:
0.4031491301709147

I also tried to import the functions "fill_cat" and "fill_num" directly in api.py and get the same error

[Leke-Ariyo]

It might be compatibility issues between versions of the packages

[github-actions[bot]]

🕒 Discussion Activity Reminder 🕒

This Discussion has been labeled as dormant by an automated system for having no activity in the last 60 days. Please consider one the following actions:

1️⃣ Close as Out of Date: If the topic is no longer relevant, close the Discussion as out of date at the bottom of the page.

2️⃣ Provide More Information: Share additional details or context — or let the community know if you've found a solution on your own.

3️⃣ Mark a Reply as Answer: If your question has been answered by a reply, mark the most helpful reply as the solution.

Note: This dormant notification will only apply to Discussions with the Question label. To learn more, see our recent announcement.

Thank you for helping bring this Discussion to a resolution! 💬