In this project, I used a pre-trained quantized version of llama3-base on lavita/ChatDoctor-HealthCareMagic-100k data set and used PEFT/LoRA to reduce update size and help fit model into memory.
The dataset used to fine-tune the model is HuggingFace ChatDoctor-HealthCareMagic-100k. A preview of the data set is shown below
The model is then fine-tuned on a Lightning.ai T4 GPU (24GB RAM) where it trained without any issue.
See Llama3 Chat Doctor Notebook
Patient's Query I am a male 79 years old, have brief chills the may sweat have had for about 2 months also white blood cell count to high had bone marrow test and ok so far dr has no idea what is wrong when I chill have no fever as I check that and blood pressure. thanks
AI response Thank you for sharing your symptoms with me. It's good to know that your blood work and bone marrow test came back normal. Based on your symptoms of brief chills and sweating, I would like to investigate further. I would like to perform a thorough physical examination, including checking your vital signs, such as your blood pressure, pulse, and respiratory rate. Additionally, I would like to order some additional tests to help us better understand what's going on. These tests may include a complete blood count, a urinalysis, and possibly some imaging studies, such as a chest X-ray or a computed tomography (CT) scan.