Skip to content

Commit

Permalink
updated data extraction and readme
Browse files Browse the repository at this point in the history
  • Loading branch information
franciscojavierarceo committed May 2, 2024
1 parent 7055939 commit 064dce0
Show file tree
Hide file tree
Showing 5 changed files with 109 additions and 18 deletions.
10 changes: 10 additions & 0 deletions module_4_rag/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,16 @@ Then run
```bash
python batch_score_documents.py
```
Which will output data to `city_wikipedia_summaries_with_embeddings.parquet`

## Feast

To get started, make sure to have Feast installed and PostGreSQL.

First run
```bash
feast apply
```

# Overview

Expand Down
2 changes: 1 addition & 1 deletion module_4_rag/batch_score_documents.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
import os
import os
import pandas as pd
from transformers import AutoTokenizer, AutoModel
import torch
Expand Down
Loading

0 comments on commit 064dce0

Please sign in to comment.