Skip to content

Commit

Permalink
Add PyPi module usage details
Browse files Browse the repository at this point in the history
  • Loading branch information
tairov committed Aug 23, 2023
1 parent 27f0a79 commit f4eb597
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,19 @@ Jack and Sammy fishing adventure foreshium of a wishing being free time, happy.
achieved tok/s: 1.3463711338028914
```

## use as a package
[PyPi llama2-py](https://pypi.org/project/llama2-py/)
```bash
pip install llama2-py
```

```python
>>> import llama2
>>> llama2.run({"checkpoint": "out/model.bin", "temperature": 0.0, "steps": 256, "prompt": None})
<s>
Once upon a time, there was...
```

## performance

Performance is awful at the moment.
Expand Down

0 comments on commit f4eb597

Please sign in to comment.