Skip to content

Commit

Permalink
docs: update for todos
Browse files Browse the repository at this point in the history
  • Loading branch information
phodal committed Nov 10, 2023
1 parent 7cc698d commit 12dc799
Showing 1 changed file with 34 additions and 1 deletion.
35 changes: 34 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,38 @@ cargo build --target=x86_64-apple-ios --release

5.run app

## Model
## Model for Testing

### Convert Model to OnnX

Tools: [https://github.com/huggingface/optimum](https://github.com/huggingface/optimum)


1.setup

```bash
pip install optimum[exporters,onnxruntime]
```

2.convert onnx

```bash
optimum-cli export onnx -m Helsinki-NLP/opus-mt-zh-en --optimize O2 optus-mt-zh-en-onnx
```

3.quantize Onnx

```bash
optimum-cli onnxruntime quantize \
--avx512 \
--onnx_model bert-tiny-onnx \
-o quantized_bert-tiny-onnx
```


Examples: [https://github.com/unit-mesh/onnx-convert-test](https://github.com/unit-mesh/onnx-convert-test)

### Embedding Model

IntelliJ IDEA Search Everywhere Model:

Expand All @@ -92,6 +123,8 @@ Bloop Model:

## FAQ

### Failed to load Huggingface native library.

```
Caused by: ai.djl.engine.EngineException: Failed to load Huggingface native library.
at ai.djl.huggingface.tokenizers.jni.LibUtils.<clinit>(LibUtils.java:43)
Expand Down

0 comments on commit 12dc799

Please sign in to comment.