Skip to content

Commit

Permalink
Update docs/source/ipex/inference.mdx
Browse files Browse the repository at this point in the history
  • Loading branch information
echarlaix authored Aug 26, 2024
1 parent be7097d commit 21f06cf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/ipex/inference.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ Optimum Intel can be used to load models from the [Hub](https://huggingface.co/m
## Loading

You can load models from HuggingFace Model Hub, it will be optimized by ipex (including weight prepack and graph mode) during loading. The ipex will patch custom op for models like llama, bert, vit.
For now, the IPEX optimization is only supported for CPUs, the original model will be exported via TorchScript. In the future `torch.compile` will be used and model exported via TorchScript will get deprecated.
For now, support is only enabled for CPUs and the original model will be exported via TorchScript. In the future `torch.compile` will be used and model exported via TorchScript will get deprecated.

```diff
import torch
Expand Down

0 comments on commit 21f06cf

Please sign in to comment.