Skip to content
This repository has been archived by the owner on Apr 23, 2024. It is now read-only.

export模型的时候,报warning,有问题么? #59

Open
yangvicky opened this issue Mar 26, 2024 · 1 comment
Open

export模型的时候,报warning,有问题么? #59

yangvicky opened this issue Mar 26, 2024 · 1 comment

Comments

@yangvicky
Copy link

使用命令: OMP_NUM_THREADS=1 torchrun --nproc_per_node
Export.py --ckpt_dir <llama_dir>
--tokenizer_path <llama_tokenizer_dir>/tokenizer.model
--export_path <path_to_store_exported_llama7b>
--fused_qkv 1 --fused_kvcache 1 --auto_causal 1
--quantized_cache 1 --dynamic_batching 1
export 模型的时候,报一些warning信息,这是什么原因?会有什么影响?需要解决么?谢谢
[W shape_type_inference.cpp:1920] Warning: The shape inference of pmx::SwiGLU type is missing, so it may result in wrong shape inference for the exported graph. Please consider adding it in symbolic function. (function UpdateReliable)
[W shape_type_inference.cpp:1920] Warning: The shape inference of pmx::RowParallelLinear type is missing, so it may result in wrong shape inference for the exported graph. Please consider adding it in symbolic function. (function UpdateReliable)

@Alcanderian
Copy link
Collaborator

warning不需要理会,这是因为自定义算子没有C++层形状推导导致的

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants