Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add aten::_transformer_encoder_layer_fwd operator #1069

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Conversation

yucai-intel
Copy link
Contributor

No description provided.

@yucai-intel
Copy link
Contributor Author

yucai-intel commented Nov 13, 2024

Skipped:
test_nn_xpu.py::TestNNDeviceTypeXPU::test_TransformerDecoderLayer_empty_xpu
test_nn_xpu.py::TestNNDeviceTypeXPU::test_TransformerDecoderLayer_empty_xpu
test_nn_xpu.py::TestNNDeviceTypeXPU::test_TransformerDecoder_empty_xpu
test_nn_xpu.py::TestNNDeviceTypeXPU::test_Transformer_empty_xpu

Reason:
Double and complex datatype matmul is not supported in oneDNN

@yucai-intel
Copy link
Contributor Author

Passed:
2024-11-12T08:29:28.2253399Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 23%]
2024-11-12T08:29:28.2891396Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_eval_mode_xpu_float64 PASSED [ 23%]
2024-11-12T08:29:28.3590552Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 23%]
2024-11-12T08:29:28.4297395Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_train_mode_xpu_float64 PASSED [ 23%]
2024-11-12T08:29:34.1619525Z test_modules_xpu.py::TestModuleXPU::test_forward_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 30%]
2024-11-12T08:29:34.3106059Z test_modules_xpu.py::TestModuleXPU::test_forward_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 30%]
2024-11-12T08:29:45.0688168Z test_modules_xpu.py::TestModuleXPU::test_if_train_and_eval_modes_differ_nn_TransformerDecoderLayer_xpu_float32 PASSED [ 43%]
2024-11-12T08:29:45.1133936Z test_modules_xpu.py::TestModuleXPU::test_if_train_and_eval_modes_differ_nn_TransformerEncoderLayer_xpu_float32 PASSED [ 43%]
2024-11-12T08:30:09.9379150Z test_modules_xpu.py::TestModuleXPU::test_non_contiguous_tensors_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 65%]
2024-11-12T08:30:10.6821987Z test_modules_xpu.py::TestModuleXPU::test_non_contiguous_tensors_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 65%]
2024-11-12T08:30:17.2118296Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 72%]
2024-11-12T08:30:17.2307973Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_eval_mode_xpu_float64 PASSED [ 72%]
2024-11-12T08:30:17.2485095Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 72%]
2024-11-12T08:30:17.2696355Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_train_mode_xpu_float64 PASSED [ 72%]
2024-11-12T08:30:23.9521383Z test_modules_xpu.py::TestModuleXPU::test_save_load_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 79%]
2024-11-12T08:30:24.3319295Z test_modules_xpu.py::TestModuleXPU::test_save_load_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 79%]
2024-11-12T08:30:28.2797438Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_eval_mode_swap_False_xpu_float32 PASSED [ 86%]
2024-11-12T08:30:28.3082916Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_eval_mode_swap_True_xpu_float32 PASSED [ 86%]
2024-11-12T08:30:28.3394529Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_train_mode_swap_False_xpu_float32 PASSED [ 86%]
2024-11-12T08:30:28.3721485Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_train_mode_swap_True_xpu_float32 PASSED [ 86%]
2024-11-12T08:30:31.7270981Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_eval_mode_swap_False_set_grad_False_xpu_float32 PASSED [ 99%]
2024-11-12T08:30:31.7678920Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_eval_mode_swap_False_set_grad_True_xpu_float32 PASSED [ 99%]
2024-11-12T08:30:31.8986542Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_eval_mode_swap_True_set_grad_False_xpu_float32 PASSED [ 99%]
2024-11-12T08:30:31.9280898Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_train_mode_swap_False_set_grad_False_xpu_float32 PASSED [ 99%]
2024-11-12T08:30:31.9727896Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_train_mode_swap_False_set_grad_True_xpu_float32 PASSED [ 99%]
2024-11-12T08:30:32.1181175Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_train_mode_swap_True_set_grad_False_xpu_float32 PASSED [ 99%]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants