Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Process isolation is not working on MPS device #230

Open
baptistecolle opened this issue Jul 19, 2024 · 0 comments
Open

Process isolation is not working on MPS device #230

baptistecolle opened this issue Jul 19, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@baptistecolle
Copy link
Collaborator

Setting up the launcher to process on an MPS device causes the benchmark to be stuck permanently on “Sending report to main process.”

Steps to reproduce:
Run this configuration on an MPS device (Mac M-series).

defaults:
  - benchmark
  - scenario: inference
  - **launcher: process # launcher: inline works**
  - backend: pytorch
  - _base_
  - _self_

name: pytorch_bert

scenario:
  latency: true
  memory: true
  input_shapes:
    batch_size: 1
    sequence_length: 128

backend:
  device: mps
  no_weights: true
  model: bert-base-uncased

(example adapted from pytorch_bert.yaml)

Temporary Solution: set to launcher: inline

Remarks: launcher.start_method: fork does not also work on mac

@baptistecolle baptistecolle added the bug Something isn't working label Jul 19, 2024
@baptistecolle baptistecolle self-assigned this Jul 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant