Skip to content

Commit

Permalink
Refactor and Generalize Benchmark Suite (#1632)
Browse files Browse the repository at this point in the history
Summary:

Generalize the benchmarking suite to support general torchrec modules instead of just QuantizedEmbeddingBagCollection. Code was further refactored to be more clean and readable.

Furthermore, since generalizing the module involves passing the torch.nn.Module in, it is required that the input module be on CPU, as when sharding on GPU, there could be a CUDA OOM if only one copy of the model can fit on the GPU. Therefore, unsharded modules are removed from  testing (This can easily be replicated by world_size=1 as an argument)

Differential Revision: D52677415
  • Loading branch information
PaulZhang12 authored and facebook-github-bot committed Jan 16, 2024
1 parent 431fb6c commit 0f8953b
Show file tree
Hide file tree
Showing 2 changed files with 449 additions and 431 deletions.
Loading

0 comments on commit 0f8953b

Please sign in to comment.