Skip to content

Commit

Permalink
Update huggingface_loader.py
Browse files Browse the repository at this point in the history
  • Loading branch information
tqchen authored Mar 28, 2024
1 parent 4255a45 commit 2b82091
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/mlc_llm/loader/huggingface_loader.py
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ def load(
# multiple quantized parameters.
for name, loader_param in self._load_or_quantize(mlc_name, param, device):
# Apply presharding if needed
if name in preshard_funcs:
if preshard_funcs is not None and name in preshard_funcs:
for shard_id, shard_param in enumerate(preshard_funcs[name](loader_param)):
yield _sharded_param_name(name, shard_id), shard_param
else:
Expand Down

0 comments on commit 2b82091

Please sign in to comment.