0.13.0
Disk size
Previously, dstack
set the disk size to 100GB
regardless of the cloud provider. Now, to accommodate larger language
models and datasets, dstack
enables setting a custom disk size using --disk
in dstack run
or via the disk
property in .dstack/profiles.yml
.
CUDA 12.1
We've upgraded the default Docker image's CUDA drivers to 12.1 (for better compatibility with modern libraries).
Mixtral 8x7B
Lastly, and most importantly, we've added the example showing how to deploy Mixtral 8x7B as a service.