From 1541d23b2855948ac3b8fe30ba92602a9f6c1af4 Mon Sep 17 00:00:00 2001 From: Emre Can Kartal <159995642+eckartal@users.noreply.github.com> Date: Tue, 17 Sep 2024 13:40:43 +0300 Subject: [PATCH] Create v0.5.4 changed post --- .../2024-09-17-improved-cpu-performance.mdx | 35 +++++++++++++++++++ 1 file changed, 35 insertions(+) create mode 100644 src/pages/changelog/2024-09-17-improved-cpu-performance.mdx diff --git a/src/pages/changelog/2024-09-17-improved-cpu-performance.mdx b/src/pages/changelog/2024-09-17-improved-cpu-performance.mdx new file mode 100644 index 00000000..598d0b8a --- /dev/null +++ b/src/pages/changelog/2024-09-17-improved-cpu-performance.mdx @@ -0,0 +1,35 @@ +--- +title: "Jan is faster now" +version: 0.5.4 +description: "Jan has faster CPU inference." +date: 2024-09-17 +ogImage: "/assets/images/changelog/jan-v0.5.4.jpg" +--- + +import ChangelogHeader from "@/components/Changelog/ChangelogHeader" + + + +Over the last few weeks, we've been working on improving Jan's stability. Every update helps us make Jan's experience faster and smoother. +With version 0.5.4, you’ll notice AI running quicker on CPU - better performance all around. + +### Model Downloads Made Easier +You can now download models directly from the model selector in Threads. No more jumping between different tabs – just pick, download, and get started. + +### Improved CPU Inference +We've addressed the slower inference speeds on CPU, so you'll notice faster processing times, especially when using larger models. + +### Error fixes for Mmdel startup +We tackled the notorious "model can't start / The specified module could not be found" error. +Plus, Phi-3 models are now working smoothly even if you're using an outdated version. + +### Consistent Warnings Between Views +Performance warnings are now aligned between Model Hub and Threads, giving you more reliable insights no matter where you're working. + +### Persistent Thread Settings +Switching between threads used to reset your instruction settings. That’s fixed now! Your settings will stay intact as you jump between old and new threads. + +### Minor UI Tweaks and Bug Fixes +We’ve also resolved issues with the input slider on the right panel and tackled several smaller bugs to keep everything running smoothly. + +For more details, see the [GitHub release notes](https://github.com/janhq/jan/releases/tag/v0.5.4).