Feature Request:

[Basten7]

Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Add the --device parameter to the llama-bench CLI binary.

Motivation

First, sometimes it is not possible to select a specific device or a set of devices using only the -sm and -sp parameters.

Second, the llama-cli already has the --device (-d) parameter, so this would be a way to harmonize the CLI interface across binaries.

Possible Implementation

No response

[Basten7]

Feature Description

Add the -ctv and -ctk parameters to the llama-bench CLI binary.