Skip to content

Commit

Permalink
Update Jlama examples (#131)
Browse files Browse the repository at this point in the history
  • Loading branch information
tjake authored Dec 3, 2024
1 parent d07ffb3 commit 12e777b
Show file tree
Hide file tree
Showing 10 changed files with 378 additions and 458 deletions.
Binary file removed jlama-examples/.mvn/wrapper/maven-wrapper.jar
Binary file not shown.
7 changes: 4 additions & 3 deletions jlama-examples/.mvn/wrapper/maven-wrapper.properties
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,14 @@
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# https://www.apache.org/licenses/LICENSE-2.0
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
distributionUrl=https://repo.maven.apache.org/maven2/org/apache/maven/apache-maven/3.8.7/apache-maven-3.8.7-bin.zip
wrapperUrl=https://repo.maven.apache.org/maven2/org/apache/maven/wrapper/maven-wrapper/3.1.1/maven-wrapper-3.1.1.jar
wrapperVersion=3.3.2
distributionType=only-script
distributionUrl=https://repo.maven.apache.org/maven2/org/apache/maven/apache-maven/3.9.0/apache-maven-3.9.0-bin.zip
9 changes: 6 additions & 3 deletions jlama-examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,11 @@

[Jlama](https://github.com/tjake/Jlama) is a fast modern Java library for running many LLMs.

Jlama is built on Java 21 and utilizes the [Panama Vector API](https://openjdk.org/jeps/448) for fast inference.
Jlama is built on Java 20+ and utilizes the [Panama Vector API](https://openjdk.org/jeps/448) for fast inference.

### Jlama with LangChain4j

To run the examples you must have java 21 installed then run the following commands:
To run the examples you must have java 20+ installed and run the following commands:

```shell
cd jlama-examples
Expand All @@ -19,9 +19,12 @@ cd jlama-examples

# Build and run Rag example
./mvnw compile exec:exec@rag

# Build and run function calling example
./mvnw compile exec:exec@functions
```

To use Jlama with LangChain4j you must use Java 21 and include the following JVM arguments:
To use Jlama with your LangChain4j app you must use Java 20+ and include the following JVM arguments:

```
--add-modules=jdk.incubator.vector
Expand Down
Loading

0 comments on commit 12e777b

Please sign in to comment.