Opik integration #1
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* add xinference rerank class * Update base.py use def to replace lamabda * Update base.py rm useless init * Update base.py fix linting --------- Co-authored-by: Logan <[email protected]>
fix examples and docs
* add optimum intel with ipex backend to llama-index-integration with notebook example * fix typo * bumped dependency versions and upgraded to newer llama-index-utils-huggingface package * add gaudi-tei link in example notebook --------- Co-authored-by: Rita Brugarolas <[email protected]>
Documenting: Default workflows for nested workflows, streaming events, unbound syntax
* fix 15451 * add test cases --------- Co-authored-by: Massimiliano Pippi <[email protected]>
fix `pip install` and `available_models` examples
…lama#15691) * increase coverage for event.py * ignore type checking imports for coverage * properly shut down workflow in test * cover workflow module and simplify validation
…#14652) * local default model for embedding * default model code for llm * add default model code for reranker * notebook rerun changes * test cases update * remove poetry lock files * code cleanup * update nvidia reranker notebook * mock the integrate api calls * mock integrate api calls in test case * mock test cases in api_key * add test cases for embeddings * fix lint, test cases * fix bug in rerank url parsing, test cases * remove poetry lock files * fix test cases, code * fix lint issues * less restrictive dep * fix for the url warning and test cases * add masked env to test case * remove test case for now --------- Co-authored-by: Logan <[email protected]>
…llama#15709) * refact: merge Context and Session to simplify the workflows api * add deprecation warnings * remove session usage * remove session usage from docs * remove usage of self.data
* fix: stop streaming events when a step raises * remove session
…utils/llama-index-utils-workflow (run-llama#15718) chore(deps-dev): bump jupyterlab Bumps [jupyterlab](https://github.com/jupyterlab/jupyterlab) from 4.2.4 to 4.2.5. - [Release notes](https://github.com/jupyterlab/jupyterlab/releases) - [Changelog](https://github.com/jupyterlab/jupyterlab/blob/@jupyterlab/[email protected]/CHANGELOG.md) - [Commits](https://github.com/jupyterlab/jupyterlab/compare/@jupyterlab/[email protected]...@jupyterlab/[email protected]) --- updated-dependencies: - dependency-name: jupyterlab dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…re (run-llama#15717) Bumps [notebook](https://github.com/jupyter/notebook) from 7.2.1 to 7.2.2. - [Release notes](https://github.com/jupyter/notebook/releases) - [Changelog](https://github.com/jupyter/notebook/blob/@jupyter-notebook/[email protected]/CHANGELOG.md) - [Commits](https://github.com/jupyter/notebook/compare/@jupyter-notebook/[email protected]...@jupyter-notebook/[email protected]) --- updated-dependencies: - dependency-name: notebook dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* docs: update ai21 docs and readme with jamba 1.5 and tool calling * docs: update ai21 docs and readme with jamba 1.5 and tool calling * docs: update ai21 docs and readme with jamba 1.5 and tool calling
…_parser, readers, embeddings (run-llama#15934)
* feat(postgres): add support for engine parameters - Introduced engine_params to support passing parameters to create_engine. - Updated create_engine and create_async_engine calls to include engine_params. - Initialized engine_params in the constructor. * style(lint): reformat for readability * refactor(postgres): rename engine_params to create_engine_kwargs * refactor(postgres): rename engine_params to create_engine_kwargs * chore: bump version to 0.2.3 * fix(postgres): rename engine_params to create_engine_kwargs
* update falkordb client * bump version * update version * fix
Abby/small updates
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR adds a new Opik integration. Opik is an open-source LLM evaluation platform built by the Comet team.
Fixes # (issue)
New Package?
Did I fill in the
tool.llamahubsection in thepyproject.tomland provide a detailed README.md for my new integration or package?Version Bump?
Did I bump the version in the
pyproject.tomlfile of the package I am updating? (Except for thellama-index-corepackage)Type of Change
Please delete options that are not relevant.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
The integration was checked by running:
llama-index-integrations/callbacks/llama-index-callbacks-opik/examples/opik_example.pyhttps://www.comet.com/docs/opik/cookbook/llama-indexSuggested Checklist:
make format; make lintto appease the lint gods