Skip to content

Commit

Permalink
Use singleton core for StatefulLLMPipeline (#1449)
Browse files Browse the repository at this point in the history
Use utils::singleton_core() in LLMStatefulLLMPipeline

ticket: CVS-159945
  • Loading branch information
sammysun0711 authored Dec 27, 2024
1 parent b7e354f commit ad31314
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/cpp/src/llm_pipeline.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ class StatefulLLMPipeline final : public LLMPipelineImplBase {
const ov::AnyMap& config,
const ov::genai::GenerationConfig& generation_config
) : LLMPipelineImplBase(tokenizer, generation_config), m_sampler(m_tokenizer) {
ov::Core core;
ov::Core core = utils::singleton_core();
ov::CompiledModel compiled_model;
auto [core_plugin_config, plugin_config] = ov::genai::utils::split_core_compile_config(config);
utils::slice_matmul_statefull_model(model);
Expand Down

0 comments on commit ad31314

Please sign in to comment.