GPTCache is ignoring cached question for the same session

[Sebastian7C]

Hello,

I'm facing an issue with storing my cache by session. When I use the same session for a question that has already been cached, it seems like the cache is completely ignored. Here's a snippet of my code:

`from gptcache.session import Session
from gptcache import cache
from gptcache.adapter import openai
import os

cache.init()
cache.set_openai_key()

Creating a session

session = Session(name="my-session")

Asking a question and getting a response

response = openai.ChatCompletion.create(
model='gpt-3.5-turbo',
messages=[
{
'role': 'user',
'content': "what's Github"
}],
session=session,
temperature=0.9
)

Asking the same question again with the same session

response = openai.ChatCompletion.create(
model='gpt-3.5-turbo',
messages=[
{
'role': 'user',
'content': "what's Github"
}],
session=session,
temperature=0.9
)
`
I'm wondering if anyone has insights on how to make sessions work properly in this context. Any help would be appreciated. Thanks!

[SimFG]

the test example maybe help you to solve the problem

GPTCache/tests/unit_tests/test_session.py

Lines 83 to 122 in acc20f0

	def test_ssd(self):
	onnx = Onnx()
	data_manager = manager_factory("sqlite,faiss", './test_session', vector_params={"dimension": onnx.dimension})
	cache.init(
	pre_embedding_func=get_prompt,
	embedding_func=onnx.to_embeddings,
	data_manager=data_manager,
	similarity_evaluation=SearchDistanceEvaluation(),
	)
	session0 = Session(self.session_id, check_hit_func=check_hit)
	with patch("openai.Completion.create") as mock_create:
	mock_create.return_value = {
	"choices": [{"text": self.expect_answer, "finish_reason": None, "index": 0}],
	"created": 1677825464,
	"id": "cmpl-6ptKyqKOGXZT6iQnqiXAH8adNLUzD",
	"model": "text-davinci-003",
	"object": "text_completion",
	}
	response = openai.Completion.create(model="text-davinci-003", prompt=self.question, session=session0)
	answer_text = get_text_from_openai_answer(response)
	self.assertEqual(answer_text, self.expect_answer)
	response = openai.Completion.create(model="text-davinci-003", prompt=self.question, session=session0)
	answer_text = get_text_from_openai_answer(response)
	self.assertEqual(answer_text, self.expect_answer)
	session1 = Session()
	response = openai.Completion.create(model="text-davinci-003", prompt=self.question, session=session1)
	answer_text = get_text_from_openai_answer(response)
	self.assertEqual(answer_text, self.expect_answer)
	with self.assertRaises(AuthenticationError):
	openai.Completion.create(model="text-davinci-003", prompt=self.question, session=session1)
	self.assertEqual(len(data_manager.list_sessions()), 2)
	session0.drop()
	session1.drop()
	self.assertEqual(len(data_manager.list_sessions()), 0)

[SimFG]

doc: https://github.com/zilliztech/GPTCache/blob/main/examples/README.md#How-to-run-with-session