AttributeError: 'OpenAIBackend' object has no attribute 'encode'

[mahmawad]

Hi,
I still get this error message despite I use the last commit & version from bertopic, could you please help ?

Code:

import openai
from bertopic.backend import OpenAIBackend
from openai import AzureOpenAI
client = AzureOpenAI(
api_version = "2023-09-15-preview",
api_key =os.getenv("OPENAI_API_KEY").strip(),
azure_endpoint ="https://x-.openai.azure.com/",
)
embedding_model = OpenAIBackend(client,"text-embedding-3-large")

embeddings = embedding_model.encode(df['PreprocessedText'].tolist(), show_progress_bar=True)

from bertopic import BERTopic

Initialize and train BERTopic model

topic_model = BERTopic(
embedding_model=embedding_model,
vectorizer_model=vectorizer_model,
umap_model=umap_model,
calculate_probabilities=True,
#hdbscan_model=hdbscan_model,
representation_model=representation_model,
verbose=True,
nr_topics=10
)

Fit the topic model and transform the data

topics, probs = topic_model.fit_transform(df['PreprocessedText'].values)

[MaartenGr]

The encode method that you refer to is specific to sentence-transformers package. You would have to use embed instead. I would advise checking out the source code and see which methods are available: https://github.com/MaartenGr/BERTopic/blob/master/bertopic/backend/_openai.py