Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Observe Issue related to Elliot's Framework #24

Open
Faisalse opened this issue Feb 7, 2023 · 0 comments
Open

Observe Issue related to Elliot's Framework #24

Faisalse opened this issue Feb 7, 2023 · 0 comments

Comments

@Faisalse
Copy link

Faisalse commented Feb 7, 2023

We are using Elliot Framework to conduct a reproducibility. However, we are facing issues with UserAutoRec, CFGAN, and LightGCN models, which produce very bad results with amazon_music, opinions and movielens_1m datasets. To handle this issue, I change the configuration file multiple times by taking random parameters and default parameters, which are given on the Elliot website for UserAutoRec, CFGAN and LightGCN models. However, I did not observe any improvement. In addition, I also analyze some articles where UserAutoRec, CFGAN, and LightGCN are picked up as baseline models to see how these models perform in other articles with amazon_music, opinions and movielens_1m datasets. Fortunately, I see their good results. I think that there is an error during the embedding of these models into the Elliot Framework,

The obtained results of UserAutoRec, CFGAN and LightGCN with amazon_music, epinions and movielens_1m datasets are given in the tables below. We also attach the used configuration files.
UserAutoRec.txt
LightGCN.txt
CFGAN.txt

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant