aws-samples / aws-samples/amazon-personalize-samples

coldstart demo

Open
#48 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
602
Forks
338
PR merge metrics
No merged PRs in 30d

Description

I reran the coldstart demo and found that the hrnn-coldstart precision@5 has gone up to 0.092 from 0.040. The baseline has also gone up to 0.0076 from 0.0044. I can understand that there is a shuffle on the item-ids, which causes the baseline changes. But I was wondering if it would cause this amount of variance in the trained model, too.

Related, the demo notebook created fake_user. I wonder if that is actually necessary.

Attaching a script with the new results:
[personalize_coldstart_demo.ipynb.zip](https://github.com/aws-samples/amazon-personalize-samples/files/3677123/personalize_coldstart_demo.ipynb.zip)
Thanks.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.