Questions tagged [movielens]

7 questions
3
votes
1 answer

memory error in matrix cosine_similarity

I have (20905040, 7) of a dataset to recommend 10 different product to the user it could be larger than that but anyway I got memory error when processing the cosine_sim =…
2
votes
1 answer

What is the correct way to compute hit rate in recommender systems?

I'm working with the famous Movielens 1M dataset and implemented some simple recommender algorithms. While computing the hit rate, I found that it's very low $(\approx 0.008)$ but the papers seem to report high scores $(\approx 0.5)$. Hence, I think…
1
vote
0 answers

Dot product of two matrices in NLP how can i get this error be solved

from sklearn.metrics.pairwise import linear_kernel sim_matrix = linear_kernel(tfidf_matrix, tfidf_matrix) when I try to get dot product I am getting this errro MemoryError Traceback (most recent call…
1
vote
1 answer

Dealing with missing data in SVD

I am a newbie to machine learning and I am trying to apply the SVD on the movielens dataset for movie recommendation. I have a movie-user matrix where the row is the user id, the column is the movie id and the value is the rating. Now, I would like…
David
  • 11
  • 1
1
vote
0 answers

What is the current state of the art solution for Movielens 100k / 20M?

I found Basic recommendation system for Movilens dataset using Keras which has a solution which works ok (MAE 0.84). What is the current state of the art for this dataset?
Martin Thoma
  • 19,540
  • 36
  • 98
  • 170
0
votes
1 answer

How to estimate missing values when calculating NDCG

I would like to compare recommendations methods using NDCG metric on MovieLens dataset. In ranking problem, the goal is to rank items based on their relevance for user. Ranking models can be learned based on ratings matrix, where each user rates…
0
votes
1 answer

precision and recall at k for movielens dataset

I wanted to recreate a very simple collaborative filtering example with the 1M movielens dataset I have from Kaggle (https://www.kaggle.com/datasets/odedgolden/movielens-1m-dataset) and then calculate the mean average precision and recall at M.…