Questions tagged [noisification]

4 questions
5
votes
1 answer

Real time noise removal using Savitzky-Golay Method

I would like to ask if Savitzky-Golay can be implemented on real-time data. I have used it on a fixed array size, but would like to extend it to output values for real-time sensor data. Can anyone refer me to appropriate implementation or hint…
2
votes
0 answers

Noisification of categorical data proportions for privacy-preservation

Imagine I'm conducting an ongoing poll asking people's favourite animal out of a list of animals, [cat, dog, penguin, chimpanzee, ...] etc. I want to provide an interface that lets people query this poll data to see the relative popularity of each…
R Hill
  • 1,115
  • 11
  • 20
2
votes
0 answers

How to remove spurious data points recorded in a measurement? How to improve the result obtained using a Savitzky-Golay filter?

The following two figures show raw data and filtered data recorded in a measurement. I have used SciPy's Savizky-Golay filter with window_length = 6 and polyorder of 3 to obtain the second plot. One can see, that the filtration has distorted the…
1
vote
0 answers

Data augmentation for recommendation systems

I have a user-item matrix that I use to train a denoising autoencoder to predict the top-k items to recommend to the different users. The idea is to corrupt the matrix by erasing a percentage p of the items that each users bought and train the…