Questions tagged [finite-precision]
5 questions
8
votes
2 answers
Why is finite precision a problem in machine learning?
Can you explain what is finite precision? Why is finite precision a problem in machine learning?
GeorgeOfTheRF
- 2,078
- 5
- 18
- 20
8
votes
1 answer
FP16, FP32 - what is it all about? or is it just Bitsize for Float-Values (Python)
What is it all about FP16, FP32 in Python? My potential Business Partner and I are building a Deep Learning Setup for working with time series. He came up with "FP16 and FP32" while finding a GPU. It looks like he's talking about Floating Point…
Ishmael89
- 91
- 1
- 1
- 3
3
votes
0 answers
Keras custom metrics - MAP and MRR
I am trying to build a LSTM model in keras where I have one question with 10 answers but only ONE among them is correct. So basically im tring to build a 10 class classification problem. As most of the research papers are using Mean average…
Rohith
- 31
- 1
1
vote
1 answer
Truncating float/doubles for reproducibility
I deploy machine learning models (typically GPU) to a variety of environments. I work sort of at the edge of ML R&D and devops, so I am really big into reproducibility, and one thing that drives me nuts is when models output similar but not…
DeusXMachina
- 263
- 1
- 2
- 6
0
votes
1 answer
Low Precision of LeakyReLU
Dear TensorFlow experts,
I am trying to understand the following output of the TensorFlow LeakyReLU function, which seems to have very low precision:
import tensorflow as tf
tf.keras.backend.set_floatx('float64')
import numpy as…
Anna Christine
- 101