Data Science Stack Exchange
Data Science Stack Exchange

Most Popular

more tags
1500 questions
10
votes
2 answers

Transform an Autoencoder to a Variational Autoencoder?

I would like to compare the training by an Autoencoder and a variational autoencoder. I have already run the traing using AE. I would like to know if it's possible to transform this AE into a VAE and maintain the same outputs and inputs. Thank you.
Kahina
  • 644
  • 1
  • 9
  • 24
10
votes
6 answers

When to use mean vs median

I'm new to data science and stats, so this might seems like a beginner question. I'm working on a dataset where I've user's Twitter followers gain per day. I want to measure the average growth he had over a period of time, which I did by finding the…
Mukul Jain
  • 213
  • 1
  • 2
  • 7
10
votes
4 answers

Gas consumption outliers detection - Neural network project. Bad results

I tried to detect outliers in the energy gas consumption of some dutch buildings, building a neural network model. I have very bad results, but I can't find the reason. I am not an expert so I would like to ask you what I can improve and what I'm…
marcodena
  • 1,667
  • 4
  • 14
  • 17
10
votes
5 answers

Products classification by name

I am a beginner with machine learning, and I'm trying to build a model to classify products by category according to the words present in the product name. My goal is to predict the category of some new product, just by observing the categories for…
elias
  • 153
  • 1
  • 7
10
votes
4 answers

Loss Function for Probability Regression

I am trying to predict a probability with a neural network, but having trouble figuring out which loss function is best. Cross entropy was my first thought, but other resources always talk about it in the context of a binary classification problem…
ahbutfore
  • 201
  • 2
  • 3
10
votes
1 answer

How does dropout work during testing in neural network?

The below paragraph is picked from the textbook Hands-On Machine Learning with sci-kit learn & Tensorflow. I couldn't understand what the author is trying to convey. It would be really grateful if someone can provide an explanation for below…
James K J
  • 477
  • 1
  • 5
  • 16
10
votes
4 answers

Online machine learning tutorial

Does anyone know some good tutorials on online machine learning technics? I.e. how it can be used in real-time environments, what are key differences compared to normal machine learning methods etc. UPD: Thank you everyone for answers, by "online" I…
Igor Bobriakov
  • 1,071
  • 2
  • 9
  • 11
10
votes
1 answer

How to calculate Cumulative Sum with Groupby in Python?

I am trying to calculate cumulative sum with groupby using Pandas's DataFrame. However, I don't get expected output. My Source Code: import pandas as pd Employee = [['A', 'B', 'C', 'D', 'E', 'F', 'G', 'H'], ['CSE', 'CSE', 'EEE', 'EEE', 'CE',…
sakamoto sato
  • 103
  • 1
  • 1
  • 5
10
votes
4 answers

Which is first ? Tuning the parameters or selecting the model

I've been reading about how we split our data into 3 parts; generally, we use the validation set to help us tune the parameters and the test set to have an unbiased estimate on how well does our model perform and thus we can compare models based on…
Ahmed Gharbi
  • 103
  • 1
  • 6
10
votes
1 answer

How to find the count of consecutive same string values in a pandas dataframe?

Assume that we have the following pandas dataframe: df = pd.DataFrame({'col1':['A>G','C>T','C>T','G>T','C>T', 'A>G','A>G','A>G'],'col2':['TCT','ACA','TCA','TCA','GCT', 'ACT','CTG','ATG'],…
burcak
  • 203
  • 1
  • 2
  • 4
10
votes
5 answers

DeprecationWarning: The 'categorical_features' keyword is deprecated in version 0.20

I was watching Machine Learning A- Z from SuperDataScience but when I was doing below code sample: import numpy as np import matplotlib.pyplot as plt import pandas as pd dataset = pd.read_csv('Data.csv') X = dataset.iloc[:, :-1].values from…
Navid
  • 201
  • 1
  • 3
  • 5
10
votes
2 answers

How do i calculate prediction probability of a class in Java Weka Api?

I am developing a prediction model using Java Weka api. I can predict class for the new instance using the following code: double predictClass = classifer.classifyInstance(instance) However, I need class probability instead of class value. Thanks…
Howa Begum
  • 348
  • 1
  • 6
10
votes
3 answers

Can we remove features that have zero-correlation with the target/label?

So I draw a pairplot/heatmap from the feature correlations of a dataset and see a set of features that bears Zero-correlations both with: every other feature and also with the target/label .Reference code snippet in python is below: corr =…
karthiks
  • 352
  • 1
  • 2
  • 11
10
votes
4 answers

Log loss vs accuracy for deciding between different learning rates?

While model tuning using cross validation and grid search I was plotting the graph of different learning rate against log loss and accuracy separately. Log loss When I used log loss as score in grid search to identify the best learning rate out of…
CodeMaster GoGo
  • 808
  • 1
  • 7
  • 15
10
votes
2 answers

Mapping column values of one DataFrame to another DataFrame using a key with different header names

I have two data frames df1 and df2 which look something like this. cat1 cat2 cat3 0 10 25 12 1 11 22 14 2 12 30 15 all_cats cat_codes 0 10 A 1 11 B 2 12 C 3 25 …
Danny
  • 1,166
  • 1
  • 8
  • 16
1 2 3
…
99 100