Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [xgboost-classifier]

7 questions
1
vote
1 answer

XGB predict_proba estimates don't match sum of leaves

When using an XGB model in the context of binary classification, I observed that the test estimates given by predict_proba were close but not equal to the results I obtained by summing the outputs of the corresponding leaves for each observation and…
Juan Felipe Salamanca Lozano
  • 11
  • 1
1
vote
3 answers

Feature importance score for a feature that contains mostly 0's in XGBoost

I have read that the feature importance scores are calculated based on how a split on that feature improves performance. I have a binary classification dataset and am running XGBoost classifier on it. There is 1 feature that has the value 0 for 1425…
Vjs
  • 13
  • 6
0
votes
1 answer

Poor performance for two classer in a multi class classification

I have a multi class classification With 5 classes(tabular data), I used xgboost model, the model score well for 3 classes but poor for the raimainig classes(2 classes), I tried up-sampling and class weights but the results is still underperformed.…
heroMhf
  • 3
  • 1
0
votes
0 answers

a few records for training, and one record after training

I try to make some credit score task. I stuck in conceputal problem. There is: train_data (62 columns, 10339239 rows, 1250000 unique ID values [0 - 1249999]([min-max] ID values)) test_data (62 columns, 4724601 rows, 500000 unique ID values [3000000…
Excentricitet
  • 1
0
votes
0 answers

Making ML Model (XGBoost) Output Smoother

I am using XGBoost for a classification problem. The model has multiple inputs and a probability as output. For simplicity's sake, let's say the model only has one continous input and the function to be learned is f(x) = x. I am creating training…
Neo
  • 11
  • 1
0
votes
1 answer

XGBoost with objective as binary:logistic returning only binary value

I am training an xgboost model for binary classification using objective as 'binary:logistic'. The model should predict probability but it is outputting either 0 or 1. I want the model to output the probability. These are the parameters I am…
shivani
  • 150
  • 10