Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [linearly-separable]

9 questions
4
votes
4 answers

Decision boundary in a classification task

I have 1000 data points from the bivariate normal distribution $\mathcal{N}$ with mean $(0,0)$ and variance $\sigma_1^2=\sigma_2^2=10$ with the covariances being $0$. Also there are 20 more points from another bivariate normal distibution with mean…
thenac
  • 141
  • 3
4
votes
2 answers

Is a data set considered to be linearly separable if it can only be separated by multiple hyperplanes?

For example, on the linear separability Wikipedia article, the following example is given: They say "The following example would need two straight lines and thus is not linearly separable". On the other hand, in Bishop's 'Pattern Recognition and…
Data
  • 467
  • 3
  • 12
3
votes
2 answers

Kernel selections in SVM

I want to understand the kernel selection rationale in SVM. Some basic things that I understand is if data is linear, then we must go for linear kernel and if it is non-linear, then others. But the question is how to understand that the given data…
SKB
  • 574
  • 5
  • 18
1
vote
1 answer

Can this dataset be separated linearly?

Is this dataset linearly separable? If not, can it be converted into one by applying some function as it seems to follow the same pattern? Also, which classification algorithms could be used to fit this dataset?
heerboi
  • 13
  • 2
1
vote
2 answers

PCA vs.KernelPCA: which one to use for high dimensional data?

I have a dataset which contains a lot of features (>>3). For computational reasons, I would like to apply a dimensionality reduction. At this point I could use different techniques: standard PCA Kernel PCA LLE ... My problem is to choose the right…
Federico Gentile
  • 147
  • 5
1
vote
1 answer

Why does Logistic Regression perform better than machine learning models in clinical prediction studies

I am developing binary classification models to predict a medical condition in my dataset. My results show that both Logistic Regression and Linear SVM consistently outperformed other ML algorithms (SVM, NB, MLP and DT), as can be seen in the…
sums22
  • 447
  • 5
  • 15
0
votes
0 answers

Does linear classifier creates linear decision boundary in the input feature space?

I read a lot , but still not able to get the following concepts -: (1) If a classifier is given, how do we know whether its a linear or non linear classifier? (Interested in step by step procedure to make a judgement of classifier) (2) If a…
Girish Kumar Chandora
  • 131
  • 4
0
votes
0 answers

questions about logistic regression

In the following Linear Regression discussion I didn't understand a few things: So my questions are: In the third slide: What does this probability means $P\left(y_i|x_i\right)$ and accordingly what does it mean to maximize it ? Does it mean to…
Ilya.K.
  • 157
  • 7
0
votes
1 answer

Visualizing the equation for separating hyperplane

I was wondering if I can visualize with the example the fact that for all points $x$ on the separating hyperplane, the following equation holds true: $$w^T.x+w_0=0\quad\quad\quad \text{... equation (1)}$$ Here, $w$ is a weight vector and $w_0$ is a…
Rnj
  • 245
  • 2
  • 9