Questions tagged [bootstrap-sampling]

Use this tag for questions related to a statistical test or metric that relies on random sampling with replacement.

In statistics, bootstrapping is any test or metric that relies on random sampling with replacement. Bootstrapping allows one to—

  • assign measures of accuracy (e.g., bias, variance, confidence intervals, prediction error) to sample estimates,
  • estimate the sampling distribution of almost any statistic,
  • construct hypothesis tests, and
  • make statistical inferences based on the assumption of a parametric model if that assumption is in doubt, or if parametric inference is impossible or requires complicated formulas for the calculation of standard errors.

The basic idea of bootstrapping is that inference about a population from sample data (sample → population) can be modelled by resampling the sample data and performing inference about a sample from resampled data (resampled → sample). As the population is unknown, the true error in a sample statistic against its population value is unknown. In bootstrap resamples, the "population" is in fact the sample, and this is known; hence the quality of inference of the "true" sample from resampled data (resampled → sample) is measurable.

69 questions
7
votes
1 answer

Bootstrap Weak Convergence

Let $X_1, X_2, \dots, X_n$ be an iid sample from an unknown distribution finite mean $\mu$ and finite variance $\sigma^2$. Furthermore, let $R_1,R_2,\dots,R_n$. denote iid Rademacher random variables. My goal is to compute the asymptotic…
6
votes
3 answers

The measure-theoretical definition of a bootstrap sample

I’m currently learning the bootstrap method, and I have two questions to ask about the definition of a bootstrap sample. Let $ (\Omega,\mathscr{S},\mathsf{P}) $ be a probability space. Let $ X_{1},\ldots,X_{n} $ be i.i.d. random variables on $…
5
votes
3 answers

Expected number of tries to choose x unique values

it's been a long time since I've dealt with probability so I thought I would ask here. I'm sampling elements independently and uniformly and with repetition from a population. Given that the population is of size n, how many tries (in expectation)…
4
votes
0 answers

Consistency of bootstrap estimator that is continuously $\rho_\infty$-Frechet differentiable

Theorem. Suppose $T$ is continuously $\rho_r$-Frechet differentiable at $F$ with the influence function satisfying $0
4
votes
1 answer

Proof of Sampling/Importance Resampling (Weighted Bootstrap) technique

From Casella Berger exercise 5.65: Let us have $X \sim f$. Then, assume we produce $m$ i.i.d. random variables $Y_1,...,Y_m$ from another distribution $g$. Let us have $$q_i = \frac{\frac{f(Y_i)}{g(Y_i)}}{\sum_{j =…
3
votes
2 answers

Bernoulli Bootstrapping and the Beta Distribution

My understanding of the bootstrap is that it gives us a method to understand the distribution of an estimator applied to a dataset. I've read statements of the form "bootstrapping relies on the closeness of the empirical CDF for a sample of size $n$…
3
votes
1 answer

Does convergence in probability imply deterministic convergence for non-random sequences?

Suppose we know that an estimator $\hat{\theta}_n$, which is a function of a random sample $X = (X_1, \dots, X_n)$, converges in probabiltiy to some constant $\theta$, i.e., $$\forall \varepsilon > 0: \lim_{n \rightarrow \infty} P( | \hat{\theta}_n…
3
votes
2 answers

Expectations and Variance of Bootstrap Samples

The following question is from Introduction to Probability by Joe Blitzstein and Jessica Hwang: Let $X_1, \cdots , X_n$ be i.i.d. r.v.s with mean $\mu$ and variance $\sigma^2$, and $n \geq 2$. A bootstrap sample of $X_1, \cdots , X_n$ is a sample of…
3
votes
0 answers

Predicting optimal sampling to solve a PDE with neural net

Let's consider the classic heat equation and ignore the boundary and initial conditions for simplicity, $$u_t(t,x) = u_{xx}(t,x).$$ I have a neural network that attempts to solve this by inputting a random uniform distribution (which we call $p$)…
3
votes
0 answers

Variance of a bootstrap estimator

Suppose we have a sample $X_1,X_2,...,X_n \sim F$, where the distribution $F$ is unknown. Let $T_n = g(X_1,X_2,...,X_n) = \bar{X}^2$, $\mu = \mathbb{E}[X_1]$, and define the following: $$\alpha_k = \int \left | x - \mu \right | ^k dF(x) \ \ \ \ …
user545426
3
votes
1 answer

Probabilistic subsampling of an Erdős–Rényi graph

Suppose I have an Erdős–Rényi graph ${\cal G}(n,p)$, where $n$ is the total number of nodes and $p$ is the probability of an edge between any pair of nodes (edges are added independently). I subsample the graph by sampling $m$ nodes from the graph…
Abas
  • 355
  • 1
  • 11
3
votes
1 answer

SVD: How to scale singular values after rotating U and V (Matlab)

I am very new to linear algebra... I construct a rectangular matrix A1 from some sampled data which is m x n where m > n [U1, S1, V1] = svd(A1) If I then construct a new matrix A2 (also m x n, m > n) using resampling for e.g. bootstrapping of the…
3
votes
1 answer

When is the bootstrap sampling method not applicable?

I have used once the bootstrap sampling method to obtain a confidence interval for the expected daily returns that I had calculated using some data given. As far as I have understood, this method can be used even when the distribution of the random…
user168764
2
votes
1 answer

The idea/intuition behind replacing elements in bootstrapping(Statistics)

I have read several posts on this, none of them directly deals with this. I don't understand the idea/intuition behind replacing elements when one bootstraps(Statistics). As in given a data set that is a good representation of the population, how…
2
votes
1 answer

Proof that the bootstrap sample contains on average n*(1-1/n)^n unique samples.

I am aware that the average bootstrap sample (meaning sampling $n$ unique objects $n$ times with replacement) has an expected number of unique samples: $$n(1-(1-1/n)^n)$$ However I am having trouble justifying it. I agree that the probability of a…
1
2 3 4 5