In fact, (finite) induction does work on this problem but it's not immediate. There are already many good answers but for the sake of completeness, I will show how it can be done. The key is to use two representations of the polynomials and a little calculus trick that occurs frequently in such calculations. Let $n \in \mathbb{N}$, and for $p \in [0,n-1]$, let $\mathcal{H}(p):"\text{If } P \text{ is a polynomial such that} \deg P \leq p, \text{then} \sum_{k=0}^n \binom{n}{k} (-1)^kP(k)=0"$.
- $\mathcal{H}(0)$ is true by Newton's binomial formula.
- Let $p \in [0...n-2]$ such that $\mathcal{H}(p)$ is true. Let us show that $\mathcal{H}(p+1)$ is true. Let $P$ be a polynomial of degree $p+1$ .
We have $$P=\sum_{i=0}^{p+1}a_iX^i$$for some collection $(a_i)$ of complex numbers.Since $Q=\sum_{i=0}^{p}a_iX^i$ is a polynomial of degree at most $p$, it verifies the induction hypothesis. We then have $$\sum_{k=0}^n \binom{n}{k} (-1)^k\left[Q(k)+a_{p+1} k^{p+1}\right]=\underbrace{0}_{\text{I.H.}}+\sum_{k=0}^n \binom{n}{k}(-1)^k a_{p+1} k^{p+1}$$
It is therefore enough to show that
$$\sum_{k=0}^n \binom{n}{k}(-1)^k k^{p+1}=0$$
To this end, consider the function $f:x \mapsto (1+x)^n.$ By Newton's binomial, we have $\forall x \in \mathbb{R},f(x)=\sum_{k=0}^n \binom{n}{k}x^k$. Besides, $f$ can be differentiated over $\mathbb{R}$ and its derivatives also have (at least) two expressions each: $$\forall j \in \mathbb{N},
f^{(j)}:x\mapsto \begin{equation}
X=
\begin{cases}
0 & \text{if}\ j>n \\
\frac{n!}{(n-j)!}(1+x)^{n-j}=\sum_{k=j}^{n} \binom {n} {k} \left(\prod_{i=0}^{j}(k-i)\right)x^{k-j} & \text{otherwise}
\end{cases}
\end{equation}$$
Notice how the product on the left hand side was simplified using factorials whereas the one on the right was kept.
In particular, if we let $$A = \underbrace{\prod_{i=0}^{p}(X-i)}_{\text{Polynomial of degree p+1}} = \sum_{i=0}^{p+1} \alpha_kX^k$$ where $(\alpha_k)$ are complex numbers such that $\alpha_{p+1}=1$ then we have $$f^{(p+1)}(-1)=\sum_{k=p+1}^{n} \binom {n} {k}(-1)^{k-p-1}A(k)$$
As $p+1<n$, we have $f^{(p+1)}(-1)=0$, so $$\sum_{k=p+1}^{n} \binom {n} {k}(-1)^{k-p-1}A(k)=0$$
However, by definition of $A$, $\forall k \in [0,p] A(k)=0$ so $$\sum_{k=0}^{n} \binom {n} {k}(-1)^kA(k)=0$$ By using the induction hypothesis again, as well as linearity, we obtain $$\underbrace{\alpha_{p+1}}_{=1}\sum_{k=0}^{n} \binom {n} {k}(-1)^k k^{p+1}=0$$ as desired.
Side note: I found this elementary solution while working on homework where we had to prove results on finite recurrence relations, so in my case using them as it was done in another answer would be circular reasoning. The derivative trick seems linked to "umbral calculus" but I admittedly don't know enough on the topic to make that clear.
See also :
How to compute $\sum^n_{k=0}(-1)^k\binom{n}{k}k^n$ and
Orthogonality for Binomial Coefficients