In Stein&Shakarchi, Complex Analysis, chapter 6, problem 2-3 (p. 180), they hint at a method to meromorphically continue the zeta function to the entire complex plane. I can see from Abel's summation formula that
$$ \zeta(s) = \frac{s}{s-1} - \frac{1}{2} - s \int_{1}^{\infty} \frac{Q(x)}{x^{s+1}} \, dx \, , $$
where $Q(x) = \{x\} - 1/2$ (with $\{x\}$ being the fractional part of $x$). This is problem 2.
They continue to problem 3. Set $Q_k(x) = B_{k+1}(x)/(k+1)!$, for $0 \leq x \leq 1$, then periodically continue. Here the term $B_{k+1}(x)$ is the $(k+1)$-th Bernoulli polynomial. We have the properties $\frac{d}{dx}Q_{k+1} = Q_k$, and $Q_k(x+1) = Q_k(x)$ and $\int_{0}^{1} Q_k(x) \, dx = 0$. Rewrite
$$ \zeta(s) = \frac{s}{s-1} - \frac{1}{2} - s \int_{1}^{\infty} \left( \frac{d^k}{dx^k} Q_k(x) \right) x^{-s-1} \, dx \, . $$
Now they claim that $k$-fold integration by parts solves the problem for $\text{Re} \, s > -k$. However, I do not quite understand how. Can you provide a hint? This is not homework.