Let me try to explain what is going on with a simpler example. Consider geometric series
$$F(s)=\sum_{n=0}^{\infty}s^n,$$
which converges inside the unit circle $|s|<1$ to the function $F(s)=\frac{1}{1-s}$. Note, however, that $F(s)$ can be analytically continued to the whole complex plane with excluded point $s=1$, which is a simple pole of $F(s)$. This point was in fact the origin of radius of convergence equal to $1$. So we are tempted to write identities like
$$ F(2)=1+2+4+8+\ldots=\frac{1}{1-2}=-1.$$
It is important to understand that they do not "really" hold. The logic is the following: the initial series defines some function in a "small" domain, but then sometimes this function can be (uniquely!) continued to a larger domain where the original series no longer makes sense. In general, this continuation will have singularities.
Sometimes - actually, almost always - one cannot construct a continuation to the whole complex plane with isolated singular points because of specific singularities called natural boundaries. An example of this is encountered if we consider instead of $F(s)$ the series
$$G(s)=\sum_{n=0}^{\infty}s^{n^2},$$
which converges inside the unit circle even better than $F(s)$ but cannot be continued elsewhere: $|s|=1$ is a dense set of singularities for $G(s)$.
Now let us go back to initial question. If we consider the series
$$\zeta(s)=\sum_{n=1}^{\infty}n^{-s},$$
it converges to some function $\zeta(s)$ in the halfplane $\mathrm{Re}\,s>1$. It turns out that this function can be (again, uniquely!) continued to the whole complex plane except the point $s=1$ where it has simple pole, similarly to our previous example. This continued function, as well as its derivatives, can be evaluated for any $s\neq1$ (for example, at $s=-1$ and $0$). One of the ways to do it is to systematically use integral representation
$$\Gamma(s)\zeta(s)=\int_0^{\infty}\frac{x^{s-1}dx}{e^x-1},$$
which for $\mathrm{Re}\,s>1$ reproduces the original series definition.