The fact that $(\mathbb{Z},0,+)$ is not atomic follows from the quantifier elimination for abelian groups.
The complete theory of $\mathbb{Z}$ admits quantifier elimination in the language of abelian groups, expanded by symbols $(P_n)_{n\geq 2}$, where $P_n$ picks out the multiples of $n$ in $\mathbb{Z}$. Note that this is a definitional expansion, since $P_n(x)$ can be defined by $\exists y\, \underbrace{y+\dots+y}_{n\text{ times}} = x$.
It follows that the complete type of $1$, for example, is axiomatized by the formulas $\{\lnot P_n(x)\mid n\geq 2\}$. Since no finite subset of these are sufficient to entail the others, $\mathrm{tp}(1/\varnothing)$ is not isolated.
For more details, see the answers to this question, where an explicit model $M\models\mathrm{Th}(\mathbb{Z})$ is constructed which omits $\mathrm{tp}(1/\varnothing)$ (and hence there is no elementary embedding $\mathbb{Z}\to M$, so $\mathbb{Z}$ is not a prime model for its complete theory). The model is the subgroup of $\widehat{Z}$ (the profinite completion of $\mathbb{Z}$) consisting of those elements which are divisible by all but finitely many primes.