I have so far managed to prove that such a group is cyclic
Cyclic groups are uniquely determined by their order. Every cyclic group is isomorphic either to $\mathbb{Z}$ or to $\mathbb{Z}_n$ for some $n$. This is quite trivial. If $G$ is a cyclic group generated by $g\in G$ then we have a group homomorphism
$$f:\mathbb{Z}\to G$$
$$f(n)=g^n$$
It is onto (because $g$ generates $G$) and thus by the first isomorphism theorem $G\simeq\mathbb{Z}/\ker(f)$. If $g$ is not of finite order then $\ker(f)=0$ and thus $G\simeq\mathbb{Z}$. Otherwise $|g|=n$ and $\ker(f)=n\mathbb{Z}$ and thus $G\simeq\mathbb{Z}_n$.
More generally by the fundamental theorem of finite abelian group, if $G$ is a finite abelian group of order $n=p_1^{\alpha_1}\cdots p_n^{\alpha_n}$ ($p_i$ prime) then
$$G\simeq A_{1}\oplus\cdots\oplus A_{n}$$
where each $A_i$ is a finite abelian group of order $p_i^{\alpha_i}$. Furthermore if $A$ is a finite abelian group of order $p^k$ then
$$A\simeq\mathbb{Z}_{p^{\beta_1}}\oplus\cdots\oplus\mathbb{Z}_{p^{\beta_m}}$$
where
$$\beta_1+\cdots +\beta_m=k$$
So all in all every finite abelian group is a product of of cyclic groups of order $p^k$ for some primes $p$. Note that
$$\mathbb{Z}_{p^a}\oplus\mathbb{Z}_{p^b}\simeq\mathbb{Z}_{p^{a+b}}$$
if and only if either $a=0$ or $b=0$.
In particular if $p, q$ are distinct primes and $G$ is abelian of order $|G|=pq$ then
$$G\simeq\mathbb{Z}_{pq}\simeq\mathbb{Z}_{p}\oplus\mathbb{Z}_{q}$$