$\newcommand{\Z}{\mathbb{Z}}$ Proposition: Let $p$ be an odd prime and $G$ a group of order $2p$. Then either $G \cong \Z/2p\Z$ or $G \cong D_{2p}$.
Attempt:
Well $G$ can be either cyclic or non cyclic, in the case where $G$ is cyclic it follows that $G \cong \Z/2p\Z$ as a finite cyclic group. So now assume that $G$ is not cyclic. By Cauchy's theorem there exist $r,s \in G$ for which $|r| = p$ and $|s| =2$ since both orders are primes diving $2p$. Note that the cyclic subgroup generated by $r$ must also have order $p$, and so $[G:\langle r \rangle ] = 2$, but his implies that $\langle r \rangle$ is normal in $G$. Because of this we get to form the quotient group as $G/\langle r \rangle$ and since there are only two cosets and one is $\langle r \rangle $ it follows that the other is $s \langle r \rangle$. Then because $G$ is partitioned into it's cosets it follows that $$ G = \{1,r,r^2,\dots,r^{p-1},s,sr,sr^2,\dots,sr^{p-1}\}, $$ and so this is almost exactly the dihedral group.
And then here I'm stuck. Is it enough to show that $rs = sr^{-1}$ because then $G$ satisfies all of the relations required of $D_{2p}$ and hence must be isomorphic?
How do I actually go about showing this relation holds? Moreover once this is shown is this enough to conclude? Or do I need to do more work in the case where $G$ is cyclic?
Also I can't use any of the Sylow theorems to solve this problem. Thanks in advance for any hints.