You should note that the rotations (around the origin) form a group:
- if you do two rotations in a row, you obtain a rotation
- also the identity (not moving anything) can be viewed as a rotation of angle 0°
But the reflections (over an axis passing through the origin) do not form a group:
- if you do two reflections in a row, you obtain a rotation, not a reflection
- the identity can not be seen as a reflection over an axis
If you combine the rotations and reflexions, you do get a group. It is called the orthogonal group $\mathrm{O}(2)$, the group of linear tranformations preserving distances (note that all linear tranformations must preserve the origin).
The group of rotations is a subgroup of the orthogonal group called the special orthogonal group $\mathrm{SO}(2)$, the group of linear transformations preserving distances and orientation. It is actually "half" the group, as the orientation has two possible states, preserved or flipped.
(FYI, the orientation of an orthogonal transformation is linked to the determinant. Also, the "$2$" stands for $2$ dimensions).
As the other answers said, if you consider only the rotation by 0° or 180° and the reflexions over the X-axis or the Y-axis, you have a subgroup of $\mathrm{O}(2)$ of order $4$ (size $4$) and this subgroup corresponds to the Klein 4-group.
For me, the interesting fact that you are looking for is the role of $\mathrm{SO}(2)$ in $\mathrm{O}(2)$, being a subgroup of index $2$ ("half" the group) and more concretely the surprising fact that the combination of $2$ reflections always gives a rotation.