The Riemann sphere is not just a visual aid or an intuitive heuristic, it is a bona fide mathematical object that exists in its own right. For example, the uniformization theorem states the three simply connected Riemann surfaces are the open unit disk, the complex plane and the Riemann sphere.
The definition of Riemann surfaces mimics the definition of abstract smooth surfaces but using transition maps that are holomorphic instead of merely smooth, so it is a natural thing to do. In this context, meromorphic functions to the complex plane are holomorphic functions to the Riemann sphere. Topologically, the Riemann sphere is indeed a sphere, so the term is justified. Indeed it is the one-point compactification of the complex plane.
The Riemann sphere is also the natural context in which to study Mobius transformations, also known as linear fractional transformations. Consider the complex space $\Bbb C^2$. In order to obtain the complex projective line $\Bbb P^1(\Bbb C)$ we must mod out the action of $\Bbb C^\times$. All of the elements of this projective line, written in homogeneous coordinates, look like $[z,1]$ with $z\in\Bbb C$ with the exception of the point $[1,0]$, which you can interpret as the "point at infinity" adjoined to the plane $\Bbb C$. This is one way to define the Riemann sphere. The induced action of ${\rm PGL}_2(\Bbb C)$ can be expressed by the rule $(\begin{smallmatrix}a&b\\c&d\end{smallmatrix})z:=\frac{az+b}{cz+d}$ subject to the conventions that dividing by $0$ yields $\infty$ and conversely.
In the Riemann surface setting, these Mobius transformations are precisely the automorphisms (so, conformal self-maps) of the Riemann sphere.
From the perspective of symmetry and symmetry groups, since these maps act transitively on the sphere (indeed, on its tangent bundle), it is a homogeneous space, which means the space looks "the same" from every point in the space, just as with Euclidean space where you can apply translations/shifts to move any point to any other point and apply rotations to relate any tangent vector to any other tangent vector. In this way, intrinsically speaking, no point is privileged or more special than any other point (this is not the case when considering arithmetic operations, of course), so excluding the point $\infty$ would be unnatural from this vantage point!