I wanted to answer my own question in addition to the other answers given, to make extra clear what is going on here (this will be useful for me as I reference this in the future, and hopefully it will be useful for others, too).
As others have said, our definition of a real-valued function $f: X \rightarrow \mathbb{R}$ being measurable is that $\{x \mid f(x) > \alpha \} \in \Sigma$, where $\Sigma$ is a $\sigma$-algebra of subsets of $X$ $((X, \Sigma)$ is a measure space).
But this definition seems so different from the definition that if $(X, \Sigma_{1})$ and $(Y, \Sigma_{2})$ are measure spaces and we have a function $f: X \to Y$, then $f$ is measurable if $E \in \Sigma_{2} \implies f^{-1}(E) \in \Sigma_{1}$.
What is going on here is that we automatically assume we are dealing with the Borel $\sigma$-algebra in the codomain when we talk about real-valued functions. Specifically, our function is going from $X$ to $\mathbb{R}$ with measure space $(X, \Sigma)$ as the domain, and $(\mathbb{R}, \mathcal{B}(\mathbb{R}))$ as the codomain.
But if this is what we are assuming about the codomain, then by the second definition of measurability, shouldn't we be checking that $E \in \mathcal{B}(\mathbb{R}) \implies f^{-1}(E) \in \Sigma$? Yes, that is the condition that needs to be satisfied for a real-valued function to be measurable. So why are we only checking that $\{x \mid f(x) > \alpha \} \in \Sigma$?
Here is the reason: First, when we assume the codomain has the Borel $\sigma$-algebra, we need to check that the preimage of a Borel measurable set is measurable. (i.e., if $f: X \to Y$ is a function and $\Sigma$ is the $\sigma$-algebra on $X$, we need to check that $E \in \mathcal{B}(Y) \implies f^{-1}(E) \in \Sigma$). But actually, it suffices to show that only the preimage of open sets is measurable, because the set $\{ E \mid E \subseteq Y \, \& \, f^{-1}(E) \in \Sigma \}$ is a $\sigma$-algebra, and so if it contains the open sets, then it must contain the smallest $\sigma$-algebra containing the open sets, which is $\mathcal{B}(Y)$. So that would imply $\mathcal{B}(Y) \subseteq \{ E \mid E \subseteq Y \, \& \, f^{-1}(E) \in \Sigma \}$, and thus the preimage of all Borel measurable sets are measurable (and if the domain is specifically equipped with Borel $\sigma$-algebra, then the preimage of all Borel measurable sets are Borel measurable). So, it suffices to just check that the preimage of an open set is measurable to show that a function is measurable with respect to an arbitrary $\Sigma$ on the domain $X$.
But, we can take it a step further. We really only need to check that the preimages of the intervals $(\alpha, \infty)$ are measurable for all $\alpha \in \mathbb{R}$. This is because we have the following equivalence:
$O \subseteq \mathbb{R}$ is open and $f^{-1}(O) \in \Sigma$ $\iff$ $f^{-1}((\alpha, \infty)) \in \Sigma$ for all $\alpha \in \mathbb{R}$.
To prove this equivalence is easy. For the $\implies$ direction, suppose every open subset of $\mathbb{R}$ has a measurable preimage. Then since for any $\alpha \in \mathbb{R}$, $(\alpha, \infty)$ is an open subset of $\mathbb{R}$, by assumption $f^{-1}((\alpha, \infty)) \in \Sigma$, as desired.
For the $\impliedby$ direction, suppose for every $\alpha \in \mathbb{R}$, $\{ x \mid f(x) > \alpha \} = f^{-1}( (\alpha, \infty) ) \in \Sigma$. This directly implies that for any interval $I \subseteq \mathbb{R}$, $f^{-1}(I) \in \Sigma$. But every open subset of $\mathbb{R}$ can be written as a countable, disjoint union of open intervals. So we have if $O \subseteq \mathbb{R}$ is open, then since we can write $O = \bigcup \limits_{n = 1}^{\infty} I_{n}$, and $f^{-1}(O) = f^{-1}(\bigcup \limits_{n = 1}^{\infty} I_{n}) = \bigcup \limits_{n = 1}^{\infty} f^{-1}(I_{n})$, and because $f^{-1}(I_{n}) \in \Sigma$ (since $I_{n}$ is an interval), then $f^{-1}(O) \in \Sigma$, as desired.
So at the end of the day, to check that a real-valued function is measurable, by definition we must check that the preimage of a Borel measurable set is measurable. But this boils down, as shown above, to proving that $\{x \mid f(x) > \alpha \} = f^{-1}( (\alpha, \infty)) \in \Sigma$ for all $\alpha \in \mathbb{R}$, since this implies that the preimage of Borel measurable sets are measurable.
Note that to check if a real-valued function is Borel measurable, it also suffices to check that $f^{-1}((\alpha, \infty)) \in \mathcal{B}(X)$ for all $\alpha \in \mathbb{R}$, since this implies that the preimage of an open set is Borel measurable, which implies that the preimage of a Borel measurable set is Borel measurable.