Great question. Great answers. Here's mine:
Assume that $g:[a,b]\to\mathbb{R}$ is not bounded and that $\alpha:[a,b]\to\mathbb{R}$ is strictly increasing.
If we use the alternative definition of an integral, which I personally prefer, (that which uses upper and lower generalized Darboux sums, and which is presented as the definition of the integral in baby Rudin), then it will suffice to show that
$$
\exists\hspace{0.4mm} \varepsilon > 0 \ni \hspace{1mm}\forall P\in\mathcal{P}, \hspace{1mm}
U(P,g,\alpha) \geq L(P,g,\alpha) + \varepsilon
$$
where $\mathcal{P}$ denotes the set of all partitions of a given closed interval ${[a,b]}$.
More to the point, we will prove the stronger statement that this holds for any $\varepsilon>0$.
Fix an arbitrary $\varepsilon>0$ and an arbitrary partition $P := \{x_0,\ldots,x_n\}$ of ${[a,b]}$.
Since $g$ is not bounded on ${[a,b]},$ we have that that $g$ is not bounded on $[x_{\ell-1},x_\ell]$
for some $\ell\in\{1,\ldots,n\}$. Consider this $\ell$.
Since $\alpha$ is strictly increasing, $\alpha(x_\ell) - \alpha(x_{\ell-1}) := \Delta\alpha_\ell >0$.
Then, since $g$ is not bounded on $[x_{\ell-1},x_\ell]$, it is reasonably clear that
\begin{align*}
\sup_{x\in[x_{\ell-1},x_\ell]} g(x)
\hspace{4mm}\geq\hspace{4mm}
\frac{\varepsilon}{\Delta\alpha_\ell}
\hspace{2mm}+
\inf_{x\in[x_{\ell-1},x_\ell]} g(x).
\end{align*}
This can be made less terse, but we skip the formality. Therefore,
\begin{align*}
U(P,g,\alpha) - L(P,g,\alpha)
\hspace{1mm}&:=\hspace{1mm}
\sum_i \underbrace{
\Bigg(\sup_{x\in[x_{i-1},x_i]} g(x) \hspace{2mm} - \inf_{x\in[x_{i-1},x_i]} g(x) \bigg)
\Delta\alpha_i
}_{\hspace{1mm}\geq\hspace{1mm} 0}
\\
\hspace{1mm}&\geq\hspace{1mm}
\underbrace{
\Bigg(\sup_{x\in[x_{\ell-1},x_\ell]} g(x) \hspace{2mm} - \inf_{x\in[x_{\ell-1},x_\ell]} g(x) \bigg)
}_{
\hspace{1mm}\geq\hspace{1mm} \varepsilon/(\Delta\alpha_\ell)
}
\Delta\alpha_\ell
\hspace{1mm}\geq\hspace{1mm}
\varepsilon.
\end{align*}