Let us start by making this claim (a picture always helps!).
Claim: for all $\alpha \in [0,1]$ and $x\in\mathbb{R}$,
$$\displaystyle\sup\{x: \mathbb{P}(L<x)\le 1-\alpha\} = \displaystyle\sup\{x: \mathbb{P}(L\le x)\le 1-\alpha\}\,.$$
Proof: The CDF being monotone has at most countably many discontinuities, which means that the set of continuity points is dense in $\mathbb{R}$. The CDF being non-decreasing immediately gives that $$\displaystyle\sup\{x: \mathbb{P}(L<x)\le 1-\alpha\} \ge \displaystyle\sup\{x: \mathbb{P}(L\le x)\le 1-\alpha\}\,.$$ To show the inequality cannot be strict, argue by contradiction and show that if it were so, then there would be $y$ in between where $y$ is a continuity point of the CDF such that the following holds $$1-\alpha < \mathbb{P}(L\le y) = \mathbb{P}(L<y)\le 1-\alpha\,,$$ a contradiction.
Now, I claim (note that the limit exists by monotonicity of the CDF)
Claim: $\displaystyle\sup\{x: \mathbb{P}(L\le x) \le 1-\alpha\} = \displaystyle \lim_{\epsilon \to 0^+} \inf\{x: \mathbb{P}(L\le x) \ge 1-\alpha + \epsilon\}$.
Proof: to see this, the monotonicity of the CDF immediately gives the inequality $$\displaystyle\sup\{x: \mathbb{P}(L\le x) \le 1-\alpha\} \le \displaystyle \lim_{\epsilon \to 0^+} \inf\{x: \mathbb{P}(L\le x) \ge 1-\alpha + \epsilon\}\,.$$ Now, suppose for a contradiction that it is strict, that is, there exists some $y\in \mathbb{R}$ such that \begin{align}\displaystyle\sup\{x: \mathbb{P}(L\le x) \le 1-\alpha\} &< y < \displaystyle \lim_{\epsilon \to 0^+} \inf\{x: \mathbb{P}(L\le x) \ge 1-\alpha + \epsilon\}\\
& = \displaystyle \inf_{\epsilon \to 0^+} \inf\{x: \mathbb{P}(L\le x) \ge 1-\alpha + \epsilon\}\,.
\end{align} where the las equality follows from the fact that $\alpha \mapsto V_\alpha (L)$ is non-decreasing. Then, it follows that $1-\alpha < \mathbb{P}(L\le y) \le 1- \alpha$, a contradiction.
Combining the above now gives the desired equality.