In solving this question, I found that s quicker proof is possible with below net characterization of l.s.c. functions. Could you have a check on my attempt?
Let $X$ be a topological space and $f:X \to \mathbb R \cup \{-\infty, +\infty\}$. For $x \in X$, let $\mathcal N(x)$ be the set of all open neighborhoods of $x$. Then the following statements are equivalent.
(a) For all $x \in X$, $$ f(x) \le \liminf _{y \to x} f (y) := \sup _{V \in \mathcal N (x)} \inf _{y \in V \setminus \{x\}} f(y). $$
(b) For all $x \in X$, if $\alpha \in \mathbb R$ and $(x_d)_{d\in D}$ is a net such that $x_d \to x$ and $f(x_d) \to \alpha$, then $f(x) \le \alpha$.
I posted my proof separately as an answer below, so I can accept my own answer and thus remove my question from unanswered list. If other people post answers, I will happily accept theirs.
Update: I have found that lower semi-continuity can also be characterized by
(c) For all $x \in X$, if $(x_d)_{d\in D}$ is a net such that $x_d \to x$, then $$ f(x) \le \liminf_d f(x_d) := \sup_{d\in D} \inf_{e\ge d} f(x_e). $$
The discussion of limsup and liminf of nets can be found here and here.