Let $X$ be a convex subset of $\mathbb{R}^n$, and let $p$ be a probability density function on $X$ (i.e. $\int_X p(x) dx = 1$), let $\phi:X\to \mathbb{R}\cup\{+\infty\}$ be a convex function with codomain in the extended reals. (This could be phrased more generally in terms of measure spaces, but for my purposes it suffices to consider the presented case where $X$ is just a subset of a finite-dimensional Euclidean space.) In that case do we have Jensen's inequality,
$$\phi\left(\int_X x \, p(x) dx\right) \leq \int_X \phi(x) p(x) dx,$$
even if $\phi$ is not lower semicontinuous?
There's quite a number of previous questions discussing related issues, but nothing that really seems to resolve this specific question. For instance the discussions in the following only consider the case where the domain of $\phi$ is in the real line rather than a general Euclidean space (relying on techniques that hold when the domain is an interval, but I'm not sure how to generalize them to Euclidean spaces):
Counterexample to Jensen's inequality?
While the proofs here rely on the existence of a supporting hyperplane, which does not seem guaranteed if $\phi$ is not lsc (there is some discussion of this point in the answers in the second link but no resolution for the case where $\phi$ has values in the extended reals and hence may not be lsc):
Jensen's inequality in measure theory
Jensen's inequality for integral without l.s.c. assumption
A simpler proof of Jensen's inequality (This one is not precisely assuming a supporting hyperplane, but the claim that a convex function is everyhere equal to the supremum of its affine minorants requires some kind of closure condition in the general case.)