Let $X$ be a compact metric space and $C(X)=\{ f:X\rightarrow \mathbb{R} \ | \ \ f \ continuous\}$ with the uniform norm. It is a separable Banach space.
1) I'm aware of the fact that $C(X)^*$, the space of continuous linear functionals $C(X)\rightarrow \mathbb{R}$ coincide with $M(X)$, the space of signed regular borel measures on $X$.
This intuitively makes sense because $\mu\in M(X)$ can be naturally be seen as an evaluation map $f\mapsto \mathbb{R}$ by means of integration.
2) I'm also aware that $(C(X)^*)^*$, the dual of the dual, coincide with the set of bounded Borel measurable functions $F:X\rightarrow\mathbb{R}$ (source: P. Lax, Functional Analysis).
UPDATE Landscape provided a counterexample in the comments. My source was: P. Lax "Functional Analysis" 2002, Page 82, Theorem 14(ii). I guess this might be a mistake, perhaps fixed in some errata somewhere.
New question: C.f. Landscape's example, let $g_A$ be the extension (given by Hahn-Banach) of $f_A$ to $C([0,1])^{**}$. Looking at $g_A$ as a function $X\rightarrow\mathbb{R}$, $g_A$ must satisfy by construction the equation $\int_{[0,1]}g_A \ d \ \delta_x= 1$ if $x\in A$ and $0$ otherwise. This seems to imply that $g_A$ is the characteristic function of $A$. Hence not Borel if $A$ is not Borel.
Thus, $g_A$ as a function $(X\rightarrow\mathbb{R})$ is uniquely determined by the construction starting from $f_A$. But is it $g_A$ as an element of $C([0,1])^{**}$ uniquely determined? If so, it looks to me we would have a reasonably well defined notion of integration for non-measurable sets.
Thanks!
Screen shot of Lax's theorem 14 on page 82:

It this is wrong it means that some elements in $C(X)^{**}$ by the process of taking countable limits of continuous functions. Borel measurable functions forms the smallest set arising from the continuous functions by closing under limits of sequences.
– OldFella May 15 '13 at 15:41