I have difficulty understanding the solution below and have already summarized my difficulties as follows,
- why "the area of the polygon $abcelef$ .... represents the number of ways the three points can be taken, so that the circle circumscribing the triangle will lie wholly within the given polygon." It looks like the ratio of the two areas is the probability that a circle with a given radius lying wholly in the polygon.
- "An element of the polygon at $G$ is $4 x d x d \psi$", what does the "element" mean? a differential form? and why is it $4 x d x d \psi$;
- why is an element of the polygon at $R$ $dt$?
- why is $dt$ only a differential form of $d\theta$? why not include $dx$ too?
- why do we introduce an imaginary angle $\phi$?
Problem:
A circle is circumscribed about a triangle formed by joining three points taken at random in the surface of a circumscriptible polygon of $n$ sides, find the chance that the circle lies wholly within the polygon.
Solution:
Let $ABCDEF\ldots$ be the polygon, $PGR$ the triangle formed by joining the three random points $P$, $G$ and $R$, $O$ the center of the entirely circumscribing $PGR$ (which I think is a typo, should be $M$ rather than $O$). Draw the polygon $abcef$..., making its sides parallel to those of the given polygon, and at a distance from them equal to $MP$, and draw $ONS$ and $MH$ perpendicular to $AB$ and $PG$. Check the figure below
Now while $PG$ is given in length and direction, and $\angle PRG$ is given, if $MP$ is less than the radius of the inscribed circle of the given polygon, the area of the polygon $abcelef\ldots$ represents the number of ways the three points can be taken, so that the circle circumscribing the triangle will lie wholly within the given polygon.
Let $PG =2x$, $OS =r$, perimeter of $ABCDEF\ldots$ $=s$, area of segment $PRG$ $=t$, area of sector $PMG$ $=v$, area of triangle $PMG$ $=u$, area of polygon $ABCDEF\ldots$ $= \Delta$, $\angle PMH = \theta$, $\phi=\sin ^{-1}(\frac{x}{r})$, and $\psi=$ the angle which $PG$ makes with some fixed line.
Then we have $PM = x \csc \theta$, $ON = r - x \csc \theta$, area $abcdef \ldots$ $=(r - x \csc \theta)^{2} \frac{\Delta}{r^{2}}$, $v = \theta x^{2} \csc^{2} \theta$, $u = x^{2} \cot \theta$, $t=v-u$, and $dt = dv - du = 2 x^{2} \csc^{2} \theta(1 - \theta \cot \theta) d \theta$.
An element of the polygon at $G$ is $4 x d x d \psi$, or $4 r^{2} \sin \phi \cos \phi d \phi d \psi$, and at $R$ it is $dt$. The limits of $x$ are $0$ and $r$; of $\phi$, $0$ and $\frac{1}{2} \pi$; of $\theta, \phi$ and $\pi - \phi$; and of $\psi$, $0$ and $2 \pi$.
Hence, doubling, since $R$ may lie on either side of $PG$, wo have for the required chance,
\begin{align*} p &=\frac{2}{\Delta^3} \int_0^r 4 x d x \int_{\theta=\phi}^{\theta=\pi-\phi} d t \int_0^{2 \pi} d \psi(r-x \csc \theta)^2 \frac{\Delta}{r^2}\\ &=\frac{16 \pi}{r^{2}\Delta^2} \int_0^r x d x \int_{\theta=\phi}^{\theta=\pi-\phi} d t(r-x \csc \theta)^2\\ &= \frac{32 \pi}{r^2 \Delta^2} \int_0^r x^3 d x \int_\phi^{\pi-\phi}(r - x \csc\theta)^{2}(1 - \theta \cot \theta) \csc^2 \theta d\theta\\ &= \frac{2 \pi r^{4}}{3 \Delta^2} \int_0^{\frac{1}{2}\pi} [2(\pi-2 \phi) \sin 2 \phi+4-4 \cos 4 \phi-3 \sin ^2 2 \phi \cos 2 \phi+64 \sin^{4} \phi \cos \phi \log \tan \frac{1}{2} \phi] d \phi\\ &= \frac{2 \pi^2 r^{4}}{5 \Delta^2}\\ &=\frac{8 \pi^2 r^2}{5 s^2} \\ \end{align*}
Remarks
If $ABCDEF \ldots$ is a circle, $s = 2\pi r$, so $p = 2/5$, and the problem is from the book "Inside Interesting Integrals" written by Prof. Paul J, Nahin, which is stated as follows,
Imagine a circle (let’s call it $C_{1}$) that has radius $a$. We then chose at random (i.e., uniformly distributed) and independently, three points from the interior of that circle. These three points, if non-collinear, uniquely determine another circle, $C_{2}$. $C_{2}$ may or may not be totally contained within $C_{1}$. What is the probability that $C_{2}$ lies totally inside $C_{1}$? See the answer

