My earlier question became too long, so, succinctly:
Suppose that $P(C)=0.2.$
Its complement is $0.8;$ that is, $[P(C)]^\complement=0.8.$
But what does $P(¬C)$ mean?
I think I am mixing up the terms 'complement' and 'negation'?
My earlier question became too long, so, succinctly:
Suppose that $P(C)=0.2.$
Its complement is $0.8;$ that is, $[P(C)]^\complement=0.8.$
But what does $P(¬C)$ mean?
I think I am mixing up the terms 'complement' and 'negation'?
Informally, exactly the same thing is intended. We can think of events as sets (nowadays preferred) or as assertions (we got $4$ or more heads). The complement $A^c$ of an event $A$ is the set language version of "$A$ doesn't occur." The assertion version is to say that "not $A$" occurs, or, in symbols, that $\lnot A$ occurs.
A similar thing can happen with conjunction. In probability, it is usual to think of events as sets, so we ordinarily write $A\cap B$ for "$A$ and $B$." But some people still write $A\land B$, where $\land$ is the "and" of logic.
Thus, in your example, $\Pr(C^c)=\Pr(\lnot C)=0.8$.
Let the sample space be $\{1,2,\ldots,10\},$ and $E$ be the event of obtaining at most $2.$
The event $E$ is the set $\{1,2\},$ so its complement $E^\complement$ is $\{3,4,\ldots,10\}.$
The statement $P(E)=0.2$ has the negation $P(E)\ne0.2.$
The statement $2\notin E$ has the negation $2\in E.$
The number $-7$ has the additive inverse (negation) $7.$
The number $7$ has the multiplicative inverse $\frac17.$
(We can read the statement $\lnot P$ as “not $P$”, and the set $A^\complement$ as “non-$A$”.)
$P(¬E)$
This object isn't well-defined, because sets/events don't have negations.
On the other hand, to negate a number means to flip its sign, while to negate a statement means to logically flip its truth value.
$[P(E)]^\complement=0.8.$
The statement isn't meaningful, because numbers/probabilities and statements don't have complements.
P.S. While the negation of a tautology is a contradiction, the complement of the set of tautologies contains contradictions as well as contingent sentences. So, negating a non-tautology doesn't generally give a tautology.