A CW complex $X$ is the union of open cells $\{e^i_\alpha\}$ and these open cells are disjoint subsets of $X$, so these open cells form a partition of $X$.
Now if we take the closed cells $\{\bar e^i_\alpha\}$, then if the number of cells is finite we can also write $X$ as a union of closed cells $$X=\bigcup_{i,\alpha}\bar e^i_\alpha$$ where the $\bar e^i_\alpha$ are not necessarily disjoint sets. In sum, the open cells form a partition of $X$ whereas the closed cells form a covering of $X$.
When the number of cells is infinite we don't have a covering of $X$ by closed cells, we only have that the union of closed cells is contained in $X$.
Is this correct?