The $p$th cohomotopy set of a pointed space $X$, $\pi^p(X)$, is the set of maps from $X$ to $S^p$ mod pointed homotopy. Unlike homotopy, there need be no natural group structure on $\pi^p(X)$ unless ($X$ is particularly nice or) $p\in\{0,1,3,7\}$: if $p$ is one of these values then we can use the group structure on $S^p$ to "add maps pointwise" (EDIT: it's not a group at $p=7$, since octonion multiplication isn't associative, but it's still algebraically nontrivial) but otherwise no such group structure exists.
At this point it's natural to ask whether we can still find some algebraic structure on $\pi^p(X)$ if $p\not\in\{0,1,3,7\}$ (and $X$ is not particularly nice). Unfortunately, Adams' theorem can be strengthened: Walter Taylor showed that in a precise sense there is no nontrivial ("demanding") algebraic structure on $S^p$ at all for $p\not\in\{0,1,3,7\}$.
My question is whether this is lethal:
Is there some $p\not\in \{0,1,3,7\}$ such that there exists some natural algebraic structure on $\pi^p(X)$ for arbitrary $X$ (or at least for $X$ substantially more general than suspensions)?
By "algebraic structure" I really intend to cast a wide net, hence the universal algebra tag. One possible precisiation of the question would be the following: letting $\tau$ be the "obvious" topology on $\pi^p(X)$, is there in the sense of Taylor's paper a nontrivial algebraic structure on $\pi^p(X)$ compatible with $\tau$? However, I'm also open to other reasonable interpretations.