This article analyzes the general question of when two polynomials commute under composition, in an elementary way. Consider the following statement in the article, in which $ F $ is assumed to be an algebraically closed field of characteristic $ 0 $ (like the field of complex numbers):
Corollary 2.10. Fix an integer $ k \ge 1 $ and let $ f ( x ) $ be a polynomial in $ F [ x ] $ of degree $ n > 1 $. Then there are at most $ n - 1 $ polynomials of degree $ k $ that commute with $ f $.
In the case of the problem at hand, taking $ f ( x ) = x ^ 2 + x $, the Corollary above implies that for any $ k > 1 $, there is at most one polynomial $ P ( x ) $ of degree $ k $ such that $ P ( x ^ 2 + x ) = P ( x ) ^ 2 + P ( x ) $.
On the other hand, we have the following classic result proved by Ritt and Julia, and quoted in the mentioned article:
Theorem 1.2. Let $ P ( x ) $ and $ Q ( x ) $ be nonlinear, nonconstant polynomials with coefficients in the complex numbers that commute under composition. Then one of the following holds:
- $ P $ and $ Q $ are similar, via the same map $ \lambda $, to Chebyshev polynomials;
- $ P $ and $ Q $ are similar, via the same map $ \lambda $, to monomials;
- There exist positive integers $ m $ and $ n $ such that $ P ^ m = Q ^ n $.
Here, $ P ^ m $ and $ Q ^ n $ denote, respectively, the $ m $-th iterate of $ P $ and the $ n $-th iterate of $ Q $. Also, the notion of similarity is defined as follows: $ P $ and $ Q $ are similar via $ \lambda $ whenever $ \lambda ( x ) = a x + b \in \mathbb C [ x ] $ with $ a \ne 0 $ and $ Q = \lambda ^ { - 1 } \circ P \circ \lambda $. Note that similar polynomials must have the same degree.
Now, first note that $ f ( x ) = x ^ 2 + x $ is neither similar to the quadratic monomial $ Q ( x ) = x ^ 2 $ nor to the quadratic Chebyshev polynomial $ T _ 2 ( x ) = 2 x ^ 2 - 1 $. Also, note that if $ P ( x ) $ is such that $ P ^ m = f ^ n $ for positive integers $ m $ and $ n $, then we must have $ ( \deg P ) ^ m = ( \deg f ) ^ n $, and therefore $ \deg P $ must be a power of $ 2 $. As $ f ^ n $ is a polynomial of degree $ 2 ^ n $ that commutes with $ f $, these are the only polynomials with degree no less than $ 2 $ that commute with $ f $ under composition. Verifying that the constant zero function and the identity function are the only polynomials with degree less than two that commute with $ f $ under composition, the list becomes complete.