This problem is a dual question of "Splitting a renewal process".
Assume we have a renewal process $P_1$ with inter-renewal distribution $p_1(x)$ and rate $\lambda_1 = \lim_{t \to \infty} \frac{N_1(t)}{t}$, where $N_1(t)$ is the total number of renewals of $P_1$ during $[0,t]$. We want to find another renewal process $P_2$ with rate $\lambda_2$ such that the super position of $P_1$ and $P_2$ is a renewal process.
If $P_1$ is Poisson, $P_2$ would be simply Poisson and the superposition of them is another Poisson and everything works. But here, $P_1$ is general, not only Poisson.
Also, if $P_1$ and $P_2$ are independent and $P_2$ is renewal, the superposition $P_1+P_2$ is renewal if and only if both $P_1$ and $P_2$ are Poisson, or have special distribution (discussed here).
The question remains for the general case. To solve that, I am thinking of considering building the superposition by as a renewal process with inter-renewal distribution $p_t(x)$ where $\frac{1}{\mathbb{E}[p_t(x)]}=\lambda_1+\lambda_2$. Now, we have $P_1(t)$ and $P_1(t)+P_2(t)$, I don't know how to find $P_2(t)$. Maybe we could take advantage of the fact that pdf of sum of two random variables is the convolution of their pdf. Any idea? or simpler method?