What I have in mind is something like the following: the natural numbers with addition form a monoid. You can imagine constructing the integers by taking the naturals, adding a set constructed by "reflecting" all of the non-zero natural numbers about $0$, and extending addition. What I mean by "reflecting" is that for each $i\in N$ the reflected element $-i$ is such that $i+j=k\iff -i+-j=-k$, and that $i+-i=0$.
My intuition is that this should be generally possible for monoids that don't have any inverses.