In first-order logic with the Zermelo-Fraenkel axioms, it is convenient to introduce notations for sets that we prove exist and are unique. For example the union of two sets, ZF proves that: $$\forall a \forall b\; \exists! u \;\forall t, \; t\in u \Leftrightarrow (t \in a \lor t \in b) $$ So we note $u = a \cup b$. That means we introduce a binary operator symbol $\cup$ with an axiom derived from the theorem above. It is easy to show that any model of ZF can be extended to a model of ZF $+\cup$, by interpreting $\cup$ as a function that maps $(a,b)$ to the unique $u$ above.
However there is a glitch in the replacement axiom scheme. With the newly introduced symbol $\cup$, there are more formulas that can go into the replacement scheme, to produce more axioms. The previous reasoning didn't check that these new axioms are satisfied by the extended model.
If we drop the unicity and start with this other ZF theorem : $\forall a, \; a\neq \emptyset \Rightarrow \exists u, u \in a$, then introduce the associated symbol Choice$(a)$ with the following axiom, $$ \forall a, \; a\neq\emptyset \Rightarrow \text{Choice}(a) \in a $$ it is easy to derive the axiom of choice from that. Adding the symbol Choice and its axiom to ZF is consistent, but not conservative.
Is there a proof that ZF plus usual operations (empty set, union, intersection, powerset, pairs of sets, tuples, cartesian products, ...) is a conservative extension of ZF with only the membership symbol $\in$ ?