Q1. I assume by $A \otimes_R B$ you mean the $R$-algebra which has as underlying $R$-module the tensor product of the underlying $R$-modules, and whose algebra is structure is given by $1 := 1 \otimes 1$ and $(a \otimes b) (a' \otimes b'):=aa' \otimes bb'$. This $R$-algebra has the following universal property: Homomorphisms $A \otimes_R B \to C$ correspond 1:1 to pairs of homomorphisms $f : A \to C$ and $g : B \to C$ which commute in the following sense: For $a \in A$ and $b \in B$ we have $f(a) g(b)=g(b) f(a)$. Therefore, it might be called the "commutative coproduct". It follows immediately that
$R\langle X,F \rangle \otimes_R R\langle Y,G \rangle = R \langle X \cup Y : F \cup G \cup \{xy-xy : x \in X, y \in Y\}\rangle$
Q2. Do you mean the coproduct in the category of $R$-algebras? In that case, we have $R \langle X,F \rangle \oplus R \langle Y,G \rangle = R\langle X \cup Y ,F \cup G \rangle$. Or do you mean the direct product (which is, unfortunately, often denoted by $\oplus$, see also here)? In that case, we have $R \langle X,F \rangle \times R \langle Y,G \rangle = R \langle X,Y,e : e^2=e, Fe, Ge^{\perp}, x=ex=xe, y=e^{\perp} y=e^{\perp} y\rangle$. By $Fe$ I mean that every occurence of $1$ in a relation has to be replaced by $e$. The reason is the following (co)universal property of the direct product of two $R$-algebras: A homomorphism $A \times B \to C$ corresponds to an idempotent $e \in C$ (the image of $(1,0)$) and two homomorphisms of algebras $A \to Ce$ and $B \to Ce^{\perp}$. Here, $e^{\perp}:=1-e$.