Addendum-2 added to demonstrate the pure Calculus approach that more closely aligns with the original poster's (i.e. the OP's) approach.
Your approach assumes that under the assumption that A arrives first, each 5 minute interval of time where A arrives is equally likely. This is false.
For example, while the normal probability of A arriving in the 55-60 interval is $(1/12)$, the probability of A arriving in the 55-60 interval is not $(1/12)$ under the assumption that A arrives before B.
Therefore, the problem is best attacked without making an assumption of who arrives first, as follows:
$\underline{\text{Case 1: A arrives in the interval of} ~~5 - 55}$
The chance of this occurring is $(50/60) = (5/6)$.
When it does occur, the chance of a meeting is $(10/60) = (1/6).$
Therefore, the computation that covers Case 1 is
$T_1 = (5/6) \times (1/6) = (5/36).$
$\underline{\text{Case 2: A does not arrive in the interval of} ~~5 - 55}$
As discussed in Case 1, the chance of Case 2 occurring is $(1/6)$.
When Case 2 occurs, you can assume, on average that A's arrival time is exactly 2.5 minutes from one of the boundaries.
That is, you can assume that A arrives either 2.5 minutes after the start of the hour, or 2.5 minutes before the end of the hour.
Under this assumption, B has an intersection interval of 7.5 minutes rather than 10 minutes.
Therefore, the computation that covers Case 2 is
$T_2 = (1/6) \times (7.5/60) = (1/6) \times (1/8) = (1/48).$
Final answer:
$$T_1 + T_2 = (5/36) + (1/48) = (23/144).$$
Addendum
Actually, in Case 2, I pulled an accurate but (arguably) invalid fast one.
That is, I assumed that Without Loss of Generality, in Case 2, A arrived exactly 2.5 minutes from one of the boundaries. I knew that this shortcut would result in the right answer, because I knew that the computation is linear. In fact, the rigorous approach for Case 2, would be to set up a Calculus problem. To me, in this instance, that is (arguably) overkill.
Consider the related problem:
What is the area under the curve $f(x)$ for the region $0 \leq x \leq 1$, where $f(x)$ equals $x$.
Technically, you are supposed to compute $\int_0^1 xdx.$
However, since the area function is linear to height, and since the average height of the function is $(1/2)$, I know from experience that the area of the region is $(1/2) \times (1-0).$
I took the same sort of (invalid) shortcut in Case 2.
Addendum-2
I was curious about the pure Calculus approach.
Never having formally studied probability, I had to guess about how to use a probability density function. My guesswork is below.
Without Loss of Generality, label the first person to arrive as $A$, and the 2nd person to arrive as $B$. This means that it is assumed that $A$ arrives on or before $B$. Then the probability of a duel will be expressed as
$$\frac{N\text{(umerator)}}{D\text{(enominator)}}$$
where $N$ will represent the integral, as $x$ goes from $0$ to $60$ of $p(x) \times f(x)$ and $D$ will represent the integral as $x$ goes from $0$ to $60$ of $p(x)$.
This means that $N$ will represent integrating, at each point $x$, the product of the relative chance of $A$ arriving at time $x$, times the chance of a duel, given that $A$ arrived at time $x$.
$D$ will represent the integral at each point $x$ of the relative chance of $A$ arriving at time $x$. Thus, $D$ will be used to normalize the relative probabilities.
Note further, that one of the two people had to be the first to arrive, and that this first arrival is arbitrarily given the label of $A$. This indicates that once the computations are completed, it is inappropriate to then multiply the computations by $(2)$, as the OP did.
For the first person to arrive at time $x$, this means that the 2nd person had to arrive at any time in the interval $(60 - x).$
Thus, it is reasonable to let the relative probability
$~\displaystyle p(x) = \frac{60 - x}{60}$.
This implies that
$\displaystyle D = \int_0^{60} \frac{60 - x}{60} dx ~=~ \frac{60x - (x^2/2)}{60} ~{\Large{|_{0}^{60}}} = 30.$
Specifying the conditional probability of $f(x)$ is tricky, since it assumes that the 2nd person has arrived in the interval between $x$ and $60$. Therefore:
For $0 \leq x \leq 55, f(x) = \frac{5}{60 - x}.$
For $55 \leq x \leq 60, f(x) = 1.$
Therefore $N$ equals
$$\int_0^{55} p(x)f(x)dx + \int_{55}^{60} p(x)f(x)dx$$
$$= \int_0^{55} \frac{60 - x}{60} \times \frac{5}{60 - x} ~dx + \int_{55}^{60} \frac{60 - x}{60} ~dx$$
$$= \frac{x}{12} ~{\Large{|_{0}^{55}}}
+ \frac{60x - (x^2/2)}{60} ~{\Large{|_{55}^{60}}} $$
$$= \frac{55}{12} + \frac{3600 - 1800}{60} - \frac{3300 - 1512.5}{60}$$
$$= \frac{(55 \times 10) + (1800 \times 2) - (3575)}{2 \times 60} = \frac{575}{120}.$$
Therefore
$$\frac{N}{D} = \frac{575}{120 \times 30} = \frac{23}{144}.$$