So I'm working through Ben Polack's "Game Theory" course (free from Open Yale Courses, by the way, and highly recommended). He has an identical problem in problem set 2, number 4.
(Disclaimer: I only have a BS in pure math, so I could be missing something here but I'll take a crack at this.)
As I understand Nash Equilibrium (NE), it's when each player's response is a best response to every other player's response. More formally, for a strategy profile $(s_1^*, s_2^*,...,s_N^*)$, it is a NE if and only if for each player $i \in \{ 1, 2 , ... , N \}$ her choice $s_i^*$ is a best response to $s_{-i}^*$. (Sidenote about notation: Polack uses $s_{-i}^*$ to denotes all strategies besides the strategy of player $i$. I'm not sure how common this notation is, so I thought I'd point it out.)
Since we're only dealing with two players, we only need player 1's strategies that are best responses to player 2's best responses.
Unfortunately, I have a slight nit-pick on the OP's 4(a) answer, so I'll address that first.
4(a): It is true that the line $s_1 + s_2 = 10$ can give NE's. But I think it's more precise to say that they're strategy profiles of the form $(s_1, 10-s_1)$ or equivalently $(10-s_2, s_2)$ for $s_1,s_2 \in [0,10)$. It's also true that if $s_2 = 10$ then $BR_1(s_2)=x$ where $x \in [0,10]$. By symmetry, if $s_1 = 10$ the $BR_2(s_1)=y$ where $y \in [0,10]$. So, like the OP said, there's another NE for the strategy profile $(10, 10)$.
4(b): joriki makes some really good points on this in the continuous case, so read his answer, too. I'll address this in the discrete case (specifically if we're dealing with cents). It's not specified in the problem set if fractional cents are allowed, but I'll go with the assumption that there are not fractional cents.
There are two cases to think about:
(1) $s_1 + s_2 \leq 10$
(2) $s_1 + s_2 > 10$
Like joriki argues, any choices by player 1 where $s_1 < 5$ are strictly dominated by $s_1'=5$. Why? Because in case (1), the payoff of player 1 is $u_1(5,s_2) = \$5$ since both players receive a payoff of whatever number they choose. In case (2), $s_2 > 5$ so player one gets a payoff of the lower number. Thus, it's still true that $u_1(5,s_2)= \$5$.
But what about $s_1 > 5$ in the discrete case using cents? Well, this is were things become a bit different. You end up with NE's for the strategy profiles $(5,5)$, $(5,5.01)$, and $(5.01,5)$, and $(5.01,5.01)$.
It might be easier see this if we start with a case where there isn't a best response from both players, so let's consider when player 2 chooses $s_2=5.02$. So what's player 1's best response? To slightly undercut player 2's choice by a penny (that devious devil). So $BR_1(5.02)=5.01$ which yields $u_1(5.01,5.02)= \$5.01$ and $u_2(5.01,5.02)=\$4.99$.
So what would be player 2's best response to $s_1=5.01$? A couple options, actually.
Player 2 could pick $s_2=5.01$ and they'd both get a payoff of $u_1=\$5$ and $u_2=\$5$ since they both get a payoff of \$5 when $s_1+s_2>10$ and $s_1=s_2$.
Another choice player 2 could make is $s_2=5.00$ (which would still maximize $u_2$ against $s_1=5.01$). Why? Because $u_2=\$5$ since it's the smaller number and the player who chooses the smaller value gets that amount of money as their payoff.
Hence, player 2 has two best responses for $s_1=5.01$. The argument is the same for player one, so we have NE's $(5,5.01)$, $(5.01,5)$, and $(5.01,5.01)$.
Lastly, similar to joriki's argument, if $s_1=5$ then the way for player 2 to maximize their utility function (that is, their best response) is to pick 5 or higher. The argument is symmetric for player 1, and the only overlapping best responses are when $s_1=5$ and $s_2=5$, therefore the strategy profile $(5,5)$ is also a NE.
Hope that's helpful!