You ask about existence of a derivative in a single point, but in title you say continuity.
As for existence, a derivative $f'(a)$ of a real function $f(x)$ at point $x=a$ is defined as a limit
$$\lim_{h\to 0} \frac{f(a+h)-f(a)}h$$
The existence (and the value) of the limit determines a derivative at the chosen point, independent on the existence of the limit in any neighborhood of $a$. As others show, there exist functions which are differentiable at a single point only.
However if you ask for continuity, it requires the derivative to be defined (exist) in some neighbourhood of $a$, so that a limit of the derivative exists:
$$\lim_{x\to a}f'(x)$$
Then you can ask if a derivative is continuous at $a$. And there are functions (examples given in other answers) with a derivative discontinuous at some point, although existing in a neighborhood of that point.