tl;dr you can modify a function any way you want at any finite number of points without affecting its Riemann integral in the slightest. Since your function $I$ is a constant zero function, modified at one point, it has the same Riemann integral as the constant zero function.
However, in hideous detail…
The definition of the Riemann integral $$\int_a^b f(x)\; dx$$ is as follows: we consider a partition $\Pi$ of the interval $[a, b]$ into subintervals $a = x_0 < x_1 < \cdots < x_n = b$, and then calculate the upper sum $$M(\Pi,f) = \sum_{i=0}^{n-1} (x_{i+1}-x_i)\sup_{x_i\le x\le x_{i+1}} f(x)$$ and the lower sum
$$m(\Pi, f) = \sum_{i=0}^{n-1} (x_{i+1}-x_i)\inf_{x_i\le x\le x_{i+1}} f(x)$$
for each such partition.
The "upper integral" is defined to be the infimum (greatest lower bound) of these upper sums:
$$ \overline{\int_a^b} f(x)\; dx = \inf M(\Pi, f)$$ and the "lower integral" similarly is the supremum (least upper bound) of the lower sums: $$\underline{\int_a^b} f(x)\;dx = \sup m(\Pi, f),$$
If the upper and lower integrals are equal, we define the Riemann integral to be equal to their common value: $$ \int_a^b f(x)\; dx = \overline{\int_a^b} f(x)\;dx = \underline{\int_a^b} f(x)\;dx.$$ This is all straight from Rudin Principles of Mathematical Analysis pages 120–121.
Now let's consider your function $I$ which is zero everywhere except at $x=k$. Evidently the parts of $\Pi$ that don't contain $k$ will contribute zero to the sums $m(\Pi, I)$ and $M(\Pi, I)$ since $\sup I = \inf I = 0$ on these intervals. So we need only worry about the one interval in each partition, say $[x_p, x_{p+1}]$, that contains $k$.
Even on this one special interval, $\inf I$ is still zero, so $m(\Pi, I) = 0$ for every partition $\Pi$ and therefore the "lower integral" $$\underline{\int_a^b} I(x)\;dx = 0.$$ So if the Riemann integral exists for your function $I$, it must be zero.
Fortunately, the "upper integral" is also zero, because the part of $\Pi$ in which $k$ lies can have $x_{p+1} - x_p$ arbitrarily small, say $\epsilon$, and therefore $$\begin{align}
M(\Pi,I) & = \sum_{i=0}^{n-1} (x_{i+1}-x_i)\sup_{x_i\le x\le x_{i+1}} I(x)\\
& = (x_{p+1} - x_p)\sup_{x_p\le x\le x_{p+1}} I(x)\\
& = (x_{p+1} - x_p)I(k)\\
& = \epsilon \cdot 1 \\
& = \epsilon
\end{align}$$
and by choosing $\Pi$ suitably we can make $\epsilon$ as close as we like to zero, and therefore the "upper integral" $$\overline{\int_a^b} I(x)\;dx = \inf M(\Pi, I) $$ is zero.
So the upper and lower integrals are both zero, and therefore (by definition) so is the Riemann integral.