Cartesian coordinates constitute the forest that hides the trees, i.e. the intrinsic notion of a tangent vector. In $E={\Bbb R}^n$ or more generally in any normed (and complete) vector space the intuitive notion you have of a tangent vector works fine. It is probably something as follows: Let $c: ]-\epsilon,\epsilon[ \rightarrow E$ be a smooth curve. Then the tangent vector to the curve at $p=c(0)$ is given by:
$$ v = c'(0)= \lim_{h\rightarrow 0} \frac{1}{h} \left( c(h) - c(0) \right) $$
So in a vector space a tangent vector may simply be viewed as an element of the vector space itself. You may compose with functions, take derivatives etc. as in your example. No need for adapting a different point of view.
The statement you are asking about, may, however, be viewed as a preparation towards working with manifolds.
Now, if $E$ were a manifold (whatever that is, I omit the details) then the situation is different. Although it is ok to talk of a smooth curve as before,
the difference $c(h)-c(0)$ does not make sense in a general manifold, so how would you describe this $v$ that doesn't exist?
Well, it does make sense to look at a smooth function of the manifold into a vector space, say $A: E \rightarrow {\Bbb R}$. Then the composed function $A\circ c: ]-\epsilon,\epsilon[\rightarrow {\Bbb R}$ is a map between reals and this we know how to differentiate. So the wanted tangent vector "$v=c'(0)$" at $p=c(0)$ may be given an interpretation as a differential operator on $A$ acting as follows:
$$ L_v A = \frac{d}{dt}_{|t=0} A(c(t)) = (A\circ c)'(0) $$
Now, a coordinate system is a suitable collection of $n$ smooth maps $x_1,...,x_n: E \rightarrow {\Bbb R}$ so, in particular, we may act upon them to define a collection of real numbers:
$$ v_k = L_v x_k = (x_k \circ c)'(0), \; k=1,...,n $$
Also, when we have a coordinate system, we may express the function $A$ as some smooth function of the coordinates: $A(\xi) = a(x_1(\xi),...,x_n(\xi))$, $\xi\in E$. But then we are able to calculate another expression for the above derivative:
$$ L_v A = \frac{d}{dt}_{|t=0} a (x_1 \circ c(t)),...,x_n\circ c(t)) = v_1\frac{\partial}{\partial x_1} a (p) + \cdots + v_n \frac{\partial}{\partial x_n} a(p)$$
So in the given coordinate system we may express the above 'action' as:
$$ L_v = v_1 \left( \frac{\partial}{\partial x_1}\right)_{|p} + \cdots + v_n \left( \frac{\partial}{\partial x_n}\right )_{|p}$$
Our tangent vector has then coordinates $v_1$,...,$v_n$ ($n$ real numbers) in the basis consisting of partial derivatives $\partial_{x_1}$,...,$\partial_{x_n}$ (evaluated at the point $p$).
This point of view also allows you to describe how tangent vectors transform under change of coordinates and all this leads to the understanding of manifolds and how to do calculus on a manifold.