By Gauss' theorem in 2D
you are supposed to calculate
$$\tag1
\int_{\partial D}F_y\,dx-F_x\,dy=
\int_{\partial D}y\,dx-x\,dy\,.
$$
When a part of the boundary of $D$ is parametrized by
$$
[a,b]\ni t\mapsto \pmatrix{x(t)\\y(t)}
$$
then the integral over that part is
$$
\int_a^b\Big\{y(t)\,\frac{dx(t)}{dt}-x(t)\,\frac{dy(t)}{dt}\Big\}\,dt=
\int_a^b\Big\{y(t)\,\dot x(t)-x(t)\,\dot y(t)\Big\}\,dt\,.
$$
This follows almost automatically from (1). If you realize that
$$
\pmatrix{\dot x\\\dot y}
$$
is the tangent vector to the boundary and
$$
\pmatrix{-\dot y\\\dot x}
$$
the normal vector it should be clear that the integral (1) calculates the flux of $F$ through the boundary.
In your case,
the boundary of $D$ consists of two parts which we parametrize as
$$
[-1,1]\ni t\mapsto\pmatrix{t\\t^2}\,,\quad [-1,1]\ni t\mapsto \pmatrix{\color{red}-t\\1}\,.
$$
The minus sign is necessary for the second part to maintain counterclockwise
orientation.
Then the integral for the first part is
$$
\int_{-1}^1\big\{t^2-2t^2\big\}\,dt=-\frac 23\,.
$$
The integral for the second part is
$$
\int_{-1}^1\big\{-1+t\cdot 0\big\}\,dt=-2\,.
$$
The sum is $-8/3\,.$
Edit: I get now what the mistakes were that you made.
You did not maintain the same orientation on the two parts of $\partial D$ because the signs of your integrals flip: They are $2$ and $-4/3\,.$
Unfortunately you do not show you got $-4/3$ but I am pretty sure that
you forgot to normalize your vector $\mathbf{n}$ to unit length. In my notation you should have done the (obviously unnecessary) calculation
$$
\int_a^b\frac{y(t)\,\dot x(t)-x(t)\,\dot y(t)}{|\dot r(t)|}|\dot r(t)|\,dt
$$
where
$$
|\dot r(t)|=\sqrt{\dot x^2(t)+\dot y^2(t)}\,.
$$
This integral is (in yet another notation)
$$
\int_C\pmatrix{x\\y}\cdot\boldsymbol{n}\,ds\,.
$$
In your case the unnormalized normal vector on that curved part
of $\partial D$ is $(-2t,t)\,.$
Why that normalization is unnecessary and when it is helpful
in some symmetric situations is explained here.