We have
x2+x−yx3−xy+1⇒x−y=y2+x−yy3+xy−1⇒x−x2+x−yx2−1=y+y2+x−yy2−1=x2+x−yx2−1+y2+x−yy2−1.(∗)
Now we have three cases:
Case 1.
x=y⇒2xx2−1=0⇒x2=1 or x=0⇒(x,y)=(0,0),(1,1),(−1,−1)
Case 2. x>y. Let k=x−y>0 so by (*) we have k=x2+kx2−1+y2+ky2−1. If ∣x∣≤1 or ∣y∣≤1 by using main equation we get (x,y)=(−1,0),(1,2),(0,1),(−2,−1). Now we can assume ∣x∣,∣y∣>1
x2−1<x2+k⇒0<x2+kx2−1<1 and similarly 0<y2+ky2−1<1, therefore
0<k=x2+kx2−1+y2+ky2−1<2⇒k=1⇒1=x2+1x2−1+y2+1y2−1.(∗∗)
Case 3. x<y. Let t=y−x>0 so by (*) we have t=t−x2x2−1+t−y2y2−1 and by adding 2=t−x2t−x2+t−y2t−y2 to both sides we get t+2=t−x2t−1+t−y2t−1.
We claim that t−x2 and t−y2 are not positive, simultaneously. Assume by
contrary t−x2>0,t−y2>0 then
t>x2,t>y2⇒2(y−x)=2t>x2+y2⇒(x+1)2+(y−1)2<2.
This contradicts because ∣x∣,∣y∣>1. Therefore at least one of fractions t−x2t−1 and t−y2t−1 is less than or equal to 0 and the other less than or equal to t−1. So
t+2=t−x2t−1+t−y2t−1≤0+(t−1)<t.
This contradiction shows that case 3 does not have a new solution and these are all the solutions: (0,0),(1,1),(−1,−1),(−1,0),(1,2),(0,1),(−2,−1). □