Solution:
Let f be a solution to the FE. By plugging y=f(x)x, we obtain
x+f(x+1)=xf(x+f(x)x)+x⟺f(x+1)=xf(x+f(x)x)
Plug in x=1 in (1) to get
f(2)=f(1+f(1)1)
Note that if f is injective, one can easily finish as f(1)=1 by the previous equality. By plugging in x=1 in the original equation, we get
1=yf(y)⟺f(y)=y1,∀y∈R>0
which is indeed a solution to the equation:
x+f(xy+1)=x+yx+yf(xy)⟺x+x+yx=x+yx+x,∀x,y∈R>0
Now, it remains to prove that f is injective: Assume that there exist u,v∈R>0, with u>v such that f(u)=f(v). Rewriting the initial equation, we get:
x⋅(1−f(x+y))=yf(yf(x))−f(yf(x)+1).
Substituting x=u and x=v in the latter equation, we get that
u⋅(f(u+y)−1)=v⋅(f(v+y)−1),∀y∈R>0
and by replacing y→y−v and introducing C=u−v>0, we get
u⋅(f(C+y)−1)=v⋅(f(y)−1),∀y>v
Let y0 be a fixed constant such that v<y0≤v+C and let's analyse the sequence (f(y0+nC))n∈N. If f(y0)=1, we get that the sequence (f(y0+nC))n∈N is constant and every term is equal to 1.
Now, if f(y0)=1, by (5), observe that
vu=f(y0+(n+1)C)−1f(y0+nC)−1∀n∈N
Therefore, by induction or telescopic product, we get
f(y0+nC)−1=(uv)n⋅(f(y0)−1)
Hence, by making n→∞ and using v<u, we get that the sequence (f(y0+nC))n∈N converges to 1. From these two cases, we conclude that the sequence (f(y0+nC))n∈N converges to 1 for any v<y0. Now, let an=y0+nC and let's make the substitution y=f(x)an. We get
x+f(an+1)=xf(x+f(x)an)+f(x)an⋅f(an)
and let's fix x=c. Then, when
n→+∞,c+f(an+1)→c+1
because the sequence
(f((y0+1)+nC))n∈N=(f(an+1))n∈N
converges to 1 . However, we have
cf(c+f(c)an)+f(c)an⋅f(an)→+∞
because
f(c)an⋅f(an)→+∞ and cf(c+f(c)an)>0
Thus, we get a contradiction by (7).