The greatest K is 16.
We first prove the inequality when K=16. Note that
u2−4vw=u2+2vw−6vw≥u2+2vw−3(v2+w2)=u2+(v+w)2−4(v2+w2)≥2u(v+w)−4(v2+w2)=2(uw−2v2)+(uv−2w2).
If uw−2v2 and uv−2w2 have different signs (possibly equal to 0), we have
(u2−4vw)2≥0≥K(2v2−uw)(2w2−uv).
The equality case will be handled below.
If both uw−2v2 and uv−2w2 are negative, then (uw)(uv)<(2v2)(2w2), which yields the contradiction u2<4vw.
Therefore, we may assume both uw−2v2 and uv−2w2 are positive. Therefore, we obtain
(u2−4vw)2≥4((uw−2v2)+(uv−2w2))2≥16(uw−2v2)(uv−2w2).
For the equality to hold, we must have v=w and u=v+w. This implies
u2=(2v)2=4v2=4vw,
contradicting u2>4vw. Therefore, equality cannot hold, and the inequality is proven.
Next, we show K=16 is the largest possible. Consider v=w=1 and u=2+ε for a sufficiently small positive ε. The relation u2>4vw holds. Also, we have
(u2−4vw)2=(4+4ε+ε2−4)2=ε2(4+ε)2
and
K(2v2−uw)(2w2−uv)=K(2−2−ε)2=Kε2.
The inequality holds if and only if (4+ε)2>K. When ε approaches 0, the left-hand side approaches 16. Therefore, K≤16. This completes the proof.