Solution:
11=(ab−2cd)2+2(ac+bd)2=(a2+2d2)(b2+2c2), so we must have either (1) a2+2d2=1, b2+2c2=11, or (2) a2+2d2=11, b2+2c2=1.
(1) gives a=±1, d=0, b=±3, c=±1. If a=1 and d=0, then ac+bd=1 implies c=1, and ab−2cd=3 implies b=3. Similarly, if a=−1, then c=−1, and b=−3.
Similarly, (2) gives (a,b,c,d)=(3,1,0,1),(−3,−1,0,−1).
(a,b,c,d)=(1,3,1,0),(−1,−3,−1,0),(3,1,0,1),(−3,−1,0,−1)