Solution:
If a≥2, then the roots x1 and x2 of the equation x2−ax+1=0 are positive and x1x2=1. In particular, Sn>0 for n=1,2,…
a) We have
SnSn−1≥Sn+1Sn⟺(x1n−1+x2n−1)(x1n+1+x2n+1)≥(x1n+x2n)2⟺x1n−1x2n+1+x2n−1x1n+1≥2x1nx2n⟺(x1x2)n−1(x1−x2)2≥0
which obviously holds.
b) Let a≥2 have the desired property. Then a) implies that
nS2S1≥S2S1+⋯+Sn+1Sn>n−1
i.e., S2S1>1−n1. Since limn→∞n1=0, the last inequality gives S2S1≥1. Using Vieta's formulas we get S1=a, S2=a2−2 and therefore a2−2a≥1⟺a2−2(a+1)(a−2)≤0. Since a≥2 we get a=2.
Conversely, if a=2, then x1=x2=1 and Sn=2 for any n=1,2,… Hence
S2S1+S3S2+⋯+Sn+1Sn=n>n−1