Proving that its sum is π2/6 is quite a bit harder. One can do it by defining a function f (x) = 0 if -π ≤ x ≤ 0 and x2 if 0 < x ≤ π and expanding it as a Fourier series, though that is not how Euler originally proved it!
cn and hence is convergent.
rn this is small for large m, n.
Finding its limit is rather tricky. Experimenting with Maple suggests that 3/5 is a good guess.
A standard way of dealing with recurrence relations like this one is to guess a solution of the form an = μn which in this case gives μ = 1 or -2/3 and the general solution is then of the form an= A.1n + B.(-2/3)n for some constants A and B.
Choosing A and B to give the correct answer for a1 and a2 gives the formula an = 3/5 + 9/10 × (-2/3)nand so as n→ ∞ we have (an)→ 3/5.