Bannerman played three Tests in total — both 1877 Melbourne Tests and the 1879 Test at Melbourne. After the 1878 tour of England (where he failed to score a century in 28 first-class innings) his batting form collapsed. He continued to play for NSW until 1888 but never again approached his 1877 form. The official explanation for his retreat from Test cricket was ill-health; less officially, contemporary accounts pointed to gambling debts and heavy drinking. From the late 1880s he made his living as a coach in Melbourne, Sydney and at Lancaster Park in New Zealand. From 1887 to 1902 he stood as umpire in 12 Tests in Australia. By his retirement he was indigent. The Australian Cricket Board paid him a small pension in his last years. He died at Surry Hills, Sydney, on 20 August 1930, aged 79. His brother Alec — 'Little Alec' — outlived him by six years and remains one of the longest-serving Australian batsmen.