Rimmer was born in 1938 in Hinckley, Leicestershire. He attended the local grammar school before matriculating at Jesus College [Cambridge?] in 1956 to read English, having been awarded a scholarship. After graduation he attended Leicester University and achieved a Diploma in Education. After a short spell teaching at Lingfield Hospital School, Rimmer moved to Red Hill School at East Sutton near Maidstone in 1961. Red Hill was a boarding school for maladjusted boys established by Otto Shaw in Chislehurst, Kent. Rimmer worked under Shaw for 15 years. On Shaw's retirement in 1976 Rimmer succeeded him as Principle, a post he held until the School closed on 31 July 1992. After the closure of Red Hill, Rimmer worked as a private tutor and an unofficial adviser to Bob Law the Head Teacher of Kent County Council's Pupil Referral Unit (1993-2003) which had taken over the Red Hill site. He also worked as a private tutor. Rimmer was Secretary to the Association of Workers with Maladjusted Children and Clerk to the Red Hill Trust. Rimmer died on 20 October 2007.