candidate: Warden Samuel Norton ( Bob Gunton ) meets with Andy and reassigns him to the prison library to assist elderly inmate Brooks Hatlen ( James Whitmore ) , a pretext for Andy to manage financial duties for the prison .