Probing sub-galactic mass structure with the power spectrum of surface-brightness anomalies in high-resolution observations of galaxy-galaxy strong gravitational lenses. II.Observational constraints on the sub-galactic matter power spectrum