Added deleting qualification on extractor delete
Added deleting qualification on extractor delete

usc-isi-i2/dig-crowd-sourcing,usc-isi-i2/dig-crowd-sourcing,usc-isi-i2/dig-crowd-sourcing,usc-isi-i2/dig-crowd-sourcing