Remove and cleanup the promised todos (#4835)
Remove and cleanup the promised todos (#4835)

Remove some todo's that won't happen.
Fix the promises in the todo's.

/assign @dgerd @mattmoor
knative/networking,knative/networking