Move setting the owner ref up.
Move setting the owner ref up.

We only call applyOne from 3 places where only one place needs it. This makes
the code simpler and probably a tiny bit more efficient.

Change-Id: I501c810d75c6555f7b87dfa24b7e07ece14320ae
GitOrigin-RevId: 36c0546bdb6b76286b7e000e8634460ae2e59936

googlecloudrobotics/core,googlecloudrobotics/core,googlecloudrobotics/core