If you already alias ssh to the wrapper, you can also alias scp so file transfers use the same host matching and (when enabled) Keychain-backed credential flow.