In some languages it might be more natural to say, "Jacob went to Isaac."
He thought that the person he was touching and smelling was Esau.