The more they were called, the more they went away from me

This can be stated in active form. AT: "The more I called them to be my people, the more they refused me" (See: rc://en/ta/man/translate/figs-activepassive)