Ezra is pointing out that they have continued to disobey God in this issue of marrying foreign women.
AT: "sins" or "going our own way"