walking straight on their way

This seems to be an idiom for "thinking only of their own affairs" or "minding their own business." (See: rc://en/ta/man/translate/figs-idiom)