This phrase indicates a time in the afternoon, before dark, that would be too late for them to travel to another town.