This refers only to men and does not include how many women or children believed.
"grew to about five thousand"