Matthew does not make clear who answered Jesus. If you need to specify an audience you can translate as "The people said to Jesus."