you will pull out some of the wheat as well

It would be too difficult to distinguish young wheat from the weeds, and to pull the weeds without uprooting the wheat.

barn

This refers to the building where the harvested wheat grain was saved and stored.