Here "that day" refers to the day the ark of the covenant was moved from the house of Obed Edom to Jerusalem.
"song of giving thanks"