Here "went up" is used because where God dwells is typically thought of as being up or above the world. AT: "God left him"