their rock: In this sarcastic comparison, Moses contrasts the pagan gods with the Lord, the God of Israel. The word rock refers to a place of safety and strength.
The false gods of the nations were not truly strong or able to save. In comparison, the Lord alone is powerful and faithful. The pagan gods fall far short of him.