Yes, this is weird!
No explanation for our language as there are several things like this that are very odd.....
There must be a reason for it as it would have started somehow but who knows???
The phrase comes from a 1645 poem by Milton. It was also mentioned by Shakespeare in one of his plays, talking about dancing, this line from a poem has come into common usage in speech and writing.