James Blunt, Queen, Elton John, The Rolling Stones…. some of these are songs performed with Muppets as well as by Muppets. But there are definitely songs and there are definitely Muppets.
Click through for the list.
I owned a Muppets 7” single, it contained one of these tracks.