This Week in Science, still my favourite science podcast, has released a compilation CD of science themed music! Some of the tracks (”Lost in Space”, “Robots are Great”, and “First Assumptions Were Correct”) are downloadable from their site, and for $5 you can order a hard copy of the mix CD.
update – Marshall of TWIS left the following in a comment:
“these are all songs performed by our listeners and donated for our use. Most of the bands are from N.California and are all unsigned acts, so if you liked something on the CD make sure to let the band know.”
There is also a long list of science themed songs in the comments of this post on Pharyngula.
And don’t forget my old, old post that I link to so often I should probably put it somewhere on the sidebar: Musical Scientists. Not so many suggestions for songs per se, but it name drops a bunch of musicians/scientists. (Although after I wrote it I heard that the singer for…. one of the well-known recent “punk”/rock bands also has one or more science degrees. I forgot which band, but I remember being surprised.)