If you on a fresh install go ahead and set rating on some albums without actually playing them, you will see that those album do not show up in the "Høyest Ranger" list at all.
On my system I tagged 20-30 albums, but only two albums did show up in the list, those two I had played some tracks from earlier. And when I played a track from one of the other rated albums, it too showed up in the list.
I believe that it should not be a requirement to have played a album for it to be shown in the "Høyest Rangert" list.