Ooooh, I didn't realize that, since I only use ratings for new music then delete those ratings once I add them to my library officially.
I think I see what my issue was. I was putting my new music album folders directly in the Listen folder so the folder structure was treating those album folders as artists. It looks like if I nest those album folders under another folder name it should work. Here's the link the imgur album I created before I figured it out
http://imgur.com/a/BNQcR.
Thanks for all your great work on this app btw.