New install - Why Postgresql and why so long to install?

Artist radio, genre radio & related artists. A Subsonic server for music nerds.

Moderator: moderators

New install - Why Postgresql and why so long to install?

Postby igbar » Sat Nov 17, 2012 2:12 am

I am new to Subsonic (today) and now to MusicCabinet (right now). The install is proceeding but i do have a couple of questions. Please these are just questions .. no critic etc. Being a sw developer for 30 years I do tend to ask questions .. so ..

1) why use PostgreSql? I have read a lot about it .. and it has been all good. Buy my question is why not use mySql? It does appear to have the majority of the market .. oh .. and I already have it installed for other products/project. Just wondering.

2) Installed all the bits and clicked off the process to import and then read this
Please note that the initial import of data from last.fm will take a while, roughly 30 minutes per 10.000 tracks. You can follow the progress meanwhile, but MusicCabinet features won't work until it's finished.

Is it really not available until this process completes? I have 160K songs over some 26K albums and 10K artists. If it can only process 10K tracks at a time at 30/10K it will take many hours to get this all done. I realize that dealing with an external org (last.fm) does put some restraints on what can be done .. but couldn't the system be used with just the last.fm bits missing until complete. At least 98% of all my tracks have fully defined metadata.

Once again this is not a critic .. i am just wondering.

Thanks a lot for what appears to be a great hack.

Igbar
igbar
 
Posts: 19
Joined: Fri Nov 16, 2012 6:06 pm

Re: New install - Why Postgresql and why so long to install?

Postby igbar » Sat Nov 17, 2012 5:34 am

Also, when it stops doing the update/meta read, how do you get it to continue with the ones it didn't do? I think i missed that somewhere.

Thanks
Igbar
igbar
 
Posts: 19
Joined: Fri Nov 16, 2012 6:06 pm

Re: New install - Why Postgresql and why so long to install?

Postby hakko » Sat Nov 17, 2012 7:21 am

igbar wrote:1) why use PostgreSql? I have read a lot about it .. and it has been all good. Buy my question is why not use mySql? It does appear to have the majority of the market .. oh .. and I already have it installed for other products/project. Just wondering.


At the time when I was about to choose database, MySql had just been purchased by Oracle and I heard that test code that they were adding wasn't open source anymore. The future of MySql seemed a bit uncertain. I like how PostgreSQL is based in a strong user community, how they have always put reliability first (early MySql seemed to put speed over reliability to get attraction), and how powerful it is. How do you make indexed like searches in MySql, for example?

igbar wrote:2) Installed all the bits and clicked off the process to import and then read this
Please note that the initial import of data from last.fm will take a while, roughly 30 minutes per 10.000 tracks. You can follow the progress meanwhile, but MusicCabinet features won't work until it's finished.
Is it really not available until this process completes? I have 160K songs over some 26K albums and 10K artists. If it can only process 10K tracks at a time at 30/10K it will take many hours to get this all done. I realize that dealing with an external org (last.fm) does put some restraints on what can be done .. but couldn't the system be used with just the last.fm bits missing until complete. At least 98% of all my tracks have fully defined metadata.


You can start streaming music from your directory structure the moment it's installed. It'll take a couple of hours to get metadata for all your music (artist biographies, genre categorization, top tracks etc), because last.fm has Terms of Service stating that we can "only" do 5 calls per second to fetch info and we're fetching a lot. So meanwhile, the system will work in a limited mode, without the joy of having access to last.fm metadata. Don't forget that last.fm is a free service, you're not paying a dime for this. I think that's pretty fair.
MusicCabinet developer
hakko
 
Posts: 1416
Joined: Tue Apr 17, 2012 7:05 pm
Location: Sweden

Re: New install - Why Postgresql and why so long to install?

Postby hakko » Sat Nov 17, 2012 7:23 am

igbar wrote:Also, when it stops doing the update/meta read, how do you get it to continue with the ones it didn't do? I think i missed that somewhere.

Thanks
Igbar


viewtopic.php?f=11&t=10457
MusicCabinet developer
hakko
 
Posts: 1416
Joined: Tue Apr 17, 2012 7:05 pm
Location: Sweden

Re: New install - Why Postgresql and why so long to install?

Postby igbar » Sat Nov 17, 2012 2:04 pm

hakko wrote:
igbar wrote:1) why use PostgreSql? I have read a lot about it .. and it has been all good. Buy my question is why not use mySql? It does appear to have the majority of the market .. oh .. and I already have it installed for other products/project. Just wondering.


At the time when I was about to choose database, MySql had just been purchased by Oracle and I heard that test code that they were adding wasn't open source anymore. The future of MySql seemed a bit uncertain. I like how PostgreSQL is based in a strong user community, how they have always put reliability first (early MySql seemed to put speed over reliability to get attraction), and how powerful it is. How do you make indexed like searches in MySql, for example?

I was wondering if the Oracle bit was part of it. They really didn't handle the take over well at all. I am very glad they have let up a lot on their posturing.

But it will be interesting to see just how Postgresql works.

igbar wrote:2) Installed all the bits and clicked off the process to import and then read this
Please note that the initial import of data from last.fm will take a while, roughly 30 minutes per 10.000 tracks. You can follow the progress meanwhile, but MusicCabinet features won't work until it's finished.
Is it really not available until this process completes? I have 160K songs over some 26K albums and 10K artists. If it can only process 10K tracks at a time at 30/10K it will take many hours to get this all done. I realize that dealing with an external org (last.fm) does put some restraints on what can be done .. but couldn't the system be used with just the last.fm bits missing until complete. At least 98% of all my tracks have fully defined metadata.


hakko wrote:You can start streaming music from your directory structure the moment it's installed. It'll take a couple of hours to get metadata for all your music (artist biographies, genre categorization, top tracks etc), because last.fm has Terms of Service stating that we can "only" do 5 calls per second to fetch info and we're fetching a lot. So meanwhile, the system will work in a limited mode, without the joy of having access to last.fm metadata. Don't forget that last.fm is a free service, you're not paying a dime for this. I think that's pretty fair.

Oh I am happy that last.fm is a free service and understand their need to throttle it. I just misread what the quote was saying. Didn't want to try to use the service while it was working in case it was serious and messed something up. With shelves full cds and albums I have plenty of to listen to ... even if it means i have to go back to the dark ages :P

Thanks again for the responses. It is very nice to be able to ask questions and not get blasted.

Have a great weekend
Igbar
igbar
 
Posts: 19
Joined: Fri Nov 16, 2012 6:06 pm

Re: New install - Why Postgresql and why so long to install?

Postby igbar » Sat Nov 17, 2012 2:10 pm

hakko wrote:
igbar wrote:Also, when it stops doing the update/meta read, how do you get it to continue with the ones it didn't do? I think i missed that somewhere.

Thanks
Igbar


viewtopic.php?f=11&t=10457

Humm so just File/Scan Full? Cool .. doing it now.

Thanks for that
Igbar
igbar
 
Posts: 19
Joined: Fri Nov 16, 2012 6:06 pm


Return to MusicCabinet

Who is online

Users browsing this forum: No registered users and 23 guests