5.0 beta1 wont do full scan

[Jailon]

all was ok on SS4.9 but upgraded to beta 5.0 beta1 and the full scan is crashing out. Seems to crash out around 22k on each scan (full DB is about 50k). If this relates to a corrupt file then I can delete it, but which one? have rebooted, stopped and started SS, removed media folders and reapplied them, cleaned up database etc.#

Any idea's? Thanks

License Subsonic Premium
Version 5.0.beta1 (build 4046) – 24 May 2014
Server jetty-6.1.x, java 1.7.0_10, Windows 8 (83.2 MB / 144.6 MB)
Java Limit 1000mb
Hardware w8.1 64bit. AMD II X250 3Ghz. 6GB Ram

Logs show:

[2014-08-04 07:46:31,229] INFO DaoHelper - Checking database schema.
[2014-08-04 07:50:16,083] INFO DaoHelper - Done checking database schema.
[2014-08-04 07:50:17,717] INFO VersionService - Resolved local Subsonic version to: 5.0.beta1
[2014-08-04 07:50:18,834] INFO PlayerDao - Deleted 3 player(s) that haven't been used after Thu Jun 05 07:50:18 BST 2014
[2014-08-04 07:50:20,224] INFO MediaScannerService - Automatic media library scanning scheduled to run every 1 day(s), starting at Tue Aug 05 03:00:00 BST 2014
[2014-08-04 07:50:20,635] INFO UPnPService - Starting UPnP service...
[2014-08-04 07:50:21,013] INFO PodcastService - Automatic Podcast update scheduled to run every 24 hour(s), starting at Mon Aug 04 07:55:21 BST 2014
[2014-08-04 07:50:22,238] INFO UPnPService - Enabling UPnP/DLNA media server
[2014-08-04 07:50:22,238] INFO UPnPService - Starting UPnP service - Done!
[2014-08-04 07:50:30,894] INFO NetworkService - Successfully forwarding port 4500.
[2014-08-04 07:51:58,412] INFO VersionService - Resolved latest Subsonic final version to: 4.9
[2014-08-04 07:51:58,412] INFO VersionService - Resolved latest Subsonic beta version to: 5.0.beta1
[2014-08-04 07:52:24,434] INFO MediaScannerService - Starting to scan media library.
[2014-08-04 07:52:32,765] INFO MediaScannerService - Scanned media library with 250 entries.
[2014-08-04 07:52:37,411] INFO MediaScannerService - Scanned media library with 500 entries.
[2014-08-04 07:52:40,533] INFO MediaScannerService - Scanned media library with 750 entries.
[2014-08-04 07:52:43,503] INFO MediaScannerService - Scanned media library with 1000 entries.
[2014-08-04 07:52:46,280] INFO MediaScannerService - Scanned media library with 1250 entries.
[2014-08-04 07:52:49,151] INFO MediaScannerService - Scanned media library with 1500 entries.
[2014-08-04 07:52:52,389] INFO MediaScannerService - Scanned media library with 1750 entries.
[2014-08-04 07:52:55,023] INFO MediaScannerService - Scanned media library with 2000 entries.
[2014-08-04 07:52:57,610] INFO MediaScannerService - Scanned media library with 2250 entries.
[2014-08-04 07:53:00,298] INFO MediaScannerService - Scanned media library with 2500 entries.
[2014-08-04 07:53:02,832] INFO MediaScannerService - Scanned media library with 2750 entries.
[2014-08-04 07:53:05,499] INFO MediaScannerService - Scanned media library with 3000 entries.
[2014-08-04 07:53:08,175] INFO MediaScannerService - Scanned media library with 3250 entries.
[2014-08-04 07:53:11,104] INFO MediaScannerService - Scanned media library with 3500 entries.
[2014-08-04 07:53:13,915] INFO MediaScannerService - Scanned media library with 3750 entries.
[2014-08-04 07:53:16,545] INFO MediaScannerService - Scanned media library with 4000 entries.
[2014-08-04 07:53:19,351] INFO MediaScannerService - Scanned media library with 4250 entries.
[2014-08-04 07:53:23,351] INFO MediaScannerService - Scanned media library with 4500 entries.
[2014-08-04 07:53:26,237] INFO MediaScannerService - Scanned media library with 4750 entries.
[2014-08-04 07:53:29,046] INFO MediaScannerService - Scanned media library with 5000 entries.
[2014-08-04 07:53:31,578] INFO MediaScannerService - Scanned media library with 5250 entries.
[2014-08-04 07:53:34,321] INFO MediaScannerService - Scanned media library with 5500 entries.
[2014-08-04 07:53:36,874] INFO MediaScannerService - Scanned media library with 5750 entries.
[2014-08-04 07:53:39,786] INFO MediaScannerService - Scanned media library with 6000 entries.
[2014-08-04 07:53:42,771] INFO MediaScannerService - Scanned media library with 6250 entries.
[2014-08-04 07:53:45,485] INFO MediaScannerService - Scanned media library with 6500 entries.
[2014-08-04 07:53:48,637] INFO MediaScannerService - Scanned media library with 6750 entries.
[2014-08-04 07:53:51,277] INFO MediaScannerService - Scanned media library with 7000 entries.
[2014-08-04 07:53:53,868] INFO MediaScannerService - Scanned media library with 7250 entries.
[2014-08-04 07:53:56,800] INFO MediaScannerService - Scanned media library with 7500 entries.
[2014-08-04 07:53:59,430] INFO MediaScannerService - Scanned media library with 7750 entries.
[2014-08-04 07:54:02,067] INFO MediaScannerService - Scanned media library with 8000 entries.
[2014-08-04 07:54:04,861] INFO MediaScannerService - Scanned media library with 8250 entries.
[2014-08-04 07:54:07,530] INFO MediaScannerService - Scanned media library with 8500 entries.
[2014-08-04 07:54:10,253] INFO MediaScannerService - Scanned media library with 8750 entries.
[2014-08-04 07:54:13,197] INFO MediaScannerService - Scanned media library with 9000 entries.
[2014-08-04 07:54:16,183] INFO MediaScannerService - Scanned media library with 9250 entries.
[2014-08-04 07:54:18,998] INFO MediaScannerService - Scanned media library with 9500 entries.
[2014-08-04 07:54:21,669] INFO MediaScannerService - Scanned media library with 9750 entries.
[2014-08-04 07:54:24,554] INFO MediaScannerService - Scanned media library with 10000 entries.
[2014-08-04 07:54:27,151] INFO MediaScannerService - Scanned media library with 10250 entries.
[2014-08-04 07:54:31,016] INFO MediaScannerService - Scanned media library with 10500 entries.
[2014-08-04 07:54:34,189] INFO MediaScannerService - Scanned media library with 10750 entries.
[2014-08-04 07:54:37,218] INFO MediaScannerService - Scanned media library with 11000 entries.
[2014-08-04 07:54:39,786] INFO MediaScannerService - Scanned media library with 11250 entries.
[2014-08-04 07:54:42,766] INFO MediaScannerService - Scanned media library with 11500 entries.
[2014-08-04 07:54:45,367] INFO MediaScannerService - Scanned media library with 11750 entries.
[2014-08-04 07:54:48,121] INFO MediaScannerService - Scanned media library with 12000 entries.
[2014-08-04 07:54:50,627] INFO MediaScannerService - Scanned media library with 12250 entries.
[2014-08-04 07:54:53,207] INFO MediaScannerService - Scanned media library with 12500 entries.
[2014-08-04 07:54:55,916] INFO MediaScannerService - Scanned media library with 12750 entries.
[2014-08-04 07:54:58,769] INFO MediaScannerService - Scanned media library with 13000 entries.
[2014-08-04 07:55:01,562] INFO MediaScannerService - Scanned media library with 13250 entries.
[2014-08-04 07:55:04,978] INFO MediaScannerService - Scanned media library with 13500 entries.
[2014-08-04 07:55:07,867] INFO MediaScannerService - Scanned media library with 13750 entries.
[2014-08-04 07:55:10,325] INFO MediaScannerService - Scanned media library with 14000 entries.
[2014-08-04 07:55:13,384] INFO MediaScannerService - Scanned media library with 14250 entries.
[2014-08-04 07:55:15,971] INFO MediaScannerService - Scanned media library with 14500 entries.
[2014-08-04 07:55:18,835] INFO MediaScannerService - Scanned media library with 14750 entries.
[2014-08-04 07:55:21,016] INFO PodcastService - Starting scheduled Podcast refresh.
[2014-08-04 07:55:21,016] INFO PodcastService - Completed scheduled Podcast refresh.
[2014-08-04 07:55:21,457] INFO MediaScannerService - Scanned media library with 15000 entries.
[2014-08-04 07:55:24,399] INFO MediaScannerService - Scanned media library with 15250 entries.
[2014-08-04 07:55:27,458] INFO MediaScannerService - Scanned media library with 15500 entries.
[2014-08-04 07:55:29,976] INFO MediaScannerService - Scanned media library with 15750 entries.
[2014-08-04 07:55:32,893] INFO MediaScannerService - Scanned media library with 16000 entries.
[2014-08-04 07:55:35,599] INFO MediaScannerService - Scanned media library with 16250 entries.
[2014-08-04 07:55:38,628] INFO MediaScannerService - Scanned media library with 16500 entries.
[2014-08-04 07:55:41,413] INFO MediaScannerService - Scanned media library with 16750 entries.
[2014-08-04 07:55:44,545] INFO MediaScannerService - Scanned media library with 17000 entries.
[2014-08-04 07:55:47,341] INFO MediaScannerService - Scanned media library with 17250 entries.
[2014-08-04 07:55:50,820] INFO MediaScannerService - Scanned media library with 17500 entries.
[2014-08-04 07:55:53,674] INFO MediaScannerService - Scanned media library with 17750 entries.
[2014-08-04 07:55:56,344] INFO MediaScannerService - Scanned media library with 18000 entries.
[2014-08-04 07:55:59,174] INFO MediaScannerService - Scanned media library with 18250 entries.
[2014-08-04 07:56:02,399] INFO MediaScannerService - Scanned media library with 18500 entries.
[2014-08-04 07:56:05,114] INFO MediaScannerService - Scanned media library with 18750 entries.
[2014-08-04 07:56:07,988] INFO MediaScannerService - Scanned media library with 19000 entries.
[2014-08-04 07:56:10,482] INFO MediaScannerService - Scanned media library with 19250 entries.
[2014-08-04 07:56:13,295] INFO MediaScannerService - Scanned media library with 19500 entries.
[2014-08-04 07:56:15,937] INFO MediaScannerService - Scanned media library with 19750 entries.
[2014-08-04 07:56:19,185] INFO MediaScannerService - Scanned media library with 20000 entries.
[2014-08-04 07:56:21,653] INFO MediaScannerService - Scanned media library with 20250 entries.
[2014-08-04 07:56:24,727] INFO MediaScannerService - Scanned media library with 20500 entries.
[2014-08-04 07:56:27,378] INFO MediaScannerService - Scanned media library with 20750 entries.
[2014-08-04 07:56:30,151] INFO MediaScannerService - Scanned media library with 21000 entries.
[2014-08-04 07:56:33,017] INFO MediaScannerService - Scanned media library with 21250 entries.
[2014-08-04 07:56:36,088] INFO MediaScannerService - Scanned media library with 21500 entries.
[2014-08-04 07:56:38,787] INFO MediaScannerService - Scanned media library with 21750 entries.
[2014-08-04 07:56:41,269] INFO MediaScannerService - Scanned media library with 22000 entries.
[2014-08-04 07:56:44,306] INFO MediaScannerService - Scanned media library with 22250 entries.
[2014-08-04 07:56:46,962] INFO MediaScannerService - Scanned media library with 22500 entries.
[2014-08-04 07:56:48,993] ERROR MediaScannerService - Failed to scan media library.
org.springframework.dao.TransientDataAccessResourceException: PreparedStatementCallback; SQL [update media_file set present=?, last_scanned=? where path=?]; S1000 General error java.lang.NullPointerException in statement [update media_file set present=?, last_scanned=? where path=?]; nested exception is java.sql.SQLException: S1000 General error java.lang.NullPointerException in statement [update media_file set present=?, last_scanned=? where path=?]
at org.springframework.jdbc.support.SQLStateSQLExceptionTranslator.doTranslate(SQLStateSQLExceptionTranslator.java:106)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:80)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:80)
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:607)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:792)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:850)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:858)
at net.sourceforge.subsonic.dao.AbstractDao.update(AbstractDao.java:71)
at net.sourceforge.subsonic.dao.MediaFileDao.markPresent(MediaFileDao.java:327)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:241)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:229)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:232)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:232)
at net.sourceforge.subsonic.service.MediaScannerService.doScanLibrary(MediaScannerService.java:178)
at net.sourceforge.subsonic.service.MediaScannerService.access$000(MediaScannerService.java:48)
at net.sourceforge.subsonic.service.MediaScannerService$2.run(MediaScannerService.java:147)
Caused by: java.sql.SQLException: S1000 General error java.lang.NullPointerException in statement [update media_file set present=?, last_scanned=? where path=?]
at org.hsqldb.jdbc.Util.throwError(Unknown Source)
at org.hsqldb.jdbc.jdbcPreparedStatement.executeUpdate(Unknown Source)
at org.springframework.jdbc.core.JdbcTemplate$2.doInPreparedStatement(JdbcTemplate.java:798)
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:591)
... 12 more

[2014-08-04 07:56:50,179] INFO PlaylistService - Starting playlist import.
[2014-08-04 07:56:50,179] INFO PlaylistService - Completed playlist import.
[2014-08-04 07:56:50,179] INFO PlaylistService - Starting playlist statistics update.
[2014-08-04 07:56:50,180] INFO PlaylistService - Completed playlist statistics update.

[yoda72]

I have the same kind of problem after updated to 5.0beta1.
Except for me it crashes earlier.
Actually, it crashes right after it start scanning.

[2014-08-08 03:00:00,957] INFO MediaScannerService - Starting to scan media library.
[2014-08-08 03:00:02,392] ERROR MediaScannerService - Failed to scan media library.
org.springframework.dao.TransientDataAccessResourceException: PreparedStatementCallback; SQL [update media_file set present=?, last_scanned=? where path=?]; S1000 General error java.lang.NullPointerException in statement [update media_file set present=?, last_scanned=? where path=?]; nested exception is java.sql.SQLException: S1000 General error java.lang.NullPointerException in statement [update media_file set present=?, last_scanned=? where path=?]
at org.springframework.jdbc.support.SQLStateSQLExceptionTranslator.doTranslate(SQLStateSQLExceptionTranslator.java:106)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:80)
at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:80)
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:607)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:792)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:850)
at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:858)
at net.sourceforge.subsonic.dao.AbstractDao.update(AbstractDao.java:71)
at net.sourceforge.subsonic.dao.MediaFileDao.markPresent(MediaFileDao.java:327)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:241)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:229)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:232)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:232)
at net.sourceforge.subsonic.service.MediaScannerService.scanFile(MediaScannerService.java:232)
at net.sourceforge.subsonic.service.MediaScannerService.doScanLibrary(MediaScannerService.java:178)
at net.sourceforge.subsonic.service.MediaScannerService.access$000(MediaScannerService.java:48)
at net.sourceforge.subsonic.service.MediaScannerService$2.run(MediaScannerService.java:147)
Caused by: java.sql.SQLException: S1000 General error java.lang.NullPointerException in statement [update media_file set present=?, last_scanned=? where path=?]
at org.hsqldb.jdbc.Util.throwError(Unknown Source)
at org.hsqldb.jdbc.jdbcPreparedStatement.executeUpdate(Unknown Source)
at org.springframework.jdbc.core.JdbcTemplate$2.doInPreparedStatement(JdbcTemplate.java:798)
at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:591)

Any idea?
Y.

[yoda72]

I "solved" the problem.
I have uninstalled subsonic and deleted the database located in c:/subsonic/ folder.
Then fresh install of 5.0beta1, and it is working.

This is not really a solution, as you will loose your database, your settings and all your data, but in my case, I don't really care.

Hope this can help you.
Y.

[GJ51]

All this can be avoided by following a few simple guidelines.

Whenever you do an upgrade (and not a bad idea to do once a week or so) stop the subsonic service before doing anything else. This will allow the process to shutdown and close all the associated files properly. Next, just do a simple copy of the data directory to a safe location in case the upgrade somehow corrupts the db during the upgrade process. This shouldn't happen if you stop the service first, but if it does, at least you'll have your back up copy to use to restore your data.

This information has been posted numerous times. Perhaps it should be posted somewhere permanent where no on will read it anyway ...

[Jailon]

Thanks. Looks like it was a database issue as a fresh install solved it, I managed to copy some of the original files back so some of the settings were retained, although I did lose my users account settings. Tried copying the script folder and others mentioned on this forum but to no avail.
Was surprised that the "db" folder was over 1gb though ?!?

[GJ51]

No surprise to me. I remember the days when I was "power user" because I had 640kb of ram and not one, but two 360k floppy drives. Back then anything that wasn't written in assembler was called bloat ware. LOL nobody thought anyone should use C because it just wasn't efficient enough.

[yoda72]

GJ51,

Thanks for the simple guideline, I didn't pay attention if the service was closed when installing.
But I'm pretty sure that the installer stop the service before starting installation.

Actually, in my case, db was corrupted before update.
I thought the update would fix the problem, as I wasn't sure if it was a problem with the DB or something else.

Anyway, I have now a fresh DB, and I'm happy with it

Thanks,
Y.