java - neo4j upgrade 1.9.x -> 2.x failing -

i'm trying run upgrade neo4j 1.9.8 2.3.0

i'm using neo4j in embedded java mode, additional webadmin configured via org.neo4j.server.configuration.serverconfigurator.

i have

allow_store_upgrade=true 

and following appears in messages.log

2015-10-22 09:45:19.263+0000 info  [o.n.k.i.s.storemigrator] starting upgrade of database store files 2015-10-22 09:45:19.609+0000 info  [o.n.u.i.b.parallelbatchimporter] import starting 2015-10-22 09:45:19.662+0000 warn  [o.n.k.i.s.metadatastore] missing counts store, rebuilding it. 2015-10-22 09:45:19.870+0000 info  [o.n.k.a.i.i.lucenelabelscanstore] no lucene scan store index found, might first use. preparing rebuild. 2015-10-22 09:45:20.011+0000 info  [o.n.k.a.i.i.lucenelabelscanstore] rebuilding lucene scan store, may take while 2015-10-22 09:45:20.013+0000 info  [o.n.k.a.i.i.lucenelabelscanstore] lucene scan store rebuilt (roughly -1 nodes) 2015-10-22 09:47:40.676+0000 info  [o.n.k.i.s.storemigrator] store upgrade 10% complete 2015-10-22 09:49:30.698+0000 info  [o.n.k.i.s.storemigrator] store upgrade 20% complete 2015-10-22 09:57:09.822+0000 info  [o.n.k.i.s.storemigrator] store upgrade 30% complete 2015-10-22 10:00:36.621+0000 info  [o.n.k.i.s.storemigrator] store upgrade 40% complete 2015-10-22 10:08:16.226+0000 info  [o.n.k.i.s.storemigrator] store upgrade 50% complete 2015-10-22 10:16:30.454+0000 info  [o.n.k.i.s.storemigrator] store upgrade 60% complete 2015-10-22 10:20:19.178+0000 info  [o.n.k.i.s.storemigrator] store upgrade 70% complete 2015-10-22 10:35:07.315+0000 info  [o.n.k.i.s.storemigrator] store upgrade 80% complete 2015-10-22 10:58:56.521+0000 info  [o.n.k.i.s.storemigrator] store upgrade 90% complete 2015-10-22 11:11:26.017+0000 info  [o.n.k.i.s.storemigrator] store upgrade 100% complete 2015-10-22 11:15:32.419+0000 info  [o.n.u.i.b.parallelbatchimporter] import completed, took 1h 30m 12s 805ms. imported:   427688598 nodes   884330252 relationships   0 properties 

so says it's done, claim of 0 properties suspicious.

when remove allow_store_upgrade property , re-boot, get:

caused by: org.neo4j.kernel.impl.storemigration.upgradenotallowedbyconfigurationexception: failed start neo4j older data store version. enable automatic upgrade, please set configuration parameter "allow_store_upgrade=true"         @ org.neo4j.kernel.impl.storemigration.configmapupgradeconfiguration.checkconfigurationallowsautomaticupgrade(configmapupgradeconfiguration.java:39) ~[neo4j-kernel-2.3.0-rc1.jar:2.3.0-rc1,8014933]         @ org.neo4j.kernel.impl.storemigration.storeupgrader.migrateifneeded(storeupgrader.java:135) ~[neo4j-kernel-2.3.0-rc1.jar:2.3.0-rc1,8014933]         @ org.neo4j.kernel.neostoredatasource.upgradestore(neostoredatasource.java:623) ~[neo4j-kernel-2.3.0-rc1.jar:2.3.0-rc1,8014933]         @ org.neo4j.kernel.neostoredatasource.start(neostoredatasource.java:514) ~[neo4j-kernel-2.3.0-rc1.jar:2.3.0-rc1,8014933]         @ org.neo4j.kernel.lifecycle.lifesupport$lifecycleinstance.start(lifesupport.java:528) ~[neo4j-kernel-2.3.0-rc1.jar:2.3.0-rc1,8014933]         ... 89 common frames omitted 

make sure have clean shutdown on 1.9.x database. on safe side run consistency checker on one, see http://www.markhneedham.com/blog/2014/01/22/neo4j-backup-store-copy-and-consistency-check/ details.

my expectation 1.9 -> 2.3 upgrade should run in 1 step. if doesn't work you, try run upgrade in multiple steps: 1.9 -> 2.0 -> 2.1 -> 2.2 -> 2.3. if multiple step approach succeeds, consider failure of "large" upgrade bug worth filing issue @ https://github.com/neo4j/neo4j/issues.