BasicOptimizer.scala:89 executed in 130.30 seconds (1.703 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 31087936321300
Reset training subject: 31090511722200
Adding measurement 2bc3ce88 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-69.30882164575029;dx=-4.929574650251924E-6
New Minimum: -69.30882164575029 > -69.30883398865831
END: th(2.154434690031884)=-69.30883398865831; dx=-4.0526556984941355E-6 evalInputDelta=1.234290802187843E-5
Fitness changed from -69.30882164575029 to -69.30883398865831
Iteration 1 complete. Error: -69.30883398865831 Total: 12.9733; Orientation: 0.0613; Line Search: 5.2228
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1afde52c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-69.30883398865831;dx=-4.0209709600870265E-6
New Minimum: -69.30883398865831 > -69.30885373730659
WOLFE (weak): th(4.641588833612779)=-69.30885373730659; dx=-4.021060691468576E-6 evalInputDelta=1.9748648284689807E-5
New Minimum: -69.30885373730659 > -69.30887842310902
WOLFE (weak): th(9.283177667225559)=-69.30887842310902; dx=-4.022409884238247E-6 evalInputDelta=4.443445071444785E-5
New Minimum: -69.30887842310902 > -69.30896235477151
WOLFE (weak): th(27.849533001676676)=-69.30896235477151; dx=-4.0213067292891975E-6 evalInputDelta=1.2836611320210523E-4
New Minimum: -69.30896235477151 > -69.30934745168463
WOLFE (weak): th(111.3981320067067)=-69.30934745168463; dx=-4.021354815340003E-6 evalInputDelta=5.134630263228246E-4
New Minimum: -69.30934745168463 > -69.31140620273197
WOLFE (weak): th(556.9906600335335)=-69.31140620273197; dx=-4.020471006367519E-6 evalInputDelta=0.002572214073666146
New Minimum: -69.31140620273197 > -69.32426584150512
WOLFE (weak): th(3341.9439602012008)=-69.32426584150512; dx=-4.0185224409526E-6 evalInputDelta=0.015431852846816696
New Minimum: -69.32426584150512 > -69.41666660802417
WOLFE (weak): th(23393.607721408407)=-69.41666660802417; dx=-4.0026742792548995E-6 evalInputDelta=0.10783261936586541
New Minimum: -69.41666660802417 > -70.14834271046146
WOLFE (weak): th(187148.86177126726)=-70.14834271046146; dx=-3.7792487368277883E-6 evalInputDelta=0.8395087218031563
New Minimum: -70.14834271046146 > -75.34785799252352
END: th(1684339.7559414054)=-75.34785799252352; dx=-2.331788855137622E-6 evalInputDelta=6.039024003865208
Fitness changed from -69.30883398865831 to -75.34785799252352
Iteration 2 complete. Error: -75.34785799252352 Total: 29.4817; Orientation: 0.0661; Line Search: 26.3005
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3ab3f2b3 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-75.34785799252352;dx=-2.1656852279618815E-6
New Minimum: -75.34785799252352 > -82.18601116084591
END: th(3628800.0000000005)=-82.18601116084591; dx=-1.2238309077955274E-6 evalInputDelta=6.838153168322393
Fitness changed from -75.34785799252352 to -82.18601116084591
Iteration 3 complete. Error: -82.18601116084591 Total: 8.5194; Orientation: 0.0604; Line Search: 5.3581
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7bcb7846 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.544e+03, gradient 1.219e-03, dot -0.674; [85c97049-95de-4532-94cb-21fc6165a576 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.18601116084591, -75.34785799252352, -69.30883398865831, -69.30882164575029
LBFGS Accumulation History: 3 points
Removed measurement 7bcb7846 to history. Total: 3
th(0)=-82.18601116084591;dx=-1.486029592364931E-6
New Minimum: -82.18601116084591 > -90.24847125294424
END: th(7818012.603187701)=-90.24847125294424; dx=-5.026788923817888E-7 evalInputDelta=8.062460092098334
Fitness changed from -82.18601116084591 to -90.24847125294424
Iteration 4 complete. Error: -90.24847125294424 Total: 9.6731; Orientation: 1.0729; Line Search: 5.4895
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 70d5b7a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.104e+04, gradient 1.438e-03, dot -0.415; [85c97049-95de-4532-94cb-21fc6165a576 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -90.24847125294424, -75.34785799252352, -69.30883398865831, -69.30882164575029
LBFGS Accumulation History: 3 points
Removed measurement 70d5b7a to history. Total: 3
th(0)=-90.24847125294424;dx=-2.066017113679056E-6
Armijo: th(1.6843397559414055E7)=-85.37218123297686; dx=7.086199422956463E-7 evalInputDelta=-4.876290019967385
New Minimum: -90.24847125294424 > -92.67280684742232
WOLF (strong): th(8421698.779707028)=-92.67280684742232; dx=6.471316894959325E-7 evalInputDelta=2.4243355944780802
New Minimum: -92.67280684742232 > -94.47963623194879
END: th(2807232.926569009)=-94.47963623194879; dx=-5.567120531378974E-7 evalInputDelta=4.2311649790045465
Fitness changed from -90.24847125294424 to -94.47963623194879
Iteration 5 complete. Error: -94.47963623194879 Total: 14.4437; Orientation: 1.0470; Line Search: 10.2575
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6c742f40 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.700e+04, gradient 1.055e-03, dot -0.666; [85c97049-95de-4532-94cb-21fc6165a576 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.47963623194879, -75.34785799252352, -69.30883398865831, -69.30882164575029
LBFGS Accumulation History: 3 points
Removed measurement 6c742f40 to history. Total: 3
th(0)=-94.47963623194879;dx=-1.1119931157363315E-6
New Minimum: -94.47963623194879 > -98.87936424175884
END: th(6048000.000000001)=-98.87936424175884; dx=-3.1074601839505766E-7 evalInputDelta=4.3997280098100475
Fitness changed from -94.47963623194879 to -98.87936424175884
Iteration 6 complete. Error: -98.87936424175884 Total: 9.5260; Orientation: 1.0165; Line Search: 5.2432
Adding measurement 32044111 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.015e+04, gradient 1.300e-03, dot -0.475; [85c97049-95de-4532-94cb-21fc6165a576 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -98.87936424175884, -75.34785799252352, -69.30883398865831, -69.30882164575029
LBFGS Accumulation History: 3 points
Removed measurement 32044111 to history. Total: 3
th(0)=-98.87936424175884;dx=-1.6898994150512057E-6
Armijo: th(1.3030021005312836E7)=-96.59144632651488; dx=6.373239472564371E-7 evalInputDelta=-2.287917915243952
New Minimum: -98.87936424175884 > -101.3713119386092
WOLF (strong): th(6515010.502656418)=-101.3713119386092; dx=4.767796711057787E-7 evalInputDelta=2.49194769685036
New Minimum: -101.3713119386092 > -101.83202346276244
END: th(2171670.167552139)=-101.83202346276244; dx=-6.611469735937032E-7 evalInputDelta=2.9526592210036
Fitness changed from -98.87936424175884 to -101.83202346276244
Iteration 7 complete. Error: -101.83202346276244 Total: 13.9519; Orientation: 1.1849; Line Search: 10.3194
Adding measurement 73c25207 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.606e+04, gradient 8.837e-04, dot -0.765; [85c97049-95de-4532-94cb-21fc6165a576 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -101.83202346276244, -75.34785799252352, -69.30883398865831, -69.30882164575029
LBFGS Accumulation History: 3 points
Removed measurement 73c25207 to history. Total: 3
th(0)=-101.83202346276244;dx=-7.805894823521785E-7
New Minimum: -101.83202346276244 > -105.29128548128811
END: th(4678721.544281682)=-105.29128548128811; dx=-5.617906229027304E-7 evalInputDelta=3.4592620185256777
Fitness changed from -101.83202346276244 to -105.29128548128811
Iteration 8 complete. Error: -105.29128548128811 Total: 8.9332; Orientation: 1.1719; Line Search: 5.2749
Adding measurement 61e218a8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.961e+04, gradient 9.090e-04, dot -0.711; [85c97049-95de-4532-94cb-21fc6165a576 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -105.29128548128811, -75.34785799252352, -69.30883398865831, -69.30882164575029
LBFGS Accumulation History: 3 points
Removed measurement 61e218a8 to history. Total: 3
th(0)=-105.29128548128811;dx=-8.254395406024157E-7
New Minimum: -105.29128548128811 > -109.92228925144015
END: th(1.0080000000000002E7)=-109.92228925144015; dx=-1.8746855954732591E-7 evalInputDelta=4.631003770152034
Fitness changed from -105.29128548128811 to -109.92228925144015
Iteration 9 complete. Error: -109.92228925144015 Total: 8.6707; Orientation: 0.9932; Line Search: 5.1261
Adding measurement 5f9efef2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.760e+04, gradient 1.299e-03, dot -0.393; [85c97049-95de-4532-94cb-21fc6165a576 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -109.92228925144015, -75.34785799252352, -69.30883398865831, -69.30882164575029
LBFGS Accumulation History: 3 points
Removed measurement 5f9efef2 to history. Total: 3
th(0)=-109.92228925144015;dx=-1.6876931743434528E-6
Armijo: th(2.1716701675521392E7)=-97.93810464598279; dx=7.691581055721472E-7 evalInputDelta=-11.984184605457358
Armijo: th(1.0858350837760696E7)=-108.97828153586144; dx=8.902208305988021E-7 evalInputDelta=-0.9440077155787066
New Minimum: -109.92228925144015 > -113.96684462613521
END: th(3619450.2792535652)=-113.96684462613521; dx=-2.1477422007683342E-7 evalInputDelta=4.044555374695065
Fitness changed from -109.92228925144015 to -113.96684462613521
Iteration 10 complete. Error: -113.96684462613521 Total: 13.6829; Orientation: 0.9988; Line Search: 10.0849
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -113.96684462613521 (> -Infinity) after 130.296s (< 5400.000s)
Returns
-113.96684462613521