BasicOptimizer.scala:89 executed in 281.89 seconds (3.191 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 644558107315300
Reset training subject: 644563893142000
Adding measurement 2f67ab62 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-35.27199513313515;dx=-1.8990462196664373E-6
New Minimum: -35.27199513313515 > -35.271997274416
END: th(2.154434690031884)=-35.271997274416; dx=-1.6601265601450309E-6 evalInputDelta=2.1412808521859006E-6
Fitness changed from -35.27199513313515 to -35.271997274416
Iteration 1 complete. Error: -35.271997274416 Total: 28.5834; Orientation: 0.1462; Line Search: 11.5542
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7de47f0d to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-35.271997274416;dx=-1.6569562002441711E-6
New Minimum: -35.271997274416 > -35.27200691017824
WOLFE (weak): th(4.641588833612779)=-35.27200691017824; dx=-1.6566803408587572E-6 evalInputDelta=9.635762239668111E-6
New Minimum: -35.27200691017824 > -35.272016545937845
WOLFE (weak): th(9.283177667225559)=-35.272016545937845; dx=-1.6561671987558311E-6 evalInputDelta=1.9271521843222672E-5
New Minimum: -35.272016545937845 > -35.272050806395114
WOLFE (weak): th(27.849533001676676)=-35.272050806395114; dx=-1.6551967514056445E-6 evalInputDelta=5.3531979112619865E-5
New Minimum: -35.272050806395114 > -35.27220497804104
WOLFE (weak): th(111.3981320067067)=-35.27220497804104; dx=-1.6546960931283487E-6 evalInputDelta=2.0770362503697015E-4
New Minimum: -35.27220497804104 > -35.27302721543861
WOLFE (weak): th(556.9906600335335)=-35.27302721543861; dx=-1.6548235254208559E-6 evalInputDelta=0.0010299410226082273
New Minimum: -35.27302721543861 > -35.27816255362707
WOLFE (weak): th(3341.9439602012008)=-35.27816255362707; dx=-1.654398798470012E-6 evalInputDelta=0.006165279211067798
New Minimum: -35.27816255362707 > -35.31511879401633
WOLFE (weak): th(23393.607721408407)=-35.31511879401633; dx=-1.6519722562325518E-6 evalInputDelta=0.04312151960032651
New Minimum: -35.31511879401633 > -35.61505271944278
WOLFE (weak): th(187148.86177126726)=-35.61505271944278; dx=-1.6325116602824592E-6 evalInputDelta=0.34305544502677776
New Minimum: -35.61505271944278 > -38.15799729301635
END: th(1684339.7559414054)=-38.15799729301635; dx=-1.4055197710660476E-6 evalInputDelta=2.886000018600349
Fitness changed from -35.271997274416 to -38.15799729301635
Iteration 2 complete. Error: -38.15799729301635 Total: 64.7446; Orientation: 0.1401; Line Search: 58.0567
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 29e13f26 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-38.15799729301635;dx=-1.328194086605616E-6
New Minimum: -38.15799729301635 > -42.55143637889255
END: th(3628800.0000000005)=-42.55143637889255; dx=-8.704532154313557E-7 evalInputDelta=4.393439085876196
Fitness changed from -38.15799729301635 to -42.55143637889255
Iteration 3 complete. Error: -42.55143637889255 Total: 18.1039; Orientation: 0.1323; Line Search: 11.3232
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 451d38bf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.225e+03, gradient 9.103e-04, dot -0.798; [c8d72470-2054-4288-9253-a4be510e9479 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -42.55143637889255, -38.15799729301635, -35.271997274416, -35.27199513313515
LBFGS Accumulation History: 3 points
Removed measurement 451d38bf to history. Total: 3
th(0)=-42.55143637889255;dx=-8.284927839304739E-7
New Minimum: -42.55143637889255 > -48.002915622739586
END: th(7818012.603187701)=-48.002915622739586; dx=-4.4623685575041924E-7 evalInputDelta=5.451479243847039
Fitness changed from -42.55143637889255 to -48.002915622739586
Iteration 4 complete. Error: -48.002915622739586 Total: 20.6724; Orientation: 2.5019; Line Search: 11.5320
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2f4fc9db to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.453e+03, gradient 7.971e-04, dot -0.579; [c8d72470-2054-4288-9253-a4be510e9479 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.002915622739586, -38.15799729301635, -35.271997274416, -35.27199513313515
LBFGS Accumulation History: 3 points
Removed measurement 2f4fc9db to history. Total: 3
th(0)=-48.002915622739586;dx=-6.348815962660325E-7
New Minimum: -48.002915622739586 > -53.904725332381176
END: th(1.6843397559414055E7)=-53.904725332381176; dx=-1.4667141792375797E-7 evalInputDelta=5.90180970964159
Fitness changed from -48.002915622739586 to -53.904725332381176
Iteration 5 complete. Error: -53.904725332381176 Total: 20.9678; Orientation: 2.4303; Line Search: 11.9354
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1008ae44 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.258e+04, gradient 9.712e-04, dot -0.352; [c8d72470-2054-4288-9253-a4be510e9479 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.904725332381176, -38.15799729301635, -35.271997274416, -35.27199513313515
LBFGS Accumulation History: 3 points
Removed measurement 1008ae44 to history. Total: 3
th(0)=-53.904725332381176;dx=-9.422576198366818E-7
Armijo: th(3.628800000000001E7)=-52.12897735996994; dx=1.7768401221756325E-7 evalInputDelta=-1.7757479724112386
New Minimum: -53.904725332381176 > -56.92645906467751
WOLF (strong): th(1.8144000000000004E7)=-56.92645906467751; dx=2.396638004350504E-7 evalInputDelta=3.021733732296333
New Minimum: -56.92645906467751 > -58.19087954642706
END: th(6048000.000000001)=-58.19087954642706; dx=-3.01509730424666E-7 evalInputDelta=4.286154214045887
Fitness changed from -53.904725332381176 to -58.19087954642706
Iteration 6 complete. Error: -58.19087954642706 Total: 32.1255; Orientation: 2.3917; Line Search: 23.2102
Adding measurement 5006fbf9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.122e+04, gradient 6.955e-04, dot -0.620; [c8d72470-2054-4288-9253-a4be510e9479 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -58.19087954642706, -38.15799729301635, -35.271997274416, -35.27199513313515
LBFGS Accumulation History: 3 points
Removed measurement 5006fbf9 to history. Total: 3
th(0)=-58.19087954642706;dx=-4.831319629048345E-7
New Minimum: -58.19087954642706 > -62.323469235044385
END: th(1.3030021005312836E7)=-62.323469235044385; dx=-1.5122197795685715E-7 evalInputDelta=4.132589688617323
Fitness changed from -58.19087954642706 to -62.323469235044385
Iteration 7 complete. Error: -62.323469235044385 Total: 19.1624; Orientation: 2.3937; Line Search: 11.1594
Adding measurement 5b2668c7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.817e+04, gradient 8.206e-04, dot -0.487; [c8d72470-2054-4288-9253-a4be510e9479 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -62.323469235044385, -38.15799729301635, -35.271997274416, -35.27199513313515
LBFGS Accumulation History: 3 points
Removed measurement 5b2668c7 to history. Total: 3
th(0)=-62.323469235044385;dx=-6.727354344397785E-7
New Minimum: -62.323469235044385 > -63.02210919344801
WOLF (strong): th(2.8072329265690096E7)=-63.02210919344801; dx=1.3102794024537718E-7 evalInputDelta=0.6986399584036249
New Minimum: -63.02210919344801 > -65.32404861558534
WOLF (strong): th(1.4036164632845048E7)=-65.32404861558534; dx=9.582514616841911E-8 evalInputDelta=3.0005793805409553
END: th(4678721.544281683)=-64.92097923148296; dx=-3.1488875784898025E-7 evalInputDelta=2.597509996438575
Fitness changed from -62.323469235044385 to -65.32404861558534
Iteration 8 complete. Error: -65.32404861558534 Total: 31.3829; Orientation: 2.3806; Line Search: 23.2778
Adding measurement 54a7e4f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.922e+04, gradient 9.521e-04, dot -0.355; [c8d72470-2054-4288-9253-a4be510e9479 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.32404861558534, -38.15799729301635, -35.271997274416, -35.27199513313515
LBFGS Accumulation History: 3 points
Removed measurement 54a7e4f to history. Total: 3
th(0)=-65.32404861558534;dx=-9.05844365080318E-7
New Minimum: -65.32404861558534 > -70.31107120255014
WOLF (strong): th(1.0080000000000004E7)=-70.31107120255014; dx=5.2419527709122094E-8 evalInputDelta=4.987022586964798
END: th(5040000.000000002)=-69.27670527471209; dx=-4.690510900903458E-7 evalInputDelta=3.9526566591267454
Fitness changed from -65.32404861558534 to -70.31107120255014
Iteration 9 complete. Error: -70.31107120255014 Total: 25.5675; Orientation: 2.3549; Line Search: 17.7260
Adding measurement 3e7d0132 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.470e+04, gradient 7.456e-04, dot -0.514; [c8d72470-2054-4288-9253-a4be510e9479 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -70.31107120255014, -38.15799729301635, -35.271997274416, -35.27199513313515
LBFGS Accumulation History: 3 points
Removed measurement 3e7d0132 to history. Total: 3
th(0)=-70.31107120255014;dx=-5.551970664244465E-7
New Minimum: -70.31107120255014 > -73.52079331937496
END: th(1.0858350837760698E7)=-73.52079331937496; dx=-2.0498832652649642E-8 evalInputDelta=3.209722116824821
Fitness changed from -70.31107120255014 to -73.52079331937496
Iteration 10 complete. Error: -73.52079331937496 Total: 19.5449; Orientation: 2.3589; Line Search: 11.4300
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -73.52079331937496 (> -Infinity) after 281.888s (< 5400.000s)
Returns
-73.52079331937496