BasicOptimizer.scala:89 executed in 86.91 seconds (1.075 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 307088224297700
Reset training subject: 307089906543600
Adding measurement 3884bad7 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-154.1260113087434;dx=-2.8948059492040364E-5
New Minimum: -154.1260113087434 > -154.12605804684716
END: th(2.154434690031884)=-154.12605804684716; dx=-1.78996229038997E-5 evalInputDelta=4.6738103776533535E-5
Fitness changed from -154.1260113087434 to -154.12605804684716
Iteration 1 complete. Error: -154.12605804684716 Total: 8.2936; Orientation: 0.0609; Line Search: 3.3436
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6dd8c743 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-154.12605804684716;dx=-1.775941816405764E-5
New Minimum: -154.12605804684716 > -154.1261515230121
WOLFE (weak): th(4.641588833612779)=-154.1261515230121; dx=-1.774187875468683E-5 evalInputDelta=9.347616494892463E-5
New Minimum: -154.1261515230121 > -154.1262449991204
WOLFE (weak): th(9.283177667225559)=-154.1262449991204; dx=-1.771210179890898E-5 evalInputDelta=1.8695227322496066E-4
New Minimum: -154.1262449991204 > -154.1266122261398
WOLFE (weak): th(27.849533001676676)=-154.1266122261398; dx=-1.7710037471724235E-5 evalInputDelta=5.541792926351263E-4
New Minimum: -154.1266122261398 > -154.1282480449602
WOLFE (weak): th(111.3981320067067)=-154.1282480449602; dx=-1.7683313046887925E-5 evalInputDelta=0.0021899981130388824
New Minimum: -154.1282480449602 > -154.13698769706343
WOLFE (weak): th(556.9906600335335)=-154.13698769706343; dx=-1.7693526452785183E-5 evalInputDelta=0.010929650216269238
New Minimum: -154.13698769706343 > -154.19161097909455
WOLFE (weak): th(3341.9439602012008)=-154.19161097909455; dx=-1.766594918830405E-5 evalInputDelta=0.06555293224738534
New Minimum: -154.19161097909455 > -154.58415841045831
WOLFE (weak): th(23393.607721408407)=-154.58415841045831; dx=-1.7616775327984115E-5 evalInputDelta=0.4581003636111518
New Minimum: -154.58415841045831 > -157.73262411671556
WOLFE (weak): th(187148.86177126726)=-157.73262411671556; dx=-1.7046833012005853E-5 evalInputDelta=3.606566069868393
New Minimum: -157.73262411671556 > -180.53323163939385
END: th(1684339.7559414054)=-180.53323163939385; dx=-1.0161514188452499E-5 evalInputDelta=26.407173592546684
Fitness changed from -154.12605804684716 to -180.53323163939385
Iteration 2 complete. Error: -180.53323163939385 Total: 18.5215; Orientation: 0.0608; Line Search: 16.6137
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 188a1cb9 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-180.53323163939385;dx=-1.2305540078664325E-5
New Minimum: -180.53323163939385 > -210.82262410657577
END: th(3628800.0000000005)=-210.82262410657577; dx=-4.294487624832853E-6 evalInputDelta=30.289392467181926
Fitness changed from -180.53323163939385 to -210.82262410657577
Iteration 3 complete. Error: -210.82262410657577 Total: 5.2106; Orientation: 0.0671; Line Search: 3.2349
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7dd7cb8e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.298e+04, gradient 3.105e-03, dot -0.410; [bbe37c4e-7e2a-4f77-9a57-709c35e144ba = 1.000/1.000e+00]
Orientation rejected. Popping history element from -210.82262410657577, -180.53323163939385, -154.12605804684716, -154.1260113087434
LBFGS Accumulation History: 3 points
Removed measurement 7dd7cb8e to history. Total: 3
th(0)=-210.82262410657577;dx=-9.622577586212377E-6
New Minimum: -210.82262410657577 > -235.77652494052208
END: th(7818012.603187701)=-235.77652494052208; dx=-3.370012651444903E-8 evalInputDelta=24.953900833946307
Fitness changed from -210.82262410657577 to -235.77652494052208
Iteration 4 complete. Error: -235.77652494052208 Total: 6.4980; Orientation: 1.0608; Line Search: 3.2908
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 776bed0a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.835e+03, gradient 3.710e-03, dot -0.163; [bbe37c4e-7e2a-4f77-9a57-709c35e144ba = 1.000/1.000e+00]
Orientation rejected. Popping history element from -235.77652494052208, -180.53323163939385, -154.12605804684716, -154.1260113087434
LBFGS Accumulation History: 3 points
Removed measurement 776bed0a to history. Total: 3
th(0)=-235.77652494052208;dx=-1.3754116621576637E-5
Armijo: th(1.6843397559414055E7)=-207.82263756457846; dx=3.149023623167244E-6 evalInputDelta=-27.953887375943623
New Minimum: -235.77652494052208 > -246.50685773066442
WOLF (strong): th(8421698.779707028)=-246.50685773066442; dx=4.270452166161791E-6 evalInputDelta=10.730332790142342
New Minimum: -246.50685773066442 > -261.6067423817018
END: th(2807232.926569009)=-261.6067423817018; dx=-3.0987321047677257E-6 evalInputDelta=25.830217441179713
Fitness changed from -235.77652494052208 to -261.6067423817018
Iteration 5 complete. Error: -261.6067423817018 Total: 9.6253; Orientation: 1.0627; Line Search: 6.7608
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6d1b4017 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.409e+04, gradient 2.470e-03, dot -0.401; [bbe37c4e-7e2a-4f77-9a57-709c35e144ba = 1.000/1.000e+00]
Orientation rejected. Popping history element from -261.6067423817018, -180.53323163939385, -154.12605804684716, -154.1260113087434
LBFGS Accumulation History: 3 points
Removed measurement 6d1b4017 to history. Total: 3
th(0)=-261.6067423817018;dx=-6.102343571610237E-6
New Minimum: -261.6067423817018 > -279.12075561840743
END: th(6048000.000000001)=-279.12075561840743; dx=-3.3445828429637827E-7 evalInputDelta=17.514013236705637
Fitness changed from -261.6067423817018 to -279.12075561840743
Iteration 6 complete. Error: -279.12075561840743 Total: 6.3299; Orientation: 0.9951; Line Search: 3.1941
Adding measurement 79394b9b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.379e+04, gradient 2.897e-03, dot -0.272; [bbe37c4e-7e2a-4f77-9a57-709c35e144ba = 1.000/1.000e+00]
Orientation rejected. Popping history element from -279.12075561840743, -180.53323163939385, -154.12605804684716, -154.1260113087434
LBFGS Accumulation History: 3 points
Removed measurement 79394b9b to history. Total: 3
th(0)=-279.12075561840743;dx=-8.374800028564865E-6
Armijo: th(1.3030021005312836E7)=-260.5185288762675; dx=2.9528655866444655E-6 evalInputDelta=-18.60222674213992
New Minimum: -279.12075561840743 > -285.42797266785726
WOLF (strong): th(6515010.502656418)=-285.42797266785726; dx=3.0084759980513552E-6 evalInputDelta=6.307217049449832
New Minimum: -285.42797266785726 > -291.98014252130895
END: th(2171670.167552139)=-291.98014252130895; dx=-2.4947318896868615E-6 evalInputDelta=12.85938690290152
Fitness changed from -279.12075561840743 to -291.98014252130895
Iteration 7 complete. Error: -291.98014252130895 Total: 9.3279; Orientation: 0.9785; Line Search: 6.6470
Adding measurement 3bdfb1c9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.268e+04, gradient 1.888e-03, dot -0.492; [bbe37c4e-7e2a-4f77-9a57-709c35e144ba = 1.000/1.000e+00]
Orientation rejected. Popping history element from -291.98014252130895, -180.53323163939385, -154.12605804684716, -154.1260113087434
LBFGS Accumulation History: 3 points
Removed measurement 3bdfb1c9 to history. Total: 3
th(0)=-291.98014252130895;dx=-3.5508953434685705E-6
New Minimum: -291.98014252130895 > -303.3507307590045
END: th(4678721.544281682)=-303.3507307590045; dx=-1.3406931750348866E-6 evalInputDelta=11.370588237695529
Fitness changed from -291.98014252130895 to -303.3507307590045
Iteration 8 complete. Error: -303.3507307590045 Total: 5.7067; Orientation: 1.0136; Line Search: 3.1351
Adding measurement 71d4ee65 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.249e+04, gradient 2.038e-03, dot -0.407; [bbe37c4e-7e2a-4f77-9a57-709c35e144ba = 1.000/1.000e+00]
Orientation rejected. Popping history element from -303.3507307590045, -180.53323163939385, -154.12605804684716, -154.1260113087434
LBFGS Accumulation History: 3 points
Removed measurement 71d4ee65 to history. Total: 3
th(0)=-303.3507307590045;dx=-4.148210740294542E-6
New Minimum: -303.3507307590045 > -305.00756133097184
WOLF (strong): th(1.0080000000000002E7)=-305.00756133097184; dx=1.237252756677402E-6 evalInputDelta=1.6568305719673617
New Minimum: -305.00756133097184 > -310.88396023143474
WOLF (strong): th(5040000.000000001)=-310.88396023143474; dx=2.7151925850797645E-7 evalInputDelta=7.533229472430264
END: th(1680000.0000000002)=-308.87192117263345; dx=-2.0816741359762874E-6 evalInputDelta=5.521190413628972
Fitness changed from -303.3507307590045 to -310.88396023143474
Iteration 9 complete. Error: -310.88396023143474 Total: 9.5159; Orientation: 1.0242; Line Search: 6.6952
Adding measurement 79a3d440 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.867e+04, gradient 2.388e-03, dot -0.289; [bbe37c4e-7e2a-4f77-9a57-709c35e144ba = 1.000/1.000e+00]
Orientation rejected. Popping history element from -310.88396023143474, -180.53323163939385, -154.12605804684716, -154.1260113087434
LBFGS Accumulation History: 3 points
Removed measurement 79a3d440 to history. Total: 3
th(0)=-310.88396023143474;dx=-5.685453646581109E-6
New Minimum: -310.88396023143474 > -320.10303522531456
WOLF (strong): th(3619450.2792535652)=-320.10303522531456; dx=6.723973109288373E-7 evalInputDelta=9.219074993879815
END: th(1809725.1396267826)=-318.8489387895418; dx=-2.4201876050507347E-6 evalInputDelta=7.964978558107077
Fitness changed from -310.88396023143474 to -320.10303522531456
Iteration 10 complete. Error: -320.10303522531456 Total: 7.5447; Orientation: 1.0276; Line Search: 4.9517
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -320.10303522531456 (> -Infinity) after 86.906s (< 5400.000s)
Returns
-320.10303522531456