BasicOptimizer.scala:89 executed in 154.75 seconds (3.376 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 469217741420100
Reset training subject: 469220637045600
Adding measurement 23da722e to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-101.97989090178528;dx=-1.2232734023998644E-5
New Minimum: -101.97989090178528 > -101.97991269633496
WOLFE (weak): th(2.154434690031884)=-101.97991269633496; dx=-1.1225337160413605E-5 evalInputDelta=2.1794549681430908E-5
New Minimum: -101.97991269633496 > -101.97994538815077
WOLFE (weak): th(4.308869380063768)=-101.97994538815077; dx=-1.1227443580180245E-5 evalInputDelta=5.44863654852179E-5
New Minimum: -101.97994538815077 > -101.9800434635353
WOLFE (weak): th(12.926608140191302)=-101.9800434635353; dx=-1.118256960701736E-5 evalInputDelta=1.5256175001354677E-4
New Minimum: -101.9800434635353 > -101.98050114741596
WOLFE (weak): th(51.70643256076521)=-101.98050114741596; dx=-1.123183090571467E-5 evalInputDelta=6.102456306820159E-4
New Minimum: -101.98050114741596 > -101.98295299037221
WOLFE (weak): th(258.53216280382605)=-101.98295299037221; dx=-1.1226152189434985E-5 evalInputDelta=0.00306208858692969
New Minimum: -101.98295299037221 > -101.99826205440304
WOLFE (weak): th(1551.1929768229563)=-101.99826205440304; dx=-1.1216506158180514E-5 evalInputDelta=0.018371152617760345
New Minimum: -101.99826205440304 > -102.10839779165318
WOLFE (weak): th(10858.350837760694)=-102.10839779165318; dx=-1.1215113540768005E-5 evalInputDelta=0.12850688986789294
New Minimum: -102.10839779165318 > -103.00253455828887
WOLFE (weak): th(86866.80670208555)=-103.00253455828887; dx=-1.1083110376268833E-5 evalInputDelta=1.0226436565035897
New Minimum: -103.00253455828887 > -110.64891330177078
END: th(781801.26031877)=-110.64891330177078; dx=-9.767622606719413E-6 evalInputDelta=8.669022399985494
Fitness changed from -101.97989090178528 to -110.64891330177078
Iteration 1 complete. Error: -110.64891330177078 Total: 38.1035; Orientation: 0.1052; Line Search: 29.4614
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2a895a84 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-110.64891330177078;dx=-9.37222546285807E-6
New Minimum: -110.64891330177078 > -124.96295882493241
END: th(1684339.7559414052)=-124.96295882493241; dx=-6.855797183208141E-6 evalInputDelta=14.314045523161639
Fitness changed from -110.64891330177078 to -124.96295882493241
Iteration 2 complete. Error: -124.96295882493241 Total: 9.4091; Orientation: 0.1026; Line Search: 5.8543
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 375d018c to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-124.96295882493241;dx=-6.636286183510504E-6
New Minimum: -124.96295882493241 > -144.3148982156774
END: th(3628800.0)=-144.3148982156774; dx=-3.771638517953344E-6 evalInputDelta=19.351939390744988
Fitness changed from -124.96295882493241 to -144.3148982156774
Iteration 3 complete. Error: -144.3148982156774 Total: 9.2224; Orientation: 0.0903; Line Search: 5.6126
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 53e41c9b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.845e+04, gradient 2.139e-03, dot -0.748; [dbb492d0-de29-41ab-b4d3-210e15521a5a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -144.3148982156774, -124.96295882493241, -110.64891330177078, -101.97989090178528
LBFGS Accumulation History: 3 points
Removed measurement 53e41c9b to history. Total: 3
th(0)=-144.3148982156774;dx=-4.56299430208607E-6
New Minimum: -144.3148982156774 > -166.17171697121893
END: th(7818012.6031877)=-166.17171697121893; dx=-1.471178421109349E-6 evalInputDelta=21.856818755541525
Fitness changed from -144.3148982156774 to -166.17171697121893
Iteration 4 complete. Error: -166.17171697121893 Total: 12.2667; Orientation: 2.2675; Line Search: 6.2714
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 90ac01 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.497e+04, gradient 2.111e-03, dot -0.515; [dbb492d0-de29-41ab-b4d3-210e15521a5a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -166.17171697121893, -124.96295882493241, -110.64891330177078, -101.97989090178528
LBFGS Accumulation History: 3 points
Removed measurement 90ac01 to history. Total: 3
th(0)=-166.17171697121893;dx=-4.455342603523456E-6
New Minimum: -166.17171697121893 > -174.38230077505713
WOLF (strong): th(1.684339755941405E7)=-174.38230077505713; dx=8.261927210263791E-7 evalInputDelta=8.210583803838205
New Minimum: -174.38230077505713 > -180.12265085082177
WOLF (strong): th(8421698.779707026)=-180.12265085082177; dx=3.0363216175982663E-8 evalInputDelta=13.950933879602843
END: th(2807232.9265690087)=-175.70919895781932; dx=-2.191988905713837E-6 evalInputDelta=9.537481986600397
Fitness changed from -166.17171697121893 to -180.12265085082177
Iteration 5 complete. Error: -180.12265085082177 Total: 19.2263; Orientation: 2.2257; Line Search: 13.0146
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 73cb2dc7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.591e+04, gradient 2.221e-03, dot -0.411; [dbb492d0-de29-41ab-b4d3-210e15521a5a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -180.12265085082177, -124.96295882493241, -110.64891330177078, -101.97989090178528
LBFGS Accumulation History: 3 points
Removed measurement 73cb2dc7 to history. Total: 3
th(0)=-180.12265085082177;dx=-4.920513797743751E-6
New Minimum: -180.12265085082177 > -194.69884305225483
END: th(6048000.0)=-194.69884305225483; dx=-8.154973064755842E-8 evalInputDelta=14.57619220143306
Fitness changed from -180.12265085082177 to -194.69884305225483
Iteration 6 complete. Error: -194.69884305225483 Total: 11.6711; Orientation: 1.8898; Line Search: 5.9935
Adding measurement 690cfdb8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.284e+04, gradient 1.779e-03, dot -0.488; [dbb492d0-de29-41ab-b4d3-210e15521a5a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -194.69884305225483, -124.96295882493241, -110.64891330177078, -101.97989090178528
LBFGS Accumulation History: 3 points
Removed measurement 690cfdb8 to history. Total: 3
th(0)=-194.69884305225483;dx=-3.1614530846598245E-6
New Minimum: -194.69884305225483 > -200.43314120669257
WOLF (strong): th(1.3030021005312834E7)=-200.43314120669257; dx=8.921113166614905E-7 evalInputDelta=5.734298154437738
New Minimum: -200.43314120669257 > -204.45831136740813
END: th(6515010.502656417)=-204.45831136740813; dx=-1.4018994416462355E-7 evalInputDelta=9.759468315153299
Fitness changed from -194.69884305225483 to -204.45831136740813
Iteration 7 complete. Error: -204.45831136740813 Total: 13.5888; Orientation: 1.7988; Line Search: 8.9829
Adding measurement 56822e26 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.604e+04, gradient 1.718e-03, dot -0.477; [dbb492d0-de29-41ab-b4d3-210e15521a5a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -204.45831136740813, -124.96295882493241, -110.64891330177078, -101.97989090178528
LBFGS Accumulation History: 3 points
Removed measurement 56822e26 to history. Total: 3
th(0)=-204.45831136740813;dx=-2.9504128627743486E-6
New Minimum: -204.45831136740813 > -206.64862535586744
WOLF (strong): th(1.4036164632845046E7)=-206.64862535586744; dx=1.0148911427234812E-6 evalInputDelta=2.190313988459309
New Minimum: -206.64862535586744 > -212.63433134293848
WOLF (strong): th(7018082.316422523)=-212.63433134293848; dx=1.9575027865830225E-7 evalInputDelta=8.176019975530352
END: th(2339360.772140841)=-210.0030215128887; dx=-1.6607304900257978E-6 evalInputDelta=5.544710145480565
Fitness changed from -204.45831136740813 to -212.63433134293848
Iteration 8 complete. Error: -212.63433134293848 Total: 16.3538; Orientation: 1.7432; Line Search: 11.5290
Adding measurement 2618fe9d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.787e+04, gradient 1.741e-03, dot -0.436; [dbb492d0-de29-41ab-b4d3-210e15521a5a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -212.63433134293848, -124.96295882493241, -110.64891330177078, -101.97989090178528
LBFGS Accumulation History: 3 points
Removed measurement 2618fe9d to history. Total: 3
th(0)=-212.63433134293848;dx=-3.0282007727038428E-6
New Minimum: -212.63433134293848 > -220.86724434897144
END: th(5040000.000000001)=-220.86724434897144; dx=-2.704947122917582E-7 evalInputDelta=8.232913006032959
Fitness changed from -212.63433134293848 to -220.86724434897144
Iteration 9 complete. Error: -220.86724434897144 Total: 10.7410; Orientation: 1.8330; Line Search: 6.1832
Adding measurement 1006e2cf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.171e+04, gradient 1.374e-03, dot -0.532; [dbb492d0-de29-41ab-b4d3-210e15521a5a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -220.86724434897144, -124.96295882493241, -110.64891330177078, -101.97989090178528
LBFGS Accumulation History: 3 points
Removed measurement 1006e2cf to history. Total: 3
th(0)=-220.86724434897144;dx=-1.8837330589802519E-6
New Minimum: -220.86724434897144 > -226.72480906018012
WOLF (strong): th(1.0858350837760696E7)=-226.72480906018012; dx=2.1819989583484306E-7 evalInputDelta=5.857564711208681
New Minimum: -226.72480906018012 > -226.79720320091255
END: th(5429175.418880348)=-226.79720320091255; dx=-4.4123218659802265E-7 evalInputDelta=5.929958851941109
Fitness changed from -220.86724434897144 to -226.79720320091255
Iteration 10 complete. Error: -226.79720320091255 Total: 13.5311; Orientation: 1.8961; Line Search: 8.9689
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -226.79720320091255 (> -Infinity) after 154.747s (< 5400.000s)
Returns
-226.79720320091255