BasicOptimizer.scala:89 executed in 130.55 seconds (1.597 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 26779445889500
Reset training subject: 26782070413000
Adding measurement 95d1a98 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-70.12554131333874;dx=-4.569751979764284E-6
New Minimum: -70.12554131333874 > -70.12554863283255
END: th(2.154434690031884)=-70.12554863283255; dx=-3.1764122516010553E-6 evalInputDelta=7.3194938039478075E-6
Fitness changed from -70.12554131333874 to -70.12554863283255
Iteration 1 complete. Error: -70.12554863283255 Total: 12.6341; Orientation: 0.0629; Line Search: 5.1140
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 66b1dc56 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-70.12554863283255;dx=-3.1457524181749856E-6
New Minimum: -70.12554863283255 > -70.12556571164848
WOLFE (weak): th(4.641588833612779)=-70.12556571164848; dx=-3.1441531590831146E-6 evalInputDelta=1.707881592949434E-5
New Minimum: -70.12556571164848 > -70.12558523029014
WOLFE (weak): th(9.283177667225559)=-70.12558523029014; dx=-3.1437485847874036E-6 evalInputDelta=3.6597457594211846E-5
New Minimum: -70.12558523029014 > -70.12565354549322
WOLFE (weak): th(27.849533001676676)=-70.12565354549322; dx=-3.1417830337672694E-6 evalInputDelta=1.0491266067447214E-4
New Minimum: -70.12565354549322 > -70.12595852326663
WOLFE (weak): th(111.3981320067067)=-70.12595852326663; dx=-3.139829215758407E-6 evalInputDelta=4.09890434085014E-4
New Minimum: -70.12595852326663 > -70.12758342248456
WOLFE (weak): th(556.9906600335335)=-70.12758342248456; dx=-3.139403886949019E-6 evalInputDelta=0.002034789652014979
New Minimum: -70.12758342248456 > -70.13776136407807
WOLFE (weak): th(3341.9439602012008)=-70.13776136407807; dx=-3.1376501198671704E-6 evalInputDelta=0.012212731245526243
New Minimum: -70.13776136407807 > -70.21096146157679
WOLFE (weak): th(23393.607721408407)=-70.21096146157679; dx=-3.132578006513569E-6 evalInputDelta=0.08541282874423928
New Minimum: -70.21096146157679 > -70.80320683167977
WOLFE (weak): th(187148.86177126726)=-70.80320683167977; dx=-3.0773638184906576E-6 evalInputDelta=0.6776581988472259
New Minimum: -70.80320683167977 > -75.63149892874978
END: th(1684339.7559414054)=-75.63149892874978; dx=-2.4308063211784335E-6 evalInputDelta=5.505950295917231
Fitness changed from -70.12554863283255 to -75.63149892874978
Iteration 2 complete. Error: -75.63149892874978 Total: 28.9498; Orientation: 0.0624; Line Search: 25.9381
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4e7b754 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-75.63149892874978;dx=-2.383762107987959E-6
New Minimum: -75.63149892874978 > -83.20047134634997
END: th(3628800.0000000005)=-83.20047134634997; dx=-1.3354871243626826E-6 evalInputDelta=7.568972417600193
Fitness changed from -75.63149892874978 to -83.20047134634997
Iteration 3 complete. Error: -83.20047134634997 Total: 8.4061; Orientation: 0.0618; Line Search: 5.4839
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 740c7c1b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.249e+03, gradient 1.213e-03, dot -0.683; [5082f71b-dfd2-4a8c-b954-f242891e76b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -83.20047134634997, -75.63149892874978, -70.12554863283255, -70.12554131333874
LBFGS Accumulation History: 3 points
Removed measurement 740c7c1b to history. Total: 3
th(0)=-83.20047134634997;dx=-1.4702401075771486E-6
New Minimum: -83.20047134634997 > -92.17119351802135
END: th(7818012.603187701)=-92.17119351802135; dx=-6.138025171781229E-7 evalInputDelta=8.970722171671383
Fitness changed from -83.20047134634997 to -92.17119351802135
Iteration 4 complete. Error: -92.17119351802135 Total: 9.3355; Orientation: 1.0647; Line Search: 5.2117
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2b0f24ef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.281e+04, gradient 1.220e-03, dot -0.490; [5082f71b-dfd2-4a8c-b954-f242891e76b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -92.17119351802135, -75.63149892874978, -70.12554863283255, -70.12554131333874
LBFGS Accumulation History: 3 points
Removed measurement 2b0f24ef to history. Total: 3
th(0)=-92.17119351802135;dx=-1.4876137826985622E-6
New Minimum: -92.17119351802135 > -94.07517207649552
WOLF (strong): th(1.6843397559414055E7)=-94.07517207649552; dx=3.55353750451796E-7 evalInputDelta=1.903978558474165
New Minimum: -94.07517207649552 > -96.93435708761864
WOLF (strong): th(8421698.779707028)=-96.93435708761864; dx=8.563016709448884E-8 evalInputDelta=4.763163569597282
END: th(2807232.926569009)=-95.68853927256067; dx=-7.114573656081706E-7 evalInputDelta=3.5173457545393205
Fitness changed from -92.17119351802135 to -96.93435708761864
Iteration 5 complete. Error: -96.93435708761864 Total: 14.2415; Orientation: 1.0353; Line Search: 10.2950
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 155143be to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.011e+04, gradient 1.480e-03, dot -0.282; [5082f71b-dfd2-4a8c-b954-f242891e76b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -96.93435708761864, -75.63149892874978, -70.12554863283255, -70.12554131333874
LBFGS Accumulation History: 3 points
Removed measurement 155143be to history. Total: 3
th(0)=-96.93435708761864;dx=-2.1884204292969413E-6
New Minimum: -96.93435708761864 > -102.9194197245938
WOLF (strong): th(6048000.000000001)=-102.9194197245938; dx=4.223776126036063E-7 evalInputDelta=5.985062636975158
END: th(3024000.0000000005)=-102.48442468787158; dx=-8.816041261764877E-7 evalInputDelta=5.5500676002529445
Fitness changed from -96.93435708761864 to -102.9194197245938
Iteration 6 complete. Error: -102.9194197245938 Total: 11.4280; Orientation: 1.0190; Line Search: 7.5441
Adding measurement 618cc0f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.888e+04, gradient 1.307e-03, dot -0.375; [5082f71b-dfd2-4a8c-b954-f242891e76b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -102.9194197245938, -75.63149892874978, -70.12554863283255, -70.12554131333874
LBFGS Accumulation History: 3 points
Removed measurement 618cc0f to history. Total: 3
th(0)=-102.9194197245938;dx=-1.706876229920844E-6
New Minimum: -102.9194197245938 > -106.77352435305804
WOLF (strong): th(6515010.502656418)=-106.77352435305804; dx=4.914588918208592E-7 evalInputDelta=3.854104628464242
New Minimum: -106.77352435305804 > -107.15193809577445
END: th(3257505.251328209)=-107.15193809577445; dx=-4.866002630748019E-7 evalInputDelta=4.23251837118066
Fitness changed from -102.9194197245938 to -107.15193809577445
Iteration 7 complete. Error: -107.15193809577445 Total: 11.3645; Orientation: 1.0904; Line Search: 7.8750
Adding measurement 52a13648 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.649e+04, gradient 8.468e-04, dot -0.680; [5082f71b-dfd2-4a8c-b954-f242891e76b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -107.15193809577445, -75.63149892874978, -70.12554863283255, -70.12554131333874
LBFGS Accumulation History: 3 points
Removed measurement 52a13648 to history. Total: 3
th(0)=-107.15193809577445;dx=-7.14671226032133E-7
New Minimum: -107.15193809577445 > -111.29263586874993
END: th(7018082.316422524)=-111.29263586874993; dx=-3.7281320724774025E-7 evalInputDelta=4.1406977729754715
Fitness changed from -107.15193809577445 to -111.29263586874993
Iteration 8 complete. Error: -111.29263586874993 Total: 8.7613; Orientation: 1.0578; Line Search: 5.2217
Adding measurement 1e1e0e94 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.937e+04, gradient 9.428e-04, dot -0.563; [5082f71b-dfd2-4a8c-b954-f242891e76b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -111.29263586874993, -75.63149892874978, -70.12554863283255, -70.12554131333874
LBFGS Accumulation History: 3 points
Removed measurement 1e1e0e94 to history. Total: 3
th(0)=-111.29263586874993;dx=-8.883276162869875E-7
New Minimum: -111.29263586874993 > -112.54936812383613
WOLF (strong): th(1.5120000000000006E7)=-112.54936812383613; dx=2.3638243833896697E-7 evalInputDelta=1.256732255086206
New Minimum: -112.54936812383613 > -114.15055954582179
WOLF (strong): th(7560000.000000003)=-114.15055954582179; dx=1.500849189183962E-8 evalInputDelta=2.8579236770718666
END: th(2520000.000000001)=-113.21678822443437; dx=-4.7363138798027307E-7 evalInputDelta=1.9241523556844413
Fitness changed from -111.29263586874993 to -114.15055954582179
Iteration 9 complete. Error: -114.15055954582179 Total: 13.7502; Orientation: 1.0678; Line Search: 10.2689
Adding measurement 58b969f3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.764e+04, gradient 1.171e-03, dot -0.391; [5082f71b-dfd2-4a8c-b954-f242891e76b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -114.15055954582179, -75.63149892874978, -70.12554863283255, -70.12554131333874
LBFGS Accumulation History: 3 points
Removed measurement 58b969f3 to history. Total: 3
th(0)=-114.15055954582179;dx=-1.3709561862973687E-6
New Minimum: -114.15055954582179 > -117.69367414312195
WOLF (strong): th(5429175.418880349)=-117.69367414312195; dx=2.2404265569820032E-7 evalInputDelta=3.5431145973001605
END: th(2714587.7094401745)=-117.2890226072046; dx=-6.02977565270049E-7 evalInputDelta=3.138463061382808
Fitness changed from -114.15055954582179 to -117.69367414312195
Iteration 10 complete. Error: -117.69367414312195 Total: 11.1995; Orientation: 1.0565; Line Search: 7.6478
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -117.69367414312195 (> -Infinity) after 130.548s (< 5400.000s)
Returns
-117.69367414312195