BasicOptimizer.scala:89 executed in 87.58 seconds (0.909 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 303931918802100
Reset training subject: 303933651902700
Adding measurement 76d54faf to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-165.3980659457269;dx=-3.00974271041724E-5
New Minimum: -165.3980659457269 > -165.3981281640848
END: th(2.154434690031884)=-165.3981281640848; dx=-2.6003452467303118E-5 evalInputDelta=6.221835789688157E-5
Fitness changed from -165.3980659457269 to -165.3981281640848
Iteration 1 complete. Error: -165.3981281640848 Total: 8.5260; Orientation: 0.0632; Line Search: 3.2879
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7a323c79 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-165.3981281640848;dx=-2.5910003306481016E-5
New Minimum: -165.3981281640848 > -165.3982588225602
WOLFE (weak): th(4.641588833612779)=-165.3982588225602; dx=-2.5923115529244485E-5 evalInputDelta=1.3065847539905917E-4
New Minimum: -165.3982588225602 > -165.39839570275706
WOLFE (weak): th(9.283177667225559)=-165.39839570275706; dx=-2.5945278745488053E-5 evalInputDelta=2.675386722614803E-4
New Minimum: -165.39839570275706 > -165.39893077880333
WOLFE (weak): th(27.849533001676676)=-165.39893077880333; dx=-2.5942426994093824E-5 evalInputDelta=8.026147185375976E-4
New Minimum: -165.39893077880333 > -165.40133859959062
WOLFE (weak): th(111.3981320067067)=-165.40133859959062; dx=-2.5938760840689792E-5 evalInputDelta=0.0032104355058208967
New Minimum: -165.40133859959062 > -165.4141921609789
WOLFE (weak): th(556.9906600335335)=-165.4141921609789; dx=-2.593709953403546E-5 evalInputDelta=0.016063996894104093
New Minimum: -165.4141921609789 > -165.49450119269716
WOLFE (weak): th(3341.9439602012008)=-165.49450119269716; dx=-2.59274413514512E-5 evalInputDelta=0.09637302861236208
New Minimum: -165.49450119269716 > -166.07162068660546
WOLFE (weak): th(23393.607721408407)=-166.07162068660546; dx=-2.581192683280987E-5 evalInputDelta=0.6734925225206609
New Minimum: -166.07162068660546 > -170.63291043452273
WOLFE (weak): th(187148.86177126726)=-170.63291043452273; dx=-2.4243939779788882E-5 evalInputDelta=5.2347822704379325
New Minimum: -170.63291043452273 > -199.631276403575
END: th(1684339.7559414054)=-199.631276403575; dx=-1.1678777322236295E-5 evalInputDelta=34.23314823949019
Fitness changed from -165.3981281640848 to -199.631276403575
Iteration 2 complete. Error: -199.631276403575 Total: 18.5490; Orientation: 0.0645; Line Search: 16.6525
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 1c434357 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-199.631276403575;dx=-1.321517979739754E-5
New Minimum: -199.631276403575 > -231.64861781424702
END: th(3628800.0000000005)=-231.64861781424702; dx=-4.34602571289016E-6 evalInputDelta=32.01734141067203
Fitness changed from -199.631276403575 to -231.64861781424702
Iteration 3 complete. Error: -231.64861781424702 Total: 5.1606; Orientation: 0.0665; Line Search: 3.2588
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 28d3e142 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.334e+03, gradient 3.117e-03, dot -0.413; [b0b9b3d7-f9b3-4fbe-ac1d-d0804bc30b73 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -231.64861781424702, -199.631276403575, -165.3981281640848, -165.3980659457269
LBFGS Accumulation History: 3 points
Removed measurement 28d3e142 to history. Total: 3
th(0)=-231.64861781424702;dx=-9.672815620815405E-6
New Minimum: -231.64861781424702 > -252.79666125841482
WOLF (strong): th(7818012.603187701)=-252.79666125841482; dx=5.465127295976922E-7 evalInputDelta=21.148043444167797
END: th(3909006.3015938504)=-252.01013523014998; dx=-1.6489228725320095E-6 evalInputDelta=20.361517415902966
Fitness changed from -231.64861781424702 to -252.79666125841482
Iteration 4 complete. Error: -252.79666125841482 Total: 7.9492; Orientation: 1.1826; Line Search: 4.9882
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 22e9ac9e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.625e+03, gradient 3.798e-03, dot -0.126; [b0b9b3d7-f9b3-4fbe-ac1d-d0804bc30b73 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -252.79666125841482, -199.631276403575, -165.3981281640848, -165.3980659457269
LBFGS Accumulation History: 3 points
Removed measurement 22e9ac9e to history. Total: 3
th(0)=-252.79666125841482;dx=-1.4413786492868781E-5
New Minimum: -252.79666125841482 > -256.23078025965606
WOLF (strong): th(8421698.779707028)=-256.23078025965606; dx=5.6608087584726205E-6 evalInputDelta=3.4341190012412426
New Minimum: -256.23078025965606 > -278.8473957658231
WOLF (strong): th(4210849.389853514)=-278.8473957658231; dx=1.6962172956125367E-6 evalInputDelta=26.050734507408265
END: th(1403616.4632845046)=-270.54263476763356; dx=-8.420013694943648E-6 evalInputDelta=17.745973509218743
Fitness changed from -252.79666125841482 to -278.8473957658231
Iteration 5 complete. Error: -278.8473957658231 Total: 9.4357; Orientation: 1.1308; Line Search: 6.5081
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement de007db to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.275e+04, gradient 3.040e-03, dot -0.233; [b0b9b3d7-f9b3-4fbe-ac1d-d0804bc30b73 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -278.8473957658231, -199.631276403575, -165.3981281640848, -165.3980659457269
LBFGS Accumulation History: 3 points
Removed measurement de007db to history. Total: 3
th(0)=-278.8473957658231;dx=-9.229322993549955E-6
New Minimum: -278.8473957658231 > -294.9449857815775
END: th(3024000.0000000005)=-294.9449857815775; dx=-8.493796654866259E-7 evalInputDelta=16.097590015754406
Fitness changed from -278.8473957658231 to -294.9449857815775
Iteration 6 complete. Error: -294.9449857815775 Total: 6.5406; Orientation: 1.2338; Line Search: 3.3523
Adding measurement 2530b4c1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.223e+04, gradient 2.223e-03, dot -0.430; [b0b9b3d7-f9b3-4fbe-ac1d-d0804bc30b73 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -294.9449857815775, -199.631276403575, -165.3981281640848, -165.3980659457269
LBFGS Accumulation History: 3 points
Removed measurement 2530b4c1 to history. Total: 3
th(0)=-294.9449857815775;dx=-4.940653680283513E-6
New Minimum: -294.9449857815775 > -304.2668494879735
WOLF (strong): th(6515010.502656418)=-304.2668494879735; dx=9.699798402652055E-7 evalInputDelta=9.321863706396016
New Minimum: -304.2668494879735 > -305.0862721409225
END: th(3257505.251328209)=-305.0862721409225; dx=-1.1676328132396336E-6 evalInputDelta=10.141286359345031
Fitness changed from -294.9449857815775 to -305.0862721409225
Iteration 7 complete. Error: -305.0862721409225 Total: 7.7889; Orientation: 1.1956; Line Search: 4.9288
Adding measurement 796fe76c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.402e+04, gradient 2.081e-03, dot -0.443; [b0b9b3d7-f9b3-4fbe-ac1d-d0804bc30b73 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -305.0862721409225, -199.631276403575, -165.3981281640848, -165.3980659457269
LBFGS Accumulation History: 3 points
Removed measurement 796fe76c to history. Total: 3
th(0)=-305.0862721409225;dx=-4.309267497350295E-6
New Minimum: -305.0862721409225 > -311.20645541876786
WOLF (strong): th(7018082.316422524)=-311.20645541876786; dx=1.0562835759831357E-6 evalInputDelta=6.120183277845342
New Minimum: -311.20645541876786 > -313.33249232369525
END: th(3509041.158211262)=-313.33249232369525; dx=-5.654807524741471E-7 evalInputDelta=8.246220182772731
Fitness changed from -305.0862721409225 to -313.33249232369525
Iteration 8 complete. Error: -313.33249232369525 Total: 7.6048; Orientation: 1.0597; Line Search: 4.8126
Adding measurement 58ede621 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.540e+04, gradient 2.121e-03, dot -0.411; [b0b9b3d7-f9b3-4fbe-ac1d-d0804bc30b73 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -313.33249232369525, -199.631276403575, -165.3981281640848, -165.3980659457269
LBFGS Accumulation History: 3 points
Removed measurement 58ede621 to history. Total: 3
th(0)=-313.33249232369525;dx=-4.498569207215689E-6
New Minimum: -313.33249232369525 > -314.2354264667621
WOLF (strong): th(7560000.000000003)=-314.2354264667621; dx=1.921269092489049E-6 evalInputDelta=0.9029341430668296
New Minimum: -314.2354264667621 > -320.50176130469407
WOLF (strong): th(3780000.0000000014)=-320.50176130469407; dx=3.1167595306748304E-7 evalInputDelta=7.169268980998822
END: th(1260000.0000000005)=-318.13401129329935; dx=-2.6459145717643117E-6 evalInputDelta=4.801518969604103
Fitness changed from -313.33249232369525 to -320.50176130469407
Iteration 9 complete. Error: -320.50176130469407 Total: 9.3972; Orientation: 1.1535; Line Search: 6.6144
Adding measurement 4066899f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.415e+04, gradient 2.241e-03, dot -0.345; [b0b9b3d7-f9b3-4fbe-ac1d-d0804bc30b73 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -320.50176130469407, -199.631276403575, -165.3981281640848, -165.3980659457269
LBFGS Accumulation History: 3 points
Removed measurement 4066899f to history. Total: 3
th(0)=-320.50176130469407;dx=-5.022607360997465E-6
New Minimum: -320.50176130469407 > -327.8771450865737
END: th(2714587.7094401745)=-327.8771450865737; dx=-2.480796382871422E-7 evalInputDelta=7.375383781879634
Fitness changed from -320.50176130469407 to -327.8771450865737
Iteration 10 complete. Error: -327.8771450865737 Total: 6.3504; Orientation: 1.2234; Line Search: 3.4266
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -327.8771450865737 (> -Infinity) after 87.578s (< 5400.000s)
Returns
-327.8771450865737