BasicOptimizer.scala:89 executed in 133.73 seconds (1.860 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 331138798727200
Reset training subject: 331141400668300
Adding measurement 4c75accf to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-126.49545253505227;dx=-2.9612387959384657E-5
New Minimum: -126.49545253505227 > -126.49550209571585
END: th(2.154434690031884)=-126.49550209571585; dx=-2.1674265272281432E-5 evalInputDelta=4.9560663583747555E-5
Fitness changed from -126.49545253505227 to -126.49550209571585
Iteration 1 complete. Error: -126.49550209571585 Total: 12.7966; Orientation: 0.0599; Line Search: 5.2535
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement b6c28b2 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-126.49550209571585;dx=-2.1561370744813385E-5
New Minimum: -126.49550209571585 > -126.49562790346701
WOLFE (weak): th(4.641588833612779)=-126.49562790346701; dx=-2.1549736815678396E-5 evalInputDelta=1.2580775116077803E-4
New Minimum: -126.49562790346701 > -126.49572702463736
WOLFE (weak): th(9.283177667225559)=-126.49572702463736; dx=-2.1545441472422954E-5 evalInputDelta=2.2492892151149135E-4
New Minimum: -126.49572702463736 > -126.49618831829295
WOLFE (weak): th(27.849533001676676)=-126.49618831829295; dx=-2.153322898717518E-5 evalInputDelta=6.862225771016028E-4
New Minimum: -126.49618831829295 > -126.49821265320661
WOLFE (weak): th(111.3981320067067)=-126.49821265320661; dx=-2.1515300625056526E-5 evalInputDelta=0.002710557490757992
New Minimum: -126.49821265320661 > -126.5090314307114
WOLFE (weak): th(556.9906600335335)=-126.5090314307114; dx=-2.1513047703271714E-5 evalInputDelta=0.0135293349955532
New Minimum: -126.5090314307114 > -126.57658783567793
WOLFE (weak): th(3341.9439602012008)=-126.57658783567793; dx=-2.1488980728655145E-5 evalInputDelta=0.08108573996207724
New Minimum: -126.57658783567793 > -127.06110473324132
WOLFE (weak): th(23393.607721408407)=-127.06110473324132; dx=-2.134423679007841E-5 evalInputDelta=0.5656026375254726
New Minimum: -127.06110473324132 > -130.86886961491956
WOLFE (weak): th(187148.86177126726)=-130.86886961491956; dx=-1.9844802580844762E-5 evalInputDelta=4.373367519203711
New Minimum: -130.86886961491956 > -151.22931945020727
END: th(1684339.7559414054)=-151.22931945020727; dx=-5.646386594814004E-6 evalInputDelta=24.73381735449142
Fitness changed from -126.49550209571585 to -151.22931945020727
Iteration 2 complete. Error: -151.22931945020727 Total: 29.3672; Orientation: 0.0618; Line Search: 26.3344
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 1482b844 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-151.22931945020727;dx=-9.70081592741976E-6
New Minimum: -151.22931945020727 > -168.84462406854544
END: th(3628800.0000000005)=-168.84462406854544; dx=-1.030473130825409E-6 evalInputDelta=17.615304618338172
Fitness changed from -151.22931945020727 to -168.84462406854544
Iteration 3 complete. Error: -168.84462406854544 Total: 8.3780; Orientation: 0.0609; Line Search: 5.1220
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3777fdd5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.662e+03, gradient 3.090e-03, dot -0.316; [3f55133e-686d-49a0-b791-a28ef6e63ad2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -168.84462406854544, -151.22931945020727, -126.49550209571585, -126.49545253505227
LBFGS Accumulation History: 3 points
Removed measurement 3777fdd5 to history. Total: 3
th(0)=-168.84462406854544;dx=-9.522138647082569E-6
Armijo: th(7818012.603187701)=-165.80005993232743; dx=3.203512499595539E-6 evalInputDelta=-3.044564136218014
New Minimum: -168.84462406854544 > -179.01817509202365
WOLF (strong): th(3909006.3015938504)=-179.01817509202365; dx=1.747167693652084E-6 evalInputDelta=10.173551023478211
END: th(1303002.1005312835)=-178.23724652378255; dx=-3.7463336114696045E-6 evalInputDelta=9.392622455237102
Fitness changed from -168.84462406854544 to -179.01817509202365
Iteration 4 complete. Error: -179.01817509202365 Total: 14.1770; Orientation: 1.0384; Line Search: 10.2171
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 1aeb36f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.668e+03, gradient 3.243e-03, dot -0.212; [3f55133e-686d-49a0-b791-a28ef6e63ad2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -179.01817509202365, -151.22931945020727, -126.49550209571585, -126.49545253505227
LBFGS Accumulation History: 3 points
Removed measurement 1aeb36f to history. Total: 3
th(0)=-179.01817509202365;dx=-1.0499589042879139E-5
New Minimum: -179.01817509202365 > -193.01508239821777
WOLF (strong): th(2807232.926569009)=-193.01508239821777; dx=7.858555311782834E-7 evalInputDelta=13.996907306194117
END: th(1403616.4632845046)=-190.72469972535154; dx=-4.318601075035267E-6 evalInputDelta=11.706524633327888
Fitness changed from -179.01817509202365 to -193.01508239821777
Iteration 5 complete. Error: -193.01508239821777 Total: 11.9770; Orientation: 1.0349; Line Search: 7.9210
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 57101183 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.212e+04, gradient 2.543e-03, dot -0.355; [3f55133e-686d-49a0-b791-a28ef6e63ad2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -193.01508239821777, -151.22931945020727, -126.49550209571585, -126.49545253505227
LBFGS Accumulation History: 3 points
Removed measurement 57101183 to history. Total: 3
th(0)=-193.01508239821777;dx=-6.44343058262926E-6
New Minimum: -193.01508239821777 > -201.6886474658708
WOLF (strong): th(3024000.0000000005)=-201.6886474658708; dx=4.948754873567849E-7 evalInputDelta=8.673565067653016
END: th(1512000.0000000002)=-200.40283521136456; dx=-2.5315552467401146E-6 evalInputDelta=7.38775281314679
Fitness changed from -193.01508239821777 to -201.6886474658708
Iteration 6 complete. Error: -201.6886474658708 Total: 11.5853; Orientation: 1.0277; Line Search: 7.6596
Adding measurement 6559859e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.751e+04, gradient 2.421e-03, dot -0.404; [3f55133e-686d-49a0-b791-a28ef6e63ad2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -201.6886474658708, -151.22931945020727, -126.49550209571585, -126.49545253505227
LBFGS Accumulation History: 3 points
Removed measurement 6559859e to history. Total: 3
th(0)=-201.6886474658708;dx=-5.851480530433165E-6
New Minimum: -201.6886474658708 > -208.2832438789944
WOLF (strong): th(3257505.251328209)=-208.2832438789944; dx=1.3360102285366155E-6 evalInputDelta=6.594596413123611
New Minimum: -208.2832438789944 > -208.44616144483788
END: th(1628752.6256641045)=-208.44616144483788; dx=-1.756719183721891E-6 evalInputDelta=6.757513978967097
Fitness changed from -201.6886474658708 to -208.44616144483788
Iteration 7 complete. Error: -208.44616144483788 Total: 11.0710; Orientation: 0.9970; Line Search: 7.6260
Adding measurement 2c5e7379 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.309e+04, gradient 1.664e-03, dot -0.650; [3f55133e-686d-49a0-b791-a28ef6e63ad2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -208.44616144483788, -151.22931945020727, -126.49550209571585, -126.49545253505227
LBFGS Accumulation History: 3 points
Removed measurement 2c5e7379 to history. Total: 3
th(0)=-208.44616144483788;dx=-2.7614579793843877E-6
New Minimum: -208.44616144483788 > -215.4788988997114
END: th(3509041.158211262)=-215.4788988997114; dx=-1.2099257268520196E-6 evalInputDelta=7.032737454873512
Fitness changed from -208.44616144483788 to -215.4788988997114
Iteration 8 complete. Error: -215.4788988997114 Total: 8.8499; Orientation: 0.9690; Line Search: 5.2667
Adding measurement 353ec34f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.388e+04, gradient 1.857e-03, dot -0.522; [3f55133e-686d-49a0-b791-a28ef6e63ad2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -215.4788988997114, -151.22931945020727, -126.49550209571585, -126.49545253505227
LBFGS Accumulation History: 3 points
Removed measurement 353ec34f to history. Total: 3
th(0)=-215.4788988997114;dx=-3.442049164501136E-6
New Minimum: -215.4788988997114 > -215.7034790994282
WOLF (strong): th(7560000.000000003)=-215.7034790994282; dx=1.3025107844575862E-6 evalInputDelta=0.22458019971679732
New Minimum: -215.7034790994282 > -220.12507881227282
WOLF (strong): th(3780000.0000000014)=-220.12507881227282; dx=2.3498386929241042E-7 evalInputDelta=4.646179912561422
END: th(1260000.0000000005)=-218.91844503913873; dx=-1.7101533546521088E-6 evalInputDelta=3.4395461394273354
Fitness changed from -215.4788988997114 to -220.12507881227282
Iteration 9 complete. Error: -220.12507881227282 Total: 13.6144; Orientation: 0.9864; Line Search: 10.1606
Adding measurement 5c17309d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.236e+04, gradient 2.270e-03, dot -0.365; [3f55133e-686d-49a0-b791-a28ef6e63ad2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -220.12507881227282, -151.22931945020727, -126.49550209571585, -126.49545253505227
LBFGS Accumulation History: 3 points
Removed measurement 5c17309d to history. Total: 3
th(0)=-220.12507881227282;dx=-5.1520316638858696E-6
New Minimum: -220.12507881227282 > -226.08260736960654
WOLF (strong): th(2714587.7094401745)=-226.08260736960654; dx=8.052738202995159E-7 evalInputDelta=5.957528557333717
END: th(1357293.8547200873)=-225.5052034811159; dx=-2.03655989311573E-6 evalInputDelta=5.380124668843081
Fitness changed from -220.12507881227282 to -226.08260736960654
Iteration 10 complete. Error: -226.08260736960654 Total: 11.4751; Orientation: 0.9978; Line Search: 7.9582
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -226.08260736960654 (> -Infinity) after 133.726s (< 5400.000s)
Returns
-226.08260736960654