BasicOptimizer.scala:89 executed in 320.06 seconds (4.946 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 661239136395300
Reset training subject: 661245252899700
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -43.809323097504304 > -43.94285196601716
th(0)=-43.94285196601716;dx=-2.0569740577623235E-6
New Minimum: -43.94285196601716 > -43.94285712229917
WOLFE (weak): th(2.154434690031884)=-43.94285712229917; dx=-1.980563987460836E-6 evalInputDelta=5.156282014695535E-6
New Minimum: -43.94285712229917 > -43.942862278580584
WOLFE (weak): th(4.308869380063768)=-43.942862278580584; dx=-1.980377101085644E-6 evalInputDelta=1.0312563425429744E-5
New Minimum: -43.942862278580584 > -43.94288118494057
WOLFE (weak): th(12.926608140191302)=-43.94288118494057; dx=-1.9804854258184484E-6 evalInputDelta=2.9218923408791397E-5
New Minimum: -43.94288118494057 > -43.94296712283799
WOLFE (weak): th(51.70643256076521)=-43.94296712283799; dx=-1.980510953156859E-6 evalInputDelta=1.1515682083285128E-4
New Minimum: -43.94296712283799 > -43.94341227845658
WOLFE (weak): th(258.53216280382605)=-43.94341227845658; dx=-1.980109612600618E-6 evalInputDelta=5.603124394184533E-4
New Minimum: -43.94341227845658 > -43.946203421717314
WOLFE (weak): th(1551.1929768229563)=-43.946203421717314; dx=-1.980074360246895E-6 evalInputDelta=0.0033514557001552703
New Minimum: -43.946203421717314 > -43.96630507311731
WOLFE (weak): th(10858.350837760694)=-43.96630507311731; dx=-1.979137640455741E-6 evalInputDelta=0.023453107100152693
New Minimum: -43.96630507311731 > -44.130095307769004
WOLFE (weak): th(86866.80670208555)=-44.130095307769004; dx=-1.9705911959594577E-6 evalInputDelta=0.1872433417518451
New Minimum: -44.130095307769004 > -45.59044942901494
WOLFE (weak): th(781801.26031877)=-45.59044942901494; dx=-1.8806899301302507E-6 evalInputDelta=1.6475974629977799
New Minimum: -45.59044942901494 > -56.293781938396926
END: th(7818012.6031877)=-56.293781938396926; dx=-9.290654928787674E-7 evalInputDelta=12.350929972379767
Fitness changed from -43.809323097504304 to -56.293781938396926
Iteration 1 complete. Error: -56.293781938396926 Total: 85.8483; Orientation: 0.0907; Line Search: 66.7771
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4a8f919f to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-56.293781938396926;dx=-9.412828146462677E-7
New Minimum: -56.293781938396926 > -67.44012412574062
END: th(1.684339755941405E7)=-67.44012412574062; dx=-3.5101997552499006E-7 evalInputDelta=11.146342187343699
Fitness changed from -56.293781938396926 to -67.44012412574062
Iteration 2 complete. Error: -67.44012412574062 Total: 19.8888; Orientation: 0.1379; Line Search: 12.4894
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 1a442d6b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-67.44012412574062;dx=-6.939726807504255E-7
New Minimum: -67.44012412574062 > -75.46887452516474
END: th(3.6288E7)=-75.46887452516474; dx=-9.827756379794226E-9 evalInputDelta=8.028750399424112
Fitness changed from -67.44012412574062 to -75.46887452516474
Iteration 3 complete. Error: -75.46887452516474 Total: 19.6207; Orientation: 0.1550; Line Search: 12.4760
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 40ea04ec to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-75.46887452516474;dx=-9.188125229158848E-7
Armijo: th(7.8180126031877E7)=-66.72085051567407; dx=2.651943783184953E-7 evalInputDelta=-8.748024009490663
New Minimum: -75.46887452516474 > -81.06565572711729
WOLF (strong): th(3.90900630159385E7)=-81.06565572711729; dx=3.1924529356301356E-7 evalInputDelta=5.5967812019525525
New Minimum: -81.06565572711729 > -84.67514990323271
END: th(1.3030021005312832E7)=-84.67514990323271; dx=-3.1490230533486695E-7 evalInputDelta=9.206275378067971
Fitness changed from -75.46887452516474 to -84.67514990323271
Iteration 4 complete. Error: -84.67514990323271 Total: 32.2858; Orientation: 0.1447; Line Search: 24.9850
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement ce4d65b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.770e+04, gradient 6.564e-04, dot -0.657; [58802390-9fb7-49da-841c-1be5a05dbf9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -84.67514990323271, -75.46887452516474, -67.44012412574062, -56.293781938396926
LBFGS Accumulation History: 3 points
Removed measurement ce4d65b to history. Total: 3
th(0)=-84.67514990323271;dx=-4.3064714098267676E-7
New Minimum: -84.67514990323271 > -91.74188618520098
END: th(2.807232926569009E7)=-91.74188618520098; dx=-6.289464201962107E-8 evalInputDelta=7.066736281968275
Fitness changed from -84.67514990323271 to -91.74188618520098
Iteration 5 complete. Error: -91.74188618520098 Total: 22.0867; Orientation: 2.7844; Line Search: 12.1984
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6428c588 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.151e+04, gradient 7.119e-04, dot -0.562; [58802390-9fb7-49da-841c-1be5a05dbf9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.74188618520098, -75.46887452516474, -67.44012412574062, -56.293781938396926
LBFGS Accumulation History: 3 points
Removed measurement 6428c588 to history. Total: 3
th(0)=-91.74188618520098;dx=-5.065212631756741E-7
Armijo: th(6.048000000000001E7)=-89.3409277281554; dx=1.8475217338064436E-7 evalInputDelta=-2.4009584570455758
New Minimum: -91.74188618520098 > -95.67253762400252
WOLF (strong): th(3.0240000000000004E7)=-95.67253762400252; dx=1.2683915707369698E-7 evalInputDelta=3.930651438801533
New Minimum: -95.67253762400252 > -95.84347443069655
END: th(1.0080000000000002E7)=-95.84347443069655; dx=-2.2290784193148677E-7 evalInputDelta=4.101588245495563
Fitness changed from -91.74188618520098 to -95.84347443069655
Iteration 6 complete. Error: -95.84347443069655 Total: 34.3822; Orientation: 2.6158; Line Search: 24.6921
Adding measurement 79c621ba to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.596e+04, gradient 5.015e-04, dot -0.740; [58802390-9fb7-49da-841c-1be5a05dbf9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -95.84347443069655, -75.46887452516474, -67.44012412574062, -56.293781938396926
LBFGS Accumulation History: 3 points
Removed measurement 79c621ba to history. Total: 3
th(0)=-95.84347443069655;dx=-2.513187902356142E-7
New Minimum: -95.84347443069655 > -100.33706624852195
END: th(2.1716701675521392E7)=-100.33706624852195; dx=-1.4623665046607844E-7 evalInputDelta=4.493591817825404
Fitness changed from -95.84347443069655 to -100.33706624852195
Iteration 7 complete. Error: -100.33706624852195 Total: 21.1900; Orientation: 2.7220; Line Search: 12.4173
Adding measurement 4accf656 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.133e+04, gradient 5.163e-04, dot -0.687; [58802390-9fb7-49da-841c-1be5a05dbf9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -100.33706624852195, -75.46887452516474, -67.44012412574062, -56.293781938396926
LBFGS Accumulation History: 3 points
Removed measurement 4accf656 to history. Total: 3
th(0)=-100.33706624852195;dx=-2.662260874825487E-7
New Minimum: -100.33706624852195 > -104.46029649492543
END: th(4.678721544281682E7)=-104.46029649492543; dx=-8.289059331813807E-10 evalInputDelta=4.12323024640348
Fitness changed from -100.33706624852195 to -104.46029649492543
Iteration 8 complete. Error: -104.46029649492543 Total: 21.1365; Orientation: 2.5577; Line Search: 12.3607
Adding measurement 6347b0d9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.958e+04, gradient 7.406e-04, dot -0.426; [58802390-9fb7-49da-841c-1be5a05dbf9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.46029649492543, -75.46887452516474, -67.44012412574062, -56.293781938396926
LBFGS Accumulation History: 3 points
Removed measurement 6347b0d9 to history. Total: 3
th(0)=-104.46029649492543;dx=-5.47447086978444E-7
Armijo: th(1.0080000000000003E8)=-87.5456837421551; dx=2.030295930731205E-7 evalInputDelta=-16.914612752770324
Armijo: th(5.0400000000000015E7)=-102.79717534249093; dx=2.927018620031709E-7 evalInputDelta=-1.663121152434499
New Minimum: -104.46029649492543 > -110.60560865071554
END: th(1.6800000000000004E7)=-110.60560865071554; dx=-8.115604853781837E-8 evalInputDelta=6.1453121557901085
Fitness changed from -104.46029649492543 to -110.60560865071554
Iteration 9 complete. Error: -110.60560865071554 Total: 32.5011; Orientation: 2.5419; Line Search: 23.9935
Adding measurement 1053bb92 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.782e+04, gradient 4.898e-04, dot -0.584; [58802390-9fb7-49da-841c-1be5a05dbf9b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -110.60560865071554, -75.46887452516474, -67.44012412574062, -56.293781938396926
LBFGS Accumulation History: 3 points
Removed measurement 1053bb92 to history. Total: 3
th(0)=-110.60560865071554;dx=-2.397295939789829E-7
New Minimum: -110.60560865071554 > -113.69577009200225
WOLF (strong): th(3.6194502792535655E7)=-113.69577009200225; dx=2.591099383211716E-8 evalInputDelta=3.0901614412867104
END: th(1.8097251396267828E7)=-113.56119512605024; dx=-7.225663632251584E-8 evalInputDelta=2.955586475334698
Fitness changed from -110.60560865071554 to -113.69577009200225
Iteration 10 complete. Error: -113.69577009200225 Total: 29.8417; Orientation: 2.8962; Line Search: 20.8174
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -113.69577009200225 (> -Infinity) after 320.063s (< 5400.000s)
Returns
-113.69577009200225