BasicOptimizer.scala:89 executed in 219.34 seconds (3.516 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 697342672214800
Reset training subject: 697347249730100
Adding measurement 8e30a50 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-875.0332136553446;dx=-0.00697215828464954
New Minimum: -875.0332136553446 > -875.0484986559317
WOLFE (weak): th(2.154434690031884)=-875.0484986559317; dx=-0.006475402678068134 evalInputDelta=0.015285000587027753
New Minimum: -875.0484986559317 > -875.063783389531
WOLFE (weak): th(4.308869380063768)=-875.063783389531; dx=-0.0064757915471963905 evalInputDelta=0.030569734186315145
New Minimum: -875.063783389531 > -875.1249196543314
WOLFE (weak): th(12.926608140191302)=-875.1249196543314; dx=-0.006475368821285682 evalInputDelta=0.09170599898675391
New Minimum: -875.1249196543314 > -875.4000514050705
WOLFE (weak): th(51.70643256076521)=-875.4000514050705; dx=-0.006470791065974535 evalInputDelta=0.36683774972584615
New Minimum: -875.4000514050705 > -876.8663666716839
WOLFE (weak): th(258.53216280382605)=-876.8663666716839; dx=-0.006463551335409993 evalInputDelta=1.8331530163392245
New Minimum: -876.8663666716839 > -885.9925225418102
WOLFE (weak): th(1551.1929768229563)=-885.9925225418102; dx=-0.006422053692537328 evalInputDelta=10.959308886465578
New Minimum: -885.9925225418102 > -949.4679102002342
END: th(10858.350837760694)=-949.4679102002342; dx=-0.0060017353886317884 evalInputDelta=74.43469654488956
Fitness changed from -875.0332136553446 to -949.4679102002342
Iteration 1 complete. Error: -949.4679102002342 Total: 49.8410; Orientation: 0.1138; Line Search: 36.4571
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 40c86bbd to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-949.4679102002342;dx=-0.00583021504149208
New Minimum: -949.4679102002342 > -1084.8550594434264
END: th(23393.607721408407)=-1084.8550594434264; dx=-0.0046771350586122026 evalInputDelta=135.3871492431922
Fitness changed from -949.4679102002342 to -1084.8550594434264
Iteration 2 complete. Error: -1084.8550594434264 Total: 14.5016; Orientation: 0.0911; Line Search: 8.8492
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 17442e46 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1084.8550594434264;dx=-0.004403089088647755
New Minimum: -1084.8550594434264 > -1288.1586664693134
END: th(50400.00000000001)=-1288.1586664693134; dx=-0.002967970636614397 evalInputDelta=203.303607025887
Fitness changed from -1084.8550594434264 to -1288.1586664693134
Iteration 3 complete. Error: -1288.1586664693134 Total: 14.6595; Orientation: 0.0980; Line Search: 9.0514
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 560beeb7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.698e+04, gradient 5.460e-02, dot -0.809; [0f3b3fe9-3fd2-402e-b1a2-cd50f72be2b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1288.1586664693134, -1084.8550594434264, -949.4679102002342, -875.0332136553446
LBFGS Accumulation History: 3 points
Removed measurement 560beeb7 to history. Total: 3
th(0)=-1288.1586664693134;dx=-0.0029808417151872975
New Minimum: -1288.1586664693134 > -1558.8260807415304
END: th(108583.50837760697)=-1558.8260807415304; dx=-0.001666930222617368 evalInputDelta=270.667414272217
Fitness changed from -1288.1586664693134 to -1558.8260807415304
Iteration 4 complete. Error: -1558.8260807415304 Total: 16.4964; Orientation: 1.7154; Line Search: 9.3014
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 342e33b9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.773e+04, gradient 4.947e-02, dot -0.610; [0f3b3fe9-3fd2-402e-b1a2-cd50f72be2b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1558.8260807415304, -1084.8550594434264, -949.4679102002342, -875.0332136553446
LBFGS Accumulation History: 3 points
Removed measurement 342e33b9 to history. Total: 3
th(0)=-1558.8260807415304;dx=-0.0024450141976738535
New Minimum: -1558.8260807415304 > -1860.618983026885
END: th(233936.07721408413)=-1860.618983026885; dx=-5.77201145569556E-4 evalInputDelta=301.79290228535456
Fitness changed from -1558.8260807415304 to -1860.618983026885
Iteration 5 complete. Error: -1860.618983026885 Total: 16.8111; Orientation: 1.7168; Line Search: 9.5228
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 75f6c04d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.619e+04, gradient 5.588e-02, dot -0.351; [0f3b3fe9-3fd2-402e-b1a2-cd50f72be2b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1860.618983026885, -1084.8550594434264, -949.4679102002342, -875.0332136553446
LBFGS Accumulation History: 3 points
Removed measurement 75f6c04d to history. Total: 3
th(0)=-1860.618983026885;dx=-0.0031205758706857024
New Minimum: -1860.618983026885 > -1930.5321805139638
WOLF (strong): th(504000.0000000002)=-1930.5321805139638; dx=4.205688269944955E-4 evalInputDelta=69.91319748707883
New Minimum: -1930.5321805139638 > -2048.438429633656
WOLF (strong): th(252000.0000000001)=-2048.438429633656; dx=2.457607125682335E-4 evalInputDelta=187.81944660677118
END: th(84000.00000000003)=-2033.3109698223732; dx=-8.837674027388276E-4 evalInputDelta=172.69198679548822
Fitness changed from -1860.618983026885 to -2048.438429633656
Iteration 6 complete. Error: -2048.438429633656 Total: 25.6871; Orientation: 1.6226; Line Search: 18.4045
Adding measurement 49a641f5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.904e+04, gradient 6.252e-02, dot -0.268; [0f3b3fe9-3fd2-402e-b1a2-cd50f72be2b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2048.438429633656, -1084.8550594434264, -949.4679102002342, -875.0332136553446
LBFGS Accumulation History: 3 points
Removed measurement 49a641f5 to history. Total: 3
th(0)=-2048.438429633656;dx=-0.0039063903835241266
New Minimum: -2048.438429633656 > -2304.601158552169
WOLF (strong): th(180972.5139626783)=-2304.601158552169; dx=4.500310712931174E-4 evalInputDelta=256.16272891851304
END: th(90486.25698133915)=-2290.1451919037795; dx=-0.001074514781507861 evalInputDelta=241.70676227012336
Fitness changed from -2048.438429633656 to -2304.601158552169
Iteration 7 complete. Error: -2304.601158552169 Total: 20.4339; Orientation: 1.6502; Line Search: 14.2391
Adding measurement 796248ac to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.301e+04, gradient 5.826e-02, dot -0.278; [0f3b3fe9-3fd2-402e-b1a2-cd50f72be2b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2304.601158552169, -1084.8550594434264, -949.4679102002342, -875.0332136553446
LBFGS Accumulation History: 3 points
Removed measurement 796248ac to history. Total: 3
th(0)=-2304.601158552169;dx=-0.0033895056263058515
New Minimum: -2304.601158552169 > -2487.3895955398702
WOLF (strong): th(194946.7310117368)=-2487.3895955398702; dx=7.818802563466058E-4 evalInputDelta=182.78843698770106
New Minimum: -2487.3895955398702 > -2511.0615285173717
END: th(97473.3655058684)=-2511.0615285173717; dx=-6.612367013448475E-4 evalInputDelta=206.46036996520252
Fitness changed from -2304.601158552169 to -2511.0615285173717
Iteration 8 complete. Error: -2511.0615285173717 Total: 19.7189; Orientation: 1.6088; Line Search: 13.7742
Adding measurement 72228f71 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.479e+04, gradient 4.260e-02, dot -0.424; [0f3b3fe9-3fd2-402e-b1a2-cd50f72be2b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2511.0615285173717, -1084.8550594434264, -949.4679102002342, -875.0332136553446
LBFGS Accumulation History: 3 points
Removed measurement 72228f71 to history. Total: 3
th(0)=-2511.0615285173717;dx=-0.0018135290502031267
New Minimum: -2511.0615285173717 > -2680.265005554488
END: th(210000.0000000001)=-2680.265005554488; dx=-1.3302348201634938E-4 evalInputDelta=169.2034770371165
Fitness changed from -2511.0615285173717 to -2680.265005554488
Iteration 9 complete. Error: -2680.265005554488 Total: 15.4893; Orientation: 1.5960; Line Search: 9.3203
Adding measurement 15b68315 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.033e+04, gradient 5.389e-02, dot -0.327; [0f3b3fe9-3fd2-402e-b1a2-cd50f72be2b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2680.265005554488, -1084.8550594434264, -949.4679102002342, -875.0332136553446
LBFGS Accumulation History: 3 points
Removed measurement 15b68315 to history. Total: 3
th(0)=-2680.265005554488;dx=-0.0029036610796455468
Armijo: th(452431.2849066958)=-2493.654647299822; dx=9.008262596751227E-4 evalInputDelta=-186.61035825466615
New Minimum: -2680.265005554488 > -2743.782061316095
WOLF (strong): th(226215.6424533479)=-2743.782061316095; dx=8.555202150908703E-4 evalInputDelta=63.517055761607025
New Minimum: -2743.782061316095 > -2816.4166062569648
END: th(75405.21415111596)=-2816.4166062569648; dx=-5.874251638745785E-4 evalInputDelta=136.15160070247657
Fitness changed from -2680.265005554488 to -2816.4166062569648
Iteration 10 complete. Error: -2816.4166062569648 Total: 24.8101; Orientation: 1.7017; Line Search: 18.7510
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2816.4166062569648 (> -Infinity) after 219.337s (< 5400.000s)
Returns
-2816.4166062569648