BasicOptimizer.scala:89 executed in 91.24 seconds (0.922 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 280970581393799
Reset training subject: 280972443759200
Adding measurement 286cd3ad to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-49.40637257722802;dx=-2.9287386702980886E-6
New Minimum: -49.40637257722802 > -49.40637637066519
WOLFE (weak): th(2.154434690031884)=-49.40637637066519; dx=-2.7026065270320295E-6 evalInputDelta=3.793437173271741E-6
New Minimum: -49.40637637066519 > -49.40638206082041
WOLFE (weak): th(4.308869380063768)=-49.40638206082041; dx=-2.7026019241254134E-6 evalInputDelta=9.483592393166873E-6
New Minimum: -49.40638206082041 > -49.40640671815213
WOLFE (weak): th(12.926608140191302)=-49.40640671815213; dx=-2.702606664292576E-6 evalInputDelta=3.4140924107362025E-5
New Minimum: -49.40640671815213 > -49.40651103749629
WOLFE (weak): th(51.70643256076521)=-49.40651103749629; dx=-2.7025972876372095E-6 evalInputDelta=1.3846026826769275E-4
New Minimum: -49.40651103749629 > -49.407068668073116
WOLFE (weak): th(258.53216280382605)=-49.407068668073116; dx=-2.702544076244111E-6 evalInputDelta=6.960908450963643E-4
New Minimum: -49.407068668073116 > -49.410564147666165
WOLFE (weak): th(1551.1929768229563)=-49.410564147666165; dx=-2.701982703601879E-6 evalInputDelta=0.00419157043814522
New Minimum: -49.410564147666165 > -49.435687151039396
WOLFE (weak): th(10858.350837760694)=-49.435687151039396; dx=-2.69682087780092E-6 evalInputDelta=0.029314573811376476
New Minimum: -49.435687151039396 > -49.63849964822599
END: th(86866.80670208555)=-49.63849964822599; dx=-2.6353032931884657E-6 evalInputDelta=0.2321270709979686
Fitness changed from -49.40637257722802 to -49.63849964822599
Iteration 1 complete. Error: -49.63849964822599 Total: 22.1757; Orientation: 0.0656; Line Search: 16.7444
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6880c06b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-49.63849964822599;dx=-2.5984594214265055E-6
New Minimum: -49.63849964822599 > -50.110386147900606
WOLFE (weak): th(187148.86177126726)=-50.110386147900606; dx=-2.4481064318491095E-6 evalInputDelta=0.4718864996746177
New Minimum: -50.110386147900606 > -50.555500253735104
END: th(374297.7235425345)=-50.555500253735104; dx=-2.3083487795281958E-6 evalInputDelta=0.9170006055091164
Fitness changed from -49.63849964822599 to -50.555500253735104
Iteration 2 complete. Error: -50.555500253735104 Total: 7.6703; Orientation: 0.0605; Line Search: 5.5673
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 177244f5 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-50.555500253735104;dx=-2.1783121755502277E-6
New Minimum: -50.555500253735104 > -52.13655299082894
END: th(806400.0000000001)=-52.13655299082894; dx=-1.7475209457024345E-6 evalInputDelta=1.5810527370938345
Fitness changed from -50.555500253735104 to -52.13655299082894
Iteration 3 complete. Error: -52.13655299082894 Total: 5.7900; Orientation: 0.0601; Line Search: 3.6521
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement de58d71 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.298e+03, gradient 1.276e-03, dot -0.923; [a01c332f-26b6-4130-889e-f944be7a35b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -52.13655299082894, -50.555500253735104, -49.63849964822599, -49.40637257722802
LBFGS Accumulation History: 3 points
Removed measurement de58d71 to history. Total: 3
th(0)=-52.13655299082894;dx=-1.6290530233188962E-6
New Minimum: -52.13655299082894 > -54.60126904911107
END: th(1737336.1340417115)=-54.60126904911107; dx=-1.2296610114204265E-6 evalInputDelta=2.4647160582821286
Fitness changed from -52.13655299082894 to -54.60126904911107
Iteration 4 complete. Error: -54.60126904911107 Total: 6.8469; Orientation: 1.0715; Line Search: 3.5300
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2e1bbf2a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.105e+03, gradient 1.156e-03, dot -0.795; [a01c332f-26b6-4130-889e-f944be7a35b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -54.60126904911107, -50.555500253735104, -49.63849964822599, -49.40637257722802
LBFGS Accumulation History: 3 points
Removed measurement 2e1bbf2a to history. Total: 3
th(0)=-54.60126904911107;dx=-1.3359968385247475E-6
New Minimum: -54.60126904911107 > -58.91052626541402
END: th(3742977.235425346)=-58.91052626541402; dx=-1.0085916760226158E-6 evalInputDelta=4.309257216302953
Fitness changed from -54.60126904911107 to -58.91052626541402
Iteration 5 complete. Error: -58.91052626541402 Total: 6.9623; Orientation: 1.0750; Line Search: 3.7966
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 3b82fb7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.928e+04, gradient 1.165e-03, dot -0.815; [a01c332f-26b6-4130-889e-f944be7a35b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -58.91052626541402, -50.555500253735104, -49.63849964822599, -49.40637257722802
LBFGS Accumulation History: 3 points
Removed measurement 3b82fb7 to history. Total: 3
th(0)=-58.91052626541402;dx=-1.3579577208788197E-6
New Minimum: -58.91052626541402 > -65.32670496690842
END: th(8064000.000000003)=-65.32670496690842; dx=-4.905311206136149E-7 evalInputDelta=6.4161787014944025
Fitness changed from -58.91052626541402 to -65.32670496690842
Iteration 6 complete. Error: -65.32670496690842 Total: 6.6084; Orientation: 1.0476; Line Search: 3.5714
Adding measurement 749bbb99 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.472e+04, gradient 1.517e-03, dot -0.437; [a01c332f-26b6-4130-889e-f944be7a35b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.32670496690842, -50.555500253735104, -49.63849964822599, -49.40637257722802
LBFGS Accumulation History: 3 points
Removed measurement 749bbb99 to history. Total: 3
th(0)=-65.32670496690842;dx=-2.3022805521208247E-6
Armijo: th(1.7373361340417117E7)=-64.57471614281577; dx=4.236190279248983E-7 evalInputDelta=-0.7519888240926491
New Minimum: -65.32670496690842 > -68.92953816279201
WOLF (strong): th(8686680.670208558)=-68.92953816279201; dx=5.3669251453968E-7 evalInputDelta=3.6028331958835906
New Minimum: -68.92953816279201 > -69.88417847255201
END: th(2895560.2234028527)=-69.88417847255201; dx=-7.503702860680392E-7 evalInputDelta=4.5574735056435856
Fitness changed from -65.32670496690842 to -69.88417847255201
Iteration 7 complete. Error: -69.88417847255201 Total: 10.1301; Orientation: 0.9976; Line Search: 7.2455
Adding measurement 35d65a43 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.371e+04, gradient 1.113e-03, dot -0.748; [a01c332f-26b6-4130-889e-f944be7a35b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.88417847255201, -50.555500253735104, -49.63849964822599, -49.40637257722802
LBFGS Accumulation History: 3 points
Removed measurement 35d65a43 to history. Total: 3
th(0)=-69.88417847255201;dx=-1.2387860053921481E-6
New Minimum: -69.88417847255201 > -74.76129058868962
END: th(6238295.392375577)=-74.76129058868962; dx=-4.4899061671826346E-7 evalInputDelta=4.87711211613761
Fitness changed from -69.88417847255201 to -74.76129058868962
Iteration 8 complete. Error: -74.76129058868962 Total: 6.4009; Orientation: 0.9950; Line Search: 3.5785
Adding measurement 7d29d8fc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.018e+04, gradient 1.320e-03, dot -0.556; [a01c332f-26b6-4130-889e-f944be7a35b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.76129058868962, -50.555500253735104, -49.63849964822599, -49.40637257722802
LBFGS Accumulation History: 3 points
Removed measurement 7d29d8fc to history. Total: 3
th(0)=-74.76129058868962;dx=-1.7425078278922175E-6
New Minimum: -74.76129058868962 > -76.40071259529168
WOLF (strong): th(1.3440000000000006E7)=-76.40071259529168; dx=3.5285139613584854E-7 evalInputDelta=1.6394220066020608
New Minimum: -76.40071259529168 > -78.5598014761853
WOLF (strong): th(6720000.000000003)=-78.5598014761853; dx=1.9709750308848716E-7 evalInputDelta=3.7985108874956808
END: th(2240000.000000001)=-77.7173628923893; dx=-8.479545692776778E-7 evalInputDelta=2.9560723036996848
Fitness changed from -74.76129058868962 to -78.5598014761853
Iteration 9 complete. Error: -78.5598014761853 Total: 10.1001; Orientation: 1.0666; Line Search: 7.2667
Adding measurement 370efa14 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.599e+04, gradient 1.533e-03, dot -0.422; [a01c332f-26b6-4130-889e-f944be7a35b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -78.5598014761853, -50.555500253735104, -49.63849964822599, -49.40637257722802
LBFGS Accumulation History: 3 points
Removed measurement 370efa14 to history. Total: 3
th(0)=-78.5598014761853;dx=-2.3497573875725854E-6
New Minimum: -78.5598014761853 > -84.27916265643597
WOLF (strong): th(4825933.705671422)=-84.27916265643597; dx=8.985718564747027E-8 evalInputDelta=5.719361180250672
END: th(2412966.852835711)=-82.97751480316259; dx=-1.233122748473892E-6 evalInputDelta=4.417713326977292
Fitness changed from -78.5598014761853 to -84.27916265643597
Iteration 10 complete. Error: -84.27916265643597 Total: 8.2596; Orientation: 1.0738; Line Search: 5.4783
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -84.27916265643597 (> -Infinity) after 91.236s (< 5400.000s)
Returns
-84.27916265643597