BasicOptimizer.scala:89 executed in 307.75 seconds (4.260 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 659340867163300
Reset training subject: 659347101094100
Adding measurement 1213a05e to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-35.80486090229349;dx=-2.004422808643632E-6
New Minimum: -35.80486090229349 > -35.804863011706736
END: th(2.154434690031884)=-35.804863011706736; dx=-1.7967340324518894E-6 evalInputDelta=2.109413244966163E-6
Fitness changed from -35.80486090229349 to -35.804863011706736
Iteration 1 complete. Error: -35.804863011706736 Total: 30.9716; Orientation: 0.1441; Line Search: 12.4371
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 488ed502 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-35.804863011706736;dx=-1.7943647212651793E-6
New Minimum: -35.804863011706736 > -35.80487355877111
WOLFE (weak): th(4.641588833612779)=-35.80487355877111; dx=-1.7937396378495181E-6 evalInputDelta=1.0547064377419701E-5
New Minimum: -35.80487355877111 > -35.804884105832386
WOLFE (weak): th(9.283177667225559)=-35.804884105832386; dx=-1.7938282470489275E-6 evalInputDelta=2.1094125649767648E-5
New Minimum: -35.804884105832386 > -35.80492207522724
WOLFE (weak): th(27.849533001676676)=-35.80492207522724; dx=-1.7934847362530811E-6 evalInputDelta=5.906352050288888E-5
New Minimum: -35.80492207522724 > -35.805088718206264
WOLFE (weak): th(111.3981320067067)=-35.805088718206264; dx=-1.79264626098518E-6 evalInputDelta=2.2570649952768918E-4
New Minimum: -35.805088718206264 > -35.805976764546784
WOLFE (weak): th(556.9906600335335)=-35.805976764546784; dx=-1.7926808034318891E-6 evalInputDelta=0.001113752840048221
New Minimum: -35.805976764546784 > -35.81152813701414
WOLFE (weak): th(3341.9439602012008)=-35.81152813701414; dx=-1.792284449103711E-6 evalInputDelta=0.006665125307407038
New Minimum: -35.81152813701414 > -35.85146758754198
WOLFE (weak): th(23393.607721408407)=-35.85146758754198; dx=-1.7892509571430019E-6 evalInputDelta=0.046604575835246465
New Minimum: -35.85146758754198 > -36.17543397355304
WOLFE (weak): th(187148.86177126726)=-36.17543397355304; dx=-1.7676602553093633E-6 evalInputDelta=0.37057096184630467
New Minimum: -36.17543397355304 > -38.909852987717265
END: th(1684339.7559414054)=-38.909852987717265; dx=-1.5064041063167458E-6 evalInputDelta=3.104989976010529
Fitness changed from -35.804863011706736 to -38.909852987717265
Iteration 2 complete. Error: -38.909852987717265 Total: 67.1587; Orientation: 0.1467; Line Search: 60.0240
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement cd4085c to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-38.909852987717265;dx=-1.404624057955878E-6
New Minimum: -38.909852987717265 > -43.51606851164409
END: th(3628800.0000000005)=-43.51606851164409; dx=-9.077210140082114E-7 evalInputDelta=4.606215523926828
Fitness changed from -38.909852987717265 to -43.51606851164409
Iteration 3 complete. Error: -43.51606851164409 Total: 19.9860; Orientation: 0.1488; Line Search: 12.5044
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1d468cc3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.396e+03, gradient 9.300e-04, dot -0.786; [3bf6b486-b724-4bc2-9826-29567e97ac84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -43.51606851164409, -38.909852987717265, -35.804863011706736, -35.80486090229349
LBFGS Accumulation History: 3 points
Removed measurement 1d468cc3 to history. Total: 3
th(0)=-43.51606851164409;dx=-8.646668668577416E-7
New Minimum: -43.51606851164409 > -49.21771408668508
END: th(7818012.603187701)=-49.21771408668508; dx=-4.77786046508269E-7 evalInputDelta=5.701645575040985
Fitness changed from -43.51606851164409 to -49.21771408668508
Iteration 4 complete. Error: -49.21771408668508 Total: 22.4819; Orientation: 2.6084; Line Search: 12.6316
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 527c125d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.670e+03, gradient 8.232e-04, dot -0.603; [3bf6b486-b724-4bc2-9826-29567e97ac84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -49.21771408668508, -38.909852987717265, -35.804863011706736, -35.80486090229349
LBFGS Accumulation History: 3 points
Removed measurement 527c125d to history. Total: 3
th(0)=-49.21771408668508;dx=-6.770449966595784E-7
New Minimum: -49.21771408668508 > -55.30060549852294
END: th(1.6843397559414055E7)=-55.30060549852294; dx=-1.4910221066010088E-7 evalInputDelta=6.082891411837863
Fitness changed from -49.21771408668508 to -55.30060549852294
Iteration 5 complete. Error: -55.30060549852294 Total: 21.9764; Orientation: 2.5886; Line Search: 12.3341
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1e396cd9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.145e+04, gradient 1.000e-03, dot -0.340; [3bf6b486-b724-4bc2-9826-29567e97ac84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -55.30060549852294, -38.909852987717265, -35.804863011706736, -35.80486090229349
LBFGS Accumulation History: 3 points
Removed measurement 1e396cd9 to history. Total: 3
th(0)=-55.30060549852294;dx=-9.99648778039398E-7
Armijo: th(3.628800000000001E7)=-52.96226400170803; dx=2.0260914250368962E-7 evalInputDelta=-2.3383414968149125
New Minimum: -55.30060549852294 > -58.34769609895289
WOLF (strong): th(1.8144000000000004E7)=-58.34769609895289; dx=2.711675152366275E-7 evalInputDelta=3.0470906004299465
New Minimum: -58.34769609895289 > -59.860828464462706
END: th(6048000.000000001)=-59.860828464462706; dx=-3.2113036577285437E-7 evalInputDelta=4.560222965939765
Fitness changed from -55.30060549852294 to -59.860828464462706
Iteration 6 complete. Error: -59.860828464462706 Total: 34.1204; Orientation: 2.5320; Line Search: 24.5885
Adding measurement 61a88930 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.053e+04, gradient 7.159e-04, dot -0.620; [3bf6b486-b724-4bc2-9826-29567e97ac84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.860828464462706, -38.909852987717265, -35.804863011706736, -35.80486090229349
LBFGS Accumulation History: 3 points
Removed measurement 61a88930 to history. Total: 3
th(0)=-59.860828464462706;dx=-5.125022717380029E-7
New Minimum: -59.860828464462706 > -64.12382180841205
END: th(1.3030021005312836E7)=-64.12382180841205; dx=-1.4655271778188426E-7 evalInputDelta=4.26299334394934
Fitness changed from -59.860828464462706 to -64.12382180841205
Iteration 7 complete. Error: -64.12382180841205 Total: 21.2516; Orientation: 2.5594; Line Search: 12.3531
Adding measurement c14f464 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.684e+04, gradient 8.457e-04, dot -0.481; [3bf6b486-b724-4bc2-9826-29567e97ac84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.12382180841205, -38.909852987717265, -35.804863011706736, -35.80486090229349
LBFGS Accumulation History: 3 points
Removed measurement c14f464 to history. Total: 3
th(0)=-64.12382180841205;dx=-7.150169051404798E-7
New Minimum: -64.12382180841205 > -64.13956987769336
WOLF (strong): th(2.8072329265690096E7)=-64.13956987769336; dx=1.743667971087509E-7 evalInputDelta=0.015748069281315225
New Minimum: -64.13956987769336 > -67.08119916643588
WOLF (strong): th(1.4036164632845048E7)=-67.08119916643588; dx=1.2807496122859683E-7 evalInputDelta=2.957377358023834
END: th(4678721.544281683)=-66.85908162438615; dx=-3.252676090198051E-7 evalInputDelta=2.7352598159741035
Fitness changed from -64.12382180841205 to -67.08119916643588
Iteration 8 complete. Error: -67.08119916643588 Total: 33.7811; Orientation: 2.5326; Line Search: 25.1680
Adding measurement 4c301c2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.724e+04, gradient 9.819e-04, dot -0.345; [3bf6b486-b724-4bc2-9826-29567e97ac84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.08119916643588, -38.909852987717265, -35.804863011706736, -35.80486090229349
LBFGS Accumulation History: 3 points
Removed measurement 4c301c2 to history. Total: 3
th(0)=-67.08119916643588;dx=-9.629445896110741E-7
New Minimum: -67.08119916643588 > -72.31133082096302
WOLF (strong): th(1.0080000000000004E7)=-72.31133082096302; dx=8.039124824109262E-8 evalInputDelta=5.230131654527142
END: th(5040000.000000002)=-71.27983865014458; dx=-4.971200514968128E-7 evalInputDelta=4.198639483708703
Fitness changed from -67.08119916643588 to -72.31133082096302
Iteration 9 complete. Error: -72.31133082096302 Total: 26.5053; Orientation: 2.5755; Line Search: 18.2035
Adding measurement 8caa9a9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.113e+04, gradient 7.650e-04, dot -0.505; [3bf6b486-b724-4bc2-9826-29567e97ac84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.31133082096302, -38.909852987717265, -35.804863011706736, -35.80486090229349
LBFGS Accumulation History: 3 points
Removed measurement 8caa9a9 to history. Total: 3
th(0)=-72.31133082096302;dx=-5.846652093638114E-7
New Minimum: -72.31133082096302 > -75.51395191394978
WOLF (strong): th(1.0858350837760698E7)=-75.51395191394978; dx=6.0064879744450005E-9 evalInputDelta=3.2026210929867602
END: th(5429175.418880349)=-74.86496939212283; dx=-2.631175322352919E-7 evalInputDelta=2.5536385711598086
Fitness changed from -72.31133082096302 to -75.51395191394978
Iteration 10 complete. Error: -75.51395191394978 Total: 28.3095; Orientation: 2.5057; Line Search: 19.7527
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -75.51395191394978 (> -Infinity) after 307.754s (< 5400.000s)
Returns
-75.51395191394978