BasicOptimizer.scala:89 executed in 112.29 seconds (1.116 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 40265841181800
Reset training subject: 40268235151900
Adding measurement 16a3060c to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-74.11750671998264;dx=-1.7918161090638564E-6
New Minimum: -74.11750671998264 > -74.11750907980115
END: th(2.154434690031884)=-74.11750907980115; dx=-1.5513197347434655E-6 evalInputDelta=2.3598185094897417E-6
Fitness changed from -74.11750671998264 to -74.11750907980115
Iteration 1 complete. Error: -74.11750907980115 Total: 11.5722; Orientation: 0.0672; Line Search: 4.7314
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2c27e36 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-74.11750907980115;dx=-1.5132105399548573E-6
New Minimum: -74.11750907980115 > -74.11751615925625
WOLFE (weak): th(4.641588833612779)=-74.11751615925625; dx=-1.5121156151714694E-6 evalInputDelta=7.079455102143584E-6
New Minimum: -74.11751615925625 > -74.11752559852866
WOLFE (weak): th(9.283177667225559)=-74.11752559852866; dx=-1.512165394354857E-6 evalInputDelta=1.6518727505854258E-5
New Minimum: -74.11752559852866 > -74.11755627615565
WOLFE (weak): th(27.849533001676676)=-74.11755627615565; dx=-1.5130321649976633E-6 evalInputDelta=4.719635450101123E-5
New Minimum: -74.11755627615565 > -74.11769550522634
WOLFE (weak): th(111.3981320067067)=-74.11769550522634; dx=-1.5128187356960714E-6 evalInputDelta=1.8642542518421124E-4
New Minimum: -74.11769550522634 > -74.11843648266024
WOLFE (weak): th(556.9906600335335)=-74.11843648266024; dx=-1.5127745805055112E-6 evalInputDelta=9.274028590908756E-4
New Minimum: -74.11843648266024 > -74.12308512111116
WOLFE (weak): th(3341.9439602012008)=-74.12308512111116; dx=-1.5116720913977251E-6 evalInputDelta=0.00557604131000744
New Minimum: -74.12308512111116 > -74.15654907415893
WOLFE (weak): th(23393.607721408407)=-74.15654907415893; dx=-1.5113581182804235E-6 evalInputDelta=0.03903999435777905
New Minimum: -74.15654907415893 > -74.42661194520923
WOLFE (weak): th(187148.86177126726)=-74.42661194520923; dx=-1.4723827251407536E-6 evalInputDelta=0.30910286540807874
New Minimum: -74.42661194520923 > -76.60361349620604
END: th(1684339.7559414054)=-76.60361349620604; dx=-1.192683078185439E-6 evalInputDelta=2.486104416404885
Fitness changed from -74.11750907980115 to -76.60361349620604
Iteration 2 complete. Error: -76.60361349620604 Total: 26.1887; Orientation: 0.0645; Line Search: 23.4942
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4f7ef133 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-76.60361349620604;dx=-1.1279471195197256E-6
New Minimum: -76.60361349620604 > -80.43732650434849
END: th(3628800.0000000005)=-80.43732650434849; dx=-8.336118938628735E-7 evalInputDelta=3.8337130081424533
Fitness changed from -76.60361349620604 to -80.43732650434849
Iteration 3 complete. Error: -80.43732650434849 Total: 7.9591; Orientation: 0.0677; Line Search: 4.5867
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4854fd1c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.437e+03, gradient 8.713e-04, dot -0.898; [28a74496-4775-402f-90d6-a526d67e3be1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.43732650434849, -76.60361349620604, -74.11750907980115, -74.11750671998264
LBFGS Accumulation History: 3 points
Removed measurement 4854fd1c to history. Total: 3
th(0)=-80.43732650434849;dx=-7.579052855896023E-7
New Minimum: -80.43732650434849 > -85.62220951925455
END: th(7818012.603187701)=-85.62220951925455; dx=-4.833942101983483E-7 evalInputDelta=5.184883014906063
Fitness changed from -80.43732650434849 to -85.62220951925455
Iteration 4 complete. Error: -85.62220951925455 Total: 8.5285; Orientation: 1.1184; Line Search: 4.5482
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 779b12b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.731e+03, gradient 6.808e-04, dot -0.791; [28a74496-4775-402f-90d6-a526d67e3be1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.62220951925455, -76.60361349620604, -74.11750907980115, -74.11750671998264
LBFGS Accumulation History: 3 points
Removed measurement 779b12b to history. Total: 3
th(0)=-85.62220951925455;dx=-4.6225453919375423E-7
New Minimum: -85.62220951925455 > -91.95383889363795
END: th(1.6843397559414055E7)=-91.95383889363795; dx=-2.67118634911241E-7 evalInputDelta=6.331629374383397
Fitness changed from -85.62220951925455 to -91.95383889363795
Iteration 5 complete. Error: -91.95383889363795 Total: 7.9425; Orientation: 1.1296; Line Search: 4.2954
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4c7c286 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.090e+04, gradient 5.748e-04, dot -0.650; [28a74496-4775-402f-90d6-a526d67e3be1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.95383889363795, -76.60361349620604, -74.11750907980115, -74.11750671998264
LBFGS Accumulation History: 3 points
Removed measurement 4c7c286 to history. Total: 3
th(0)=-91.95383889363795;dx=-3.297367495129026E-7
New Minimum: -91.95383889363795 > -99.28509199547402
END: th(3.628800000000001E7)=-99.28509199547402; dx=-1.1166265081881117E-7 evalInputDelta=7.331253101836069
Fitness changed from -91.95383889363795 to -99.28509199547402
Iteration 6 complete. Error: -99.28509199547402 Total: 8.1907; Orientation: 1.0863; Line Search: 4.3585
Adding measurement 78e4c48b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.828e+04, gradient 6.368e-04, dot -0.444; [28a74496-4775-402f-90d6-a526d67e3be1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -99.28509199547402, -76.60361349620604, -74.11750907980115, -74.11750671998264
LBFGS Accumulation History: 3 points
Removed measurement 78e4c48b to history. Total: 3
th(0)=-99.28509199547402;dx=-4.051793654689722E-7
Armijo: th(7.818012603187701E7)=-93.76099307580013; dx=1.61265600254772E-7 evalInputDelta=-5.524098919673889
New Minimum: -99.28509199547402 > -101.18594787033064
WOLF (strong): th(3.9090063015938506E7)=-101.18594787033064; dx=1.2767600825989667E-7 evalInputDelta=1.9008558748566173
New Minimum: -101.18594787033064 > -102.76433580341435
END: th(1.3030021005312836E7)=-102.76433580341435; dx=-1.1722620334741995E-7 evalInputDelta=3.4792438079403354
Fitness changed from -99.28509199547402 to -102.76433580341435
Iteration 7 complete. Error: -102.76433580341435 Total: 12.7520; Orientation: 1.0846; Line Search: 9.2831
Adding measurement 60af2b3b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.151e+04, gradient 4.735e-04, dot -0.630; [28a74496-4775-402f-90d6-a526d67e3be1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -102.76433580341435, -76.60361349620604, -74.11750907980115, -74.11750671998264
LBFGS Accumulation History: 3 points
Removed measurement 60af2b3b to history. Total: 3
th(0)=-102.76433580341435;dx=-2.2303433045990015E-7
New Minimum: -102.76433580341435 > -106.30735899246446
END: th(2.8072329265690096E7)=-106.30735899246446; dx=-5.9566448007356993E-8 evalInputDelta=3.5430231890501034
Fitness changed from -102.76433580341435 to -106.30735899246446
Iteration 8 complete. Error: -106.30735899246446 Total: 7.6206; Orientation: 1.1034; Line Search: 4.4311
Adding measurement 4243ed7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.560e+04, gradient 5.788e-04, dot -0.454; [28a74496-4775-402f-90d6-a526d67e3be1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -106.30735899246446, -76.60361349620604, -74.11750907980115, -74.11750671998264
LBFGS Accumulation History: 3 points
Removed measurement 4243ed7 to history. Total: 3
th(0)=-106.30735899246446;dx=-3.340722007980303E-7
Armijo: th(6.048000000000002E7)=-102.73534001581011; dx=1.4801846979731288E-7 evalInputDelta=-3.5720189766543484
New Minimum: -106.30735899246446 > -107.86153775762713
WOLF (strong): th(3.024000000000001E7)=-107.86153775762713; dx=1.0388630161577674E-7 evalInputDelta=1.5541787651626748
New Minimum: -107.86153775762713 > -108.66098741902074
END: th(1.0080000000000004E7)=-108.66098741902074; dx=-1.1854534955055863E-7 evalInputDelta=2.353628426556284
Fitness changed from -106.30735899246446 to -108.66098741902074
Iteration 9 complete. Error: -108.66098741902074 Total: 12.4884; Orientation: 1.0943; Line Search: 9.2846
Adding measurement 68caf7f4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.925e+04, gradient 4.037e-04, dot -0.684; [28a74496-4775-402f-90d6-a526d67e3be1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -108.66098741902074, -76.60361349620604, -74.11750907980115, -74.11750671998264
LBFGS Accumulation History: 3 points
Removed measurement 68caf7f4 to history. Total: 3
th(0)=-108.66098741902074;dx=-1.6190700272102793E-7
New Minimum: -108.66098741902074 > -111.21820148322722
END: th(2.1716701675521396E7)=-111.21820148322722; dx=-8.954526031757117E-8 evalInputDelta=2.5572140642064767
Fitness changed from -108.66098741902074 to -111.21820148322722
Iteration 10 complete. Error: -111.21820148322722 Total: 8.5552; Orientation: 1.1211; Line Search: 4.6618
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -111.21820148322722 (> -Infinity) after 112.291s (< 5400.000s)
Returns
-111.21820148322722