BasicOptimizer.scala:89 executed in 132.58 seconds (1.807 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 32061744120100
Reset training subject: 32064380151400
Adding measurement 2c98c1d1 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-71.9108762362728;dx=-4.7110020528108965E-6
New Minimum: -71.9108762362728 > -71.91088337404518
END: th(2.154434690031884)=-71.91088337404518; dx=-3.1987908822272542E-6 evalInputDelta=7.137772385590324E-6
Fitness changed from -71.9108762362728 to -71.91088337404518
Iteration 1 complete. Error: -71.91088337404518 Total: 13.0951; Orientation: 0.0633; Line Search: 5.2582
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2d76ada8 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-71.91088337404518;dx=-3.1713601260921087E-6
New Minimum: -71.91088337404518 > -71.91090002884468
WOLFE (weak): th(4.641588833612779)=-71.91090002884468; dx=-3.1699842255550844E-6 evalInputDelta=1.665479949508608E-5
New Minimum: -71.91090002884468 > -71.91091906289651
WOLFE (weak): th(9.283177667225559)=-71.91091906289651; dx=-3.168731080569539E-6 evalInputDelta=3.5688851326654E-5
New Minimum: -71.91091906289651 > -71.91098568203826
WOLFE (weak): th(27.849533001676676)=-71.91098568203826; dx=-3.165728208764437E-6 evalInputDelta=1.0230799307464622E-4
New Minimum: -71.91098568203826 > -71.91129260514413
WOLFE (weak): th(111.3981320067067)=-71.91129260514413; dx=-3.1642174046947374E-6 evalInputDelta=4.0923109894208665E-4
New Minimum: -71.91129260514413 > -71.91291523111266
WOLFE (weak): th(556.9906600335335)=-71.91291523111266; dx=-3.163314513144859E-6 evalInputDelta=0.0020318570674788816
New Minimum: -71.91291523111266 > -71.92305224574784
WOLFE (weak): th(3341.9439602012008)=-71.92305224574784; dx=-3.1627112402464937E-6 evalInputDelta=0.012168871702655792
New Minimum: -71.92305224574784 > -71.99598426006085
WOLFE (weak): th(23393.607721408407)=-71.99598426006085; dx=-3.158096504506526E-6 evalInputDelta=0.08510088601566679
New Minimum: -71.99598426006085 > -72.58662710960354
WOLFE (weak): th(187148.86177126726)=-72.58662710960354; dx=-3.104272466445183E-6 evalInputDelta=0.6757437355583562
New Minimum: -72.58662710960354 > -77.46847525846312
END: th(1684339.7559414054)=-77.46847525846312; dx=-2.530126359473385E-6 evalInputDelta=5.557591884417931
Fitness changed from -71.91088337404518 to -77.46847525846312
Iteration 2 complete. Error: -77.46847525846312 Total: 28.8879; Orientation: 0.0622; Line Search: 25.8149
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 41fb2347 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-77.46847525846312;dx=-2.4662870624802375E-6
New Minimum: -77.46847525846312 > -85.30164380161008
END: th(3628800.0000000005)=-85.30164380161008; dx=-1.3961662796777355E-6 evalInputDelta=7.833168543146968
Fitness changed from -77.46847525846312 to -85.30164380161008
Iteration 3 complete. Error: -85.30164380161008 Total: 8.4280; Orientation: 0.0613; Line Search: 5.3086
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3d6127ad to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.027e+04, gradient 1.221e-03, dot -0.696; [8918c8e4-f83c-43a2-ae08-fceaea175fc0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.30164380161008, -77.46847525846312, -71.91088337404518, -71.9108762362728
LBFGS Accumulation History: 3 points
Removed measurement 3d6127ad to history. Total: 3
th(0)=-85.30164380161008;dx=-1.4891428854997036E-6
New Minimum: -85.30164380161008 > -94.61082916821687
END: th(7818012.603187701)=-94.61082916821687; dx=-6.564461000356206E-7 evalInputDelta=9.309185366606783
Fitness changed from -85.30164380161008 to -94.61082916821687
Iteration 4 complete. Error: -94.61082916821687 Total: 9.2304; Orientation: 1.0743; Line Search: 5.0124
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 8b89fc2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.259e+04, gradient 1.156e-03, dot -0.507; [8918c8e4-f83c-43a2-ae08-fceaea175fc0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.61082916821687, -77.46847525846312, -71.91088337404518, -71.9108762362728
LBFGS Accumulation History: 3 points
Removed measurement 8b89fc2 to history. Total: 3
th(0)=-94.61082916821687;dx=-1.336687687805868E-6
New Minimum: -94.61082916821687 > -98.35194246761438
WOLF (strong): th(1.6843397559414055E7)=-98.35194246761438; dx=2.585609627578447E-7 evalInputDelta=3.7411132993975116
New Minimum: -98.35194246761438 > -99.92769906095067
END: th(8421698.779707028)=-99.92769906095067; dx=-5.678363278380841E-8 evalInputDelta=5.316869892733806
Fitness changed from -94.61082916821687 to -99.92769906095067
Iteration 5 complete. Error: -99.92769906095067 Total: 12.2834; Orientation: 1.0535; Line Search: 7.9712
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 71b78582 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.149e+04, gradient 1.391e-03, dot -0.327; [8918c8e4-f83c-43a2-ae08-fceaea175fc0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -99.92769906095067, -77.46847525846312, -71.91088337404518, -71.9108762362728
LBFGS Accumulation History: 3 points
Removed measurement 71b78582 to history. Total: 3
th(0)=-99.92769906095067;dx=-1.935129808329515E-6
Armijo: th(1.8144000000000004E7)=-93.36815835247785; dx=8.419646107814378E-7 evalInputDelta=-6.559540708472824
New Minimum: -99.92769906095067 > -102.89146080364704
WOLF (strong): th(9072000.000000002)=-102.89146080364704; dx=7.686473471062189E-7 evalInputDelta=2.963761742696363
New Minimum: -102.89146080364704 > -104.66852572322301
END: th(3024000.0000000005)=-104.66852572322301; dx=-7.443165029636428E-7 evalInputDelta=4.74082666227234
Fitness changed from -99.92769906095067 to -104.66852572322301
Iteration 6 complete. Error: -104.66852572322301 Total: 14.8117; Orientation: 1.0174; Line Search: 10.6630
Adding measurement 2af491a1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.133e+04, gradient 8.937e-04, dot -0.664; [8918c8e4-f83c-43a2-ae08-fceaea175fc0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.66852572322301, -77.46847525846312, -71.91088337404518, -71.9108762362728
LBFGS Accumulation History: 3 points
Removed measurement 2af491a1 to history. Total: 3
th(0)=-104.66852572322301;dx=-7.982685582411815E-7
New Minimum: -104.66852572322301 > -108.97966939563082
END: th(6515010.502656418)=-108.97966939563082; dx=-4.1590547718132543E-7 evalInputDelta=4.311143672407809
Fitness changed from -104.66852572322301 to -108.97966939563082
Iteration 7 complete. Error: -108.97966939563082 Total: 8.8547; Orientation: 1.0221; Line Search: 5.3883
Adding measurement 11be3e08 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.458e+04, gradient 9.362e-04, dot -0.584; [8918c8e4-f83c-43a2-ae08-fceaea175fc0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -108.97966939563082, -77.46847525846312, -71.91088337404518, -71.9108762362728
LBFGS Accumulation History: 3 points
Removed measurement 11be3e08 to history. Total: 3
th(0)=-108.97966939563082;dx=-8.75799531207562E-7
New Minimum: -108.97966939563082 > -112.04926943369303
WOLF (strong): th(1.4036164632845048E7)=-112.04926943369303; dx=1.1808293279651773E-7 evalInputDelta=3.0696000380622053
New Minimum: -112.04926943369303 > -112.37298715331481
END: th(7018082.316422524)=-112.37298715331481; dx=-1.284785209233745E-7 evalInputDelta=3.393317757683988
Fitness changed from -108.97966939563082 to -112.37298715331481
Iteration 8 complete. Error: -112.37298715331481 Total: 11.0134; Orientation: 1.0298; Line Search: 7.5236
Adding measurement 3f99c0bf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.541e+04, gradient 1.096e-03, dot -0.449; [8918c8e4-f83c-43a2-ae08-fceaea175fc0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -112.37298715331481, -77.46847525846312, -71.91088337404518, -71.9108762362728
LBFGS Accumulation History: 3 points
Removed measurement 3f99c0bf to history. Total: 3
th(0)=-112.37298715331481;dx=-1.2009087753585037E-6
Armijo: th(1.5120000000000006E7)=-110.17347728493222; dx=5.881306078211433E-7 evalInputDelta=-2.1995098683825915
New Minimum: -112.37298715331481 > -115.00346203363638
WOLF (strong): th(7560000.000000003)=-115.00346203363638; dx=3.4584352989777E-7 evalInputDelta=2.6304748803215716
END: th(2520000.000000001)=-114.9678044612823; dx=-5.972588471811218E-7 evalInputDelta=2.5948173079674888
Fitness changed from -112.37298715331481 to -115.00346203363638
Iteration 9 complete. Error: -115.00346203363638 Total: 14.2162; Orientation: 0.9910; Line Search: 10.6671
Adding measurement 14e0b02e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.370e+04, gradient 1.312e-03, dot -0.315; [8918c8e4-f83c-43a2-ae08-fceaea175fc0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -115.00346203363638, -77.46847525846312, -71.91088337404518, -71.9108762362728
LBFGS Accumulation History: 3 points
Removed measurement 14e0b02e to history. Total: 3
th(0)=-115.00346203363638;dx=-1.721609173904385E-6
New Minimum: -115.00346203363638 > -119.26560528640276
WOLF (strong): th(5429175.418880349)=-119.26560528640276; dx=3.5461366137016607E-7 evalInputDelta=4.2621432527663785
END: th(2714587.7094401745)=-118.89777170057923; dx=-7.204797741632862E-7 evalInputDelta=3.8943096669428456
Fitness changed from -115.00346203363638 to -119.26560528640276
Iteration 10 complete. Error: -119.26560528640276 Total: 11.2507; Orientation: 1.0314; Line Search: 7.6968
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -119.26560528640276 (> -Infinity) after 132.575s (< 5400.000s)
Returns
-119.26560528640276