BasicOptimizer.scala:89 executed in 136.67 seconds (1.686 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 112053102077100
Reset training subject: 112055814183100
Adding measurement 1290fed2 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-28.397651612725685;dx=-1.3165234444857579E-6
New Minimum: -28.397651612725685 > -28.397654590599103
END: th(2.154434690031884)=-28.397654590599103; dx=-9.696296374408515E-7 evalInputDelta=2.9778734180752053E-6
Fitness changed from -28.397651612725685 to -28.397654590599103
Iteration 1 complete. Error: -28.397654590599103 Total: 15.1004; Orientation: 0.0625; Line Search: 6.1311
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6bbe2457 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-28.397654590599103;dx=-9.694458249270157E-7
New Minimum: -28.397654590599103 > -28.397659057408653
WOLFE (weak): th(4.641588833612779)=-28.397659057408653; dx=-9.689671705170978E-7 evalInputDelta=4.466809549796835E-6
New Minimum: -28.397659057408653 > -28.39766501315362
WOLFE (weak): th(9.283177667225559)=-28.39766501315362; dx=-9.681720827771807E-7 evalInputDelta=1.042255451721985E-5
New Minimum: -28.39766501315362 > -28.397685858251176
WOLFE (weak): th(27.849533001676676)=-28.397685858251176; dx=-9.678983938095444E-7 evalInputDelta=3.1267652072841656E-5
New Minimum: -28.397685858251176 > -28.397773705279903
WOLFE (weak): th(111.3981320067067)=-28.397773705279903; dx=-9.674328876038286E-7 evalInputDelta=1.1911468079972565E-4
New Minimum: -28.397773705279903 > -28.39824569229034
WOLFE (weak): th(556.9906600335335)=-28.39824569229034; dx=-9.672831246461288E-7 evalInputDelta=5.911016912385492E-4
New Minimum: -28.39824569229034 > -28.40118910620325
WOLFE (weak): th(3341.9439602012008)=-28.40118910620325; dx=-9.668768372181823E-7 evalInputDelta=0.0035345156041479697
New Minimum: -28.40118910620325 > -28.422367630131866
WOLFE (weak): th(23393.607721408407)=-28.422367630131866; dx=-9.653402666497146E-7 evalInputDelta=0.024713039532763048
New Minimum: -28.422367630131866 > -28.594111736920937
WOLFE (weak): th(187148.86177126726)=-28.594111736920937; dx=-9.518470762365519E-7 evalInputDelta=0.19645714632183342
New Minimum: -28.594111736920937 > -30.02841975934704
END: th(1684339.7559414054)=-30.02841975934704; dx=-7.98547808180625E-7 evalInputDelta=1.6307651687479385
Fitness changed from -28.397654590599103 to -30.02841975934704
Iteration 2 complete. Error: -30.02841975934704 Total: 31.3621; Orientation: 0.0655; Line Search: 27.3817
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 368bdfc8 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-30.02841975934704;dx=-7.954920804814924E-7
New Minimum: -30.02841975934704 > -32.529944632974136
END: th(3628800.0000000005)=-32.529944632974136; dx=-5.152032083154846E-7 evalInputDelta=2.501524873627094
Fitness changed from -30.02841975934704 to -32.529944632974136
Iteration 3 complete. Error: -32.529944632974136 Total: 8.6565; Orientation: 0.0623; Line Search: 5.4647
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4b782ff3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.711e+03, gradient 7.232e-04, dot -0.786; [481ba968-2de7-47ad-89ef-4265c462cfc1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -32.529944632974136, -30.02841975934704, -28.397654590599103, -28.397651612725685
LBFGS Accumulation History: 3 points
Removed measurement 4b782ff3 to history. Total: 3
th(0)=-32.529944632974136;dx=-5.224806723475129E-7
New Minimum: -32.529944632974136 > -35.90159697967612
END: th(7818012.603187701)=-35.90159697967612; dx=-2.876222214031653E-7 evalInputDelta=3.3716523467019854
Fitness changed from -32.529944632974136 to -35.90159697967612
Iteration 4 complete. Error: -35.90159697967612 Total: 9.5020; Orientation: 1.1265; Line Search: 5.3827
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 36e7e010 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.176e+03, gradient 6.516e-04, dot -0.604; [481ba968-2de7-47ad-89ef-4265c462cfc1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -35.90159697967612, -30.02841975934704, -28.397654590599103, -28.397651612725685
LBFGS Accumulation History: 3 points
Removed measurement 36e7e010 to history. Total: 3
th(0)=-35.90159697967612;dx=-4.241843912043717E-7
New Minimum: -35.90159697967612 > -39.61491117472793
END: th(1.6843397559414055E7)=-39.61491117472793; dx=-1.0169454813895373E-7 evalInputDelta=3.713314195051808
Fitness changed from -35.90159697967612 to -39.61491117472793
Iteration 5 complete. Error: -39.61491117472793 Total: 9.6913; Orientation: 1.1133; Line Search: 5.3981
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 10064f56 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.022e+04, gradient 7.289e-04, dot -0.349; [481ba968-2de7-47ad-89ef-4265c462cfc1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -39.61491117472793, -30.02841975934704, -28.397654590599103, -28.397651612725685
LBFGS Accumulation History: 3 points
Removed measurement 10064f56 to history. Total: 3
th(0)=-39.61491117472793;dx=-5.307642597958732E-7
New Minimum: -39.61491117472793 > -41.3670030796398
WOLF (strong): th(3.628800000000001E7)=-41.3670030796398; dx=4.374115340486822E-8 evalInputDelta=1.7520919049118717
New Minimum: -41.3670030796398 > -42.42756060829097
WOLF (strong): th(1.8144000000000004E7)=-42.42756060829097; dx=3.90075070023942E-8 evalInputDelta=2.8126494335630383
END: th(6048000.000000001)=-42.05500512819161; dx=-2.0481161388521462E-7 evalInputDelta=2.4400939534636805
Fitness changed from -39.61491117472793 to -42.42756060829097
Iteration 6 complete. Error: -42.42756060829097 Total: 14.5091; Orientation: 1.0200; Line Search: 10.3401
Adding measurement 3c4995b4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.195e+04, gradient 7.641e-04, dot -0.261; [481ba968-2de7-47ad-89ef-4265c462cfc1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -42.42756060829097, -30.02841975934704, -28.397654590599103, -28.397651612725685
LBFGS Accumulation History: 3 points
Removed measurement 3c4995b4 to history. Total: 3
th(0)=-42.42756060829097;dx=-5.824078963428462E-7
New Minimum: -42.42756060829097 > -46.43049700090944
END: th(1.3030021005312836E7)=-46.43049700090944; dx=-4.309823878805914E-9 evalInputDelta=4.002936392618473
Fitness changed from -42.42756060829097 to -46.43049700090944
Iteration 7 complete. Error: -46.43049700090944 Total: 9.8752; Orientation: 1.4262; Line Search: 5.5778
Adding measurement 5f47db71 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.104e+04, gradient 6.319e-04, dot -0.398; [481ba968-2de7-47ad-89ef-4265c462cfc1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.43049700090944, -30.02841975934704, -28.397654590599103, -28.397651612725685
LBFGS Accumulation History: 3 points
Removed measurement 5f47db71 to history. Total: 3
th(0)=-46.43049700090944;dx=-3.981269547016884E-7
New Minimum: -46.43049700090944 > -47.68525817553819
WOLF (strong): th(2.8072329265690096E7)=-47.68525817553819; dx=9.278134314417322E-8 evalInputDelta=1.2547611746287473
New Minimum: -47.68525817553819 > -48.942030579732
WOLF (strong): th(1.4036164632845048E7)=-48.942030579732; dx=1.88635097033437E-8 evalInputDelta=2.511533578822558
END: th(4678721.544281683)=-48.068029968485455; dx=-2.401867535447283E-7 evalInputDelta=1.6375329675760142
Fitness changed from -46.43049700090944 to -48.942030579732
Iteration 8 complete. Error: -48.942030579732 Total: 14.5928; Orientation: 1.0440; Line Search: 10.7426
Adding measurement 4ee109ae to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.443e+04, gradient 6.361e-04, dot -0.381; [481ba968-2de7-47ad-89ef-4265c462cfc1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.942030579732, -30.02841975934704, -28.397654590599103, -28.397651612725685
LBFGS Accumulation History: 3 points
Removed measurement 4ee109ae to history. Total: 3
th(0)=-48.942030579732;dx=-4.043727553691282E-7
New Minimum: -48.942030579732 > -51.2340542389143
END: th(1.0080000000000004E7)=-51.2340542389143; dx=-2.2208197803489176E-8 evalInputDelta=2.2920236591822984
Fitness changed from -48.942030579732 to -51.2340542389143
Iteration 9 complete. Error: -51.2340542389143 Total: 9.0079; Orientation: 1.0619; Line Search: 5.4291
Adding measurement 4ac9859e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.170e+04, gradient 5.276e-04, dot -0.492; [481ba968-2de7-47ad-89ef-4265c462cfc1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -51.2340542389143, -30.02841975934704, -28.397654590599103, -28.397651612725685
LBFGS Accumulation History: 3 points
Removed measurement 4ac9859e to history. Total: 3
th(0)=-51.2340542389143;dx=-2.7785422808024197E-7
New Minimum: -51.2340542389143 > -52.67199547738737
WOLF (strong): th(2.1716701675521396E7)=-52.67199547738737; dx=3.8801248153729403E-8 evalInputDelta=1.4379412384730728
New Minimum: -52.67199547738737 > -52.92611349707999
END: th(1.0858350837760698E7)=-52.92611349707999; dx=-3.451020539871873E-8 evalInputDelta=1.692059258165692
Fitness changed from -51.2340542389143 to -52.92611349707999
Iteration 10 complete. Error: -52.92611349707999 Total: 13.9148; Orientation: 1.3129; Line Search: 9.2656
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -52.92611349707999 (> -Infinity) after 136.674s (< 5400.000s)
Returns
-52.92611349707999