BasicOptimizer.scala:89 executed in 132.20 seconds (2.773 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 108760758130200
Reset training subject: 108763531345000
Adding measurement 739e8b96 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-37.511162493056794;dx=-1.1822523993097205E-6
New Minimum: -37.511162493056794 > -37.51116362024947
END: th(2.154434690031884)=-37.51116362024947; dx=-9.528614590453052E-7 evalInputDelta=1.1271926751987849E-6
Fitness changed from -37.511162493056794 to -37.51116362024947
Iteration 1 complete. Error: -37.51116362024947 Total: 13.6529; Orientation: 0.1525; Line Search: 5.6892
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 26b3c9a2 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-37.51116362024947;dx=-9.509913069059044E-7
New Minimum: -37.51116362024947 > -37.511169256212334
WOLFE (weak): th(4.641588833612779)=-37.511169256212334; dx=-9.509416131104855E-7 evalInputDelta=5.6359628644031545E-6
New Minimum: -37.511169256212334 > -37.511174892174346
WOLFE (weak): th(9.283177667225559)=-37.511174892174346; dx=-9.506358550314083E-7 evalInputDelta=1.1271924876155026E-5
New Minimum: -37.511174892174346 > -37.5111951816306
WOLFE (weak): th(27.849533001676676)=-37.5111951816306; dx=-9.505093750259498E-7 evalInputDelta=3.156138112814233E-5
New Minimum: -37.5111951816306 > -37.51128197529177
WOLFE (weak): th(111.3981320067067)=-37.51128197529177; dx=-9.500916987188163E-7 evalInputDelta=1.1835504230361948E-4
New Minimum: -37.51128197529177 > -37.51174975585193
WOLFE (weak): th(556.9906600335335)=-37.51174975585193; dx=-9.503805016049766E-7 evalInputDelta=5.861356024610131E-4
New Minimum: -37.51174975585193 > -37.51467127979902
WOLFE (weak): th(3341.9439602012008)=-37.51467127979902; dx=-9.500021572307119E-7 evalInputDelta=0.0035076595495482366
New Minimum: -37.51467127979902 > -37.53569796258087
WOLFE (weak): th(23393.607721408407)=-37.53569796258087; dx=-9.48634930609097E-7 evalInputDelta=0.024534342331399728
New Minimum: -37.53569796258087 > -37.70423951918719
WOLFE (weak): th(187148.86177126726)=-37.70423951918719; dx=-9.149394086774324E-7 evalInputDelta=0.19307589893772104
New Minimum: -37.70423951918719 > -39.04695488459757
END: th(1684339.7559414054)=-39.04695488459757; dx=-7.276054292122778E-7 evalInputDelta=1.5357912643480987
Fitness changed from -37.51116362024947 to -39.04695488459757
Iteration 2 complete. Error: -39.04695488459757 Total: 30.2604; Orientation: 0.0480; Line Search: 27.0463
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 1ff81b0d to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-39.04695488459757;dx=-7.15155933642843E-7
New Minimum: -39.04695488459757 > -41.34170793739763
END: th(3628800.0000000005)=-41.34170793739763; dx=-4.781862403224032E-7 evalInputDelta=2.2947530528000613
Fitness changed from -39.04695488459757 to -41.34170793739763
Iteration 3 complete. Error: -41.34170793739763 Total: 8.4984; Orientation: 0.0406; Line Search: 5.3394
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7736c41e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.953e+03, gradient 7.008e-04, dot -0.797; [f1a7f14c-fa8d-4f75-9c8f-4777b72f4bf7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -41.34170793739763, -39.04695488459757, -37.51116362024947, -37.511162493056794
LBFGS Accumulation History: 3 points
Removed measurement 7736c41e to history. Total: 3
th(0)=-41.34170793739763;dx=-4.906635155808882E-7
New Minimum: -41.34170793739763 > -44.66037194713488
END: th(7818012.603187701)=-44.66037194713488; dx=-3.0445627448302223E-7 evalInputDelta=3.3186640097372475
Fitness changed from -41.34170793739763 to -44.66037194713488
Iteration 4 complete. Error: -44.66037194713488 Total: 9.7604; Orientation: 1.2145; Line Search: 5.3886
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 70b1028d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.081e+04, gradient 6.495e-04, dot -0.682; [f1a7f14c-fa8d-4f75-9c8f-4777b72f4bf7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -44.66037194713488, -39.04695488459757, -37.51116362024947, -37.511162493056794
LBFGS Accumulation History: 3 points
Removed measurement 70b1028d to history. Total: 3
th(0)=-44.66037194713488;dx=-4.214756248296399E-7
New Minimum: -44.66037194713488 > -48.59609274083611
END: th(1.6843397559414055E7)=-48.59609274083611; dx=-1.1726188056224871E-7 evalInputDelta=3.935720793701236
Fitness changed from -44.66037194713488 to -48.59609274083611
Iteration 5 complete. Error: -48.59609274083611 Total: 9.8577; Orientation: 1.0896; Line Search: 5.5594
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 44e7c06b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.142e+04, gradient 7.619e-04, dot -0.372; [f1a7f14c-fa8d-4f75-9c8f-4777b72f4bf7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.59609274083611, -39.04695488459757, -37.51116362024947, -37.511162493056794
LBFGS Accumulation History: 3 points
Removed measurement 44e7c06b to history. Total: 3
th(0)=-48.59609274083611;dx=-5.804316361028543E-7
Armijo: th(3.628800000000001E7)=-48.49443458694719; dx=1.1357765544631281E-7 evalInputDelta=-0.10165815388891986
New Minimum: -48.59609274083611 > -50.99264809763474
WOLF (strong): th(1.8144000000000004E7)=-50.99264809763474; dx=9.932622853289887E-8 evalInputDelta=2.396555356798629
New Minimum: -50.99264809763474 > -51.212772516393564
END: th(6048000.000000001)=-51.212772516393564; dx=-2.0023578566989364E-7 evalInputDelta=2.6166797755574507
Fitness changed from -48.59609274083611 to -51.212772516393564
Iteration 6 complete. Error: -51.212772516393564 Total: 15.5070; Orientation: 1.1119; Line Search: 11.1657
Adding measurement 5c8e7687 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.089e+04, gradient 5.859e-04, dot -0.614; [f1a7f14c-fa8d-4f75-9c8f-4777b72f4bf7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -51.212772516393564, -39.04695488459757, -37.51116362024947, -37.511162493056794
LBFGS Accumulation History: 3 points
Removed measurement 5c8e7687 to history. Total: 3
th(0)=-51.212772516393564;dx=-3.431144027768101E-7
New Minimum: -51.212772516393564 > -53.74636880981683
END: th(1.3030021005312836E7)=-53.74636880981683; dx=-7.181859729945144E-8 evalInputDelta=2.5335962934232654
Fitness changed from -51.212772516393564 to -53.74636880981683
Iteration 7 complete. Error: -53.74636880981683 Total: 9.3076; Orientation: 1.0972; Line Search: 5.6100
Adding measurement 6e8f3b76 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.254e+04, gradient 6.995e-04, dot -0.445; [f1a7f14c-fa8d-4f75-9c8f-4777b72f4bf7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.74636880981683, -39.04695488459757, -37.51116362024947, -37.511162493056794
LBFGS Accumulation History: 3 points
Removed measurement 6e8f3b76 to history. Total: 3
th(0)=-53.74636880981683;dx=-4.884024567859507E-7
Armijo: th(2.8072329265690096E7)=-53.724607408612805; dx=1.0672086678300244E-7 evalInputDelta=-0.021761401204024367
New Minimum: -53.74636880981683 > -55.49840849250612
WOLF (strong): th(1.4036164632845048E7)=-55.49840849250612; dx=8.451835199375813E-8 evalInputDelta=1.7520396826892934
New Minimum: -55.49840849250612 > -55.53514261960158
END: th(4678721.544281683)=-55.53514261960158; dx=-1.9835231748850816E-7 evalInputDelta=1.7887738097847503
Fitness changed from -53.74636880981683 to -55.53514261960158
Iteration 8 complete. Error: -55.53514261960158 Total: 14.4921; Orientation: 1.2474; Line Search: 10.7306
Adding measurement 24489d12 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.070e+04, gradient 5.064e-04, dot -0.685; [f1a7f14c-fa8d-4f75-9c8f-4777b72f4bf7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -55.53514261960158, -39.04695488459757, -37.51116362024947, -37.511162493056794
LBFGS Accumulation History: 3 points
Removed measurement 24489d12 to history. Total: 3
th(0)=-55.53514261960158;dx=-2.5601398049090796E-7
New Minimum: -55.53514261960158 > -57.44692660890223
END: th(1.0080000000000004E7)=-57.44692660890223; dx=-1.196410524737192E-7 evalInputDelta=1.9117839893006519
Fitness changed from -55.53514261960158 to -57.44692660890223
Iteration 9 complete. Error: -57.44692660890223 Total: 8.9600; Orientation: 1.1002; Line Search: 5.3769
Adding measurement 4af8ff3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.320e+04, gradient 5.679e-04, dot -0.573; [f1a7f14c-fa8d-4f75-9c8f-4777b72f4bf7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -57.44692660890223, -39.04695488459757, -37.51116362024947, -37.511162493056794
LBFGS Accumulation History: 3 points
Removed measurement 4af8ff3 to history. Total: 3
th(0)=-57.44692660890223;dx=-3.2165985916737466E-7
New Minimum: -57.44692660890223 > -58.83764137992319
WOLF (strong): th(2.1716701675521396E7)=-58.83764137992319; dx=1.9823717451155137E-8 evalInputDelta=1.39071477102096
New Minimum: -58.83764137992319 > -58.98417950395243
END: th(1.0858350837760698E7)=-58.98417950395243; dx=-2.5477058022267175E-8 evalInputDelta=1.5372528950502016
Fitness changed from -57.44692660890223 to -58.98417950395243
Iteration 10 complete. Error: -58.98417950395243 Total: 11.4229; Orientation: 1.0560; Line Search: 7.9202
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -58.98417950395243 (> -Infinity) after 132.184s (< 5400.000s)
Returns
-58.98417950395243