BasicOptimizer.scala:89 executed in 110.77 seconds (1.372 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 44019767703900
Reset training subject: 44022186168000
Adding measurement 16abbf67 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-48.0387882533169;dx=-1.7025737016865446E-6
New Minimum: -48.0387882533169 > -48.038791894205175
END: th(2.154434690031884)=-48.038791894205175; dx=-1.3158462168081373E-6 evalInputDelta=3.640888273537257E-6
Fitness changed from -48.0387882533169 to -48.038791894205175
Iteration 1 complete. Error: -48.038791894205175 Total: 11.5301; Orientation: 0.0611; Line Search: 4.7059
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1944ce4b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-48.038791894205175;dx=-1.3029427265358492E-6
New Minimum: -48.038791894205175 > -48.03879735553706
WOLFE (weak): th(4.641588833612779)=-48.03879735553706; dx=-1.3004302295783593E-6 evalInputDelta=5.461331888056975E-6
New Minimum: -48.03879735553706 > -48.0388064577555
WOLFE (weak): th(9.283177667225559)=-48.0388064577555; dx=-1.2997037534778824E-6 evalInputDelta=1.456355032303236E-5
New Minimum: -48.0388064577555 > -48.038831943957945
WOLFE (weak): th(27.849533001676676)=-48.038831943957945; dx=-1.2976787597228194E-6 evalInputDelta=4.00497527692778E-5
New Minimum: -48.038831943957945 > -48.03895027257789
WOLFE (weak): th(111.3981320067067)=-48.03895027257789; dx=-1.2970210644398437E-6 evalInputDelta=1.5837837271703847E-4
New Minimum: -48.03895027257789 > -48.03958014001906
WOLFE (weak): th(556.9906600335335)=-48.03958014001906; dx=-1.2963302668342568E-6 evalInputDelta=7.8824581388659E-4
New Minimum: -48.03958014001906 > -48.04350297244621
WOLFE (weak): th(3341.9439602012008)=-48.04350297244621; dx=-1.2953141913689722E-6 evalInputDelta=0.004711078241037114
New Minimum: -48.04350297244621 > -48.071739735244456
WOLFE (weak): th(23393.607721408407)=-48.071739735244456; dx=-1.2944595320215521E-6 evalInputDelta=0.032947841039280945
New Minimum: -48.071739735244456 > -48.3008617905945
WOLFE (weak): th(187148.86177126726)=-48.3008617905945; dx=-1.2778608424707861E-6 evalInputDelta=0.26206989638932754
New Minimum: -48.3008617905945 > -50.25311482260929
END: th(1684339.7559414054)=-50.25311482260929; dx=-1.1278727669093105E-6 evalInputDelta=2.2143229284041155
Fitness changed from -48.038791894205175 to -50.25311482260929
Iteration 2 complete. Error: -50.25311482260929 Total: 25.3298; Orientation: 0.0613; Line Search: 22.6298
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 156b4887 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-50.25311482260929;dx=-1.1363213885489414E-6
New Minimum: -50.25311482260929 > -53.969599350025916
END: th(3628800.0000000005)=-53.969599350025916; dx=-8.302092130114487E-7 evalInputDelta=3.7164845274166254
Fitness changed from -50.25311482260929 to -53.969599350025916
Iteration 3 complete. Error: -53.969599350025916 Total: 7.4480; Orientation: 0.0619; Line Search: 4.6654
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3ee00a8e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.476e+04, gradient 8.906e-04, dot -0.879; [bd35a1de-2bde-46e5-9765-0bc81be1174a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.969599350025916, -50.25311482260929, -48.038791894205175, -48.0387882533169
LBFGS Accumulation History: 3 points
Removed measurement 3ee00a8e to history. Total: 3
th(0)=-53.969599350025916;dx=-7.925280690664583E-7
New Minimum: -53.969599350025916 > -59.47526280031761
END: th(7818012.603187701)=-59.47526280031761; dx=-5.378872705000787E-7 evalInputDelta=5.505663450291692
Fitness changed from -53.969599350025916 to -59.47526280031761
Iteration 4 complete. Error: -59.47526280031761 Total: 8.4231; Orientation: 1.1375; Line Search: 4.6355
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 42beb91f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.368e+04, gradient 7.553e-04, dot -0.757; [bd35a1de-2bde-46e5-9765-0bc81be1174a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.47526280031761, -50.25311482260929, -48.038791894205175, -48.0387882533169
LBFGS Accumulation History: 3 points
Removed measurement 42beb91f to history. Total: 3
th(0)=-59.47526280031761;dx=-5.69702948287444E-7
New Minimum: -59.47526280031761 > -67.14619665741093
END: th(1.6843397559414055E7)=-67.14619665741093; dx=-3.1889145536661455E-7 evalInputDelta=7.670933857093317
Fitness changed from -59.47526280031761 to -67.14619665741093
Iteration 5 complete. Error: -67.14619665741093 Total: 8.3367; Orientation: 1.0292; Line Search: 4.5618
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1740de23 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.917e+04, gradient 6.954e-04, dot -0.611; [bd35a1de-2bde-46e5-9765-0bc81be1174a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.14619665741093, -50.25311482260929, -48.038791894205175, -48.0387882533169
LBFGS Accumulation History: 3 points
Removed measurement 1740de23 to history. Total: 3
th(0)=-67.14619665741093;dx=-4.833779011390945E-7
New Minimum: -67.14619665741093 > -75.07770583724653
END: th(3.628800000000001E7)=-75.07770583724653; dx=-7.823281301710087E-8 evalInputDelta=7.931509179835601
Fitness changed from -67.14619665741093 to -75.07770583724653
Iteration 6 complete. Error: -75.07770583724653 Total: 8.8117; Orientation: 1.0255; Line Search: 4.9453
Adding measurement 7c5a4cb3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.806e+04, gradient 8.537e-04, dot -0.273; [bd35a1de-2bde-46e5-9765-0bc81be1174a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.07770583724653, -50.25311482260929, -48.038791894205175, -48.0387882533169
LBFGS Accumulation History: 3 points
Removed measurement 7c5a4cb3 to history. Total: 3
th(0)=-75.07770583724653;dx=-7.282909422237413E-7
Armijo: th(7.818012603187701E7)=-69.0836149826862; dx=1.5139686878020857E-7 evalInputDelta=-5.994090854560326
New Minimum: -75.07770583724653 > -77.78089805794207
WOLF (strong): th(3.9090063015938506E7)=-77.78089805794207; dx=1.990989317265334E-7 evalInputDelta=2.7031922206955414
New Minimum: -77.78089805794207 > -81.12563142214813
END: th(1.3030021005312836E7)=-81.12563142214813; dx=-1.60493988257429E-7 evalInputDelta=6.047925584901606
Fitness changed from -75.07770583724653 to -81.12563142214813
Iteration 7 complete. Error: -81.12563142214813 Total: 12.4677; Orientation: 1.0221; Line Search: 9.2028
Adding measurement 1f7048e0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.192e+04, gradient 6.009e-04, dot -0.514; [bd35a1de-2bde-46e5-9765-0bc81be1174a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -81.12563142214813, -50.25311482260929, -48.038791894205175, -48.0387882533169
LBFGS Accumulation History: 3 points
Removed measurement 1f7048e0 to history. Total: 3
th(0)=-81.12563142214813;dx=-3.602647159488187E-7
New Minimum: -81.12563142214813 > -86.00461435378124
END: th(2.8072329265690096E7)=-86.00461435378124; dx=-3.47237010070889E-8 evalInputDelta=4.878982931633104
Fitness changed from -81.12563142214813 to -86.00461435378124
Iteration 8 complete. Error: -86.00461435378124 Total: 7.9054; Orientation: 1.0173; Line Search: 4.7254
Adding measurement 589f508 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.425e+04, gradient 7.396e-04, dot -0.355; [bd35a1de-2bde-46e5-9765-0bc81be1174a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.00461435378124, -50.25311482260929, -48.038791894205175, -48.0387882533169
LBFGS Accumulation History: 3 points
Removed measurement 589f508 to history. Total: 3
th(0)=-86.00461435378124;dx=-5.46212590771338E-7
Armijo: th(6.048000000000002E7)=-81.69181664014117; dx=1.6018063630463627E-7 evalInputDelta=-4.312797713640066
New Minimum: -86.00461435378124 > -88.21876085335528
WOLF (strong): th(3.024000000000001E7)=-88.21876085335528; dx=1.6968492406690463E-7 evalInputDelta=2.214146499574042
New Minimum: -88.21876085335528 > -89.82547653865231
END: th(1.0080000000000004E7)=-89.82547653865231; dx=-1.7291738010987988E-7 evalInputDelta=3.820862184871075
Fitness changed from -86.00461435378124 to -89.82547653865231
Iteration 9 complete. Error: -89.82547653865231 Total: 12.4528; Orientation: 1.0368; Line Search: 9.2092
Adding measurement 240bdeaf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.476e+04, gradient 4.848e-04, dot -0.605; [bd35a1de-2bde-46e5-9765-0bc81be1174a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -89.82547653865231, -50.25311482260929, -48.038791894205175, -48.0387882533169
LBFGS Accumulation History: 3 points
Removed measurement 240bdeaf to history. Total: 3
th(0)=-89.82547653865231;dx=-2.338673773775611E-7
New Minimum: -89.82547653865231 > -93.51406279083916
END: th(2.1716701675521396E7)=-93.51406279083916; dx=-1.1826692295442568E-7 evalInputDelta=3.6885862521868518
Fitness changed from -89.82547653865231 to -93.51406279083916
Iteration 10 complete. Error: -93.51406279083916 Total: 7.6672; Orientation: 1.0293; Line Search: 4.4740
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -93.51406279083916 (> -Infinity) after 110.773s (< 5400.000s)
Returns
-93.51406279083916