BasicOptimizer.scala:89 executed in 129.69 seconds (1.231 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 26071949509700
Reset training subject: 26074540551000
Adding measurement 4a9fdee6 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-67.68849757366492;dx=-4.760481146294318E-6
New Minimum: -67.68849757366492 > -67.68851021203685
END: th(2.154434690031884)=-67.68851021203685; dx=-3.93765807130383E-6 evalInputDelta=1.2638371927664593E-5
Fitness changed from -67.68849757366492 to -67.68851021203685
Iteration 1 complete. Error: -67.68851021203685 Total: 12.5510; Orientation: 0.0625; Line Search: 4.9528
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1506dbe0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-67.68851021203685;dx=-3.908319550814916E-6
New Minimum: -67.68851021203685 > -67.68852790575357
WOLFE (weak): th(4.641588833612779)=-67.68852790575357; dx=-3.908557739355597E-6 evalInputDelta=1.7693716728217623E-5
New Minimum: -67.68852790575357 > -67.68855065481115
WOLFE (weak): th(9.283177667225559)=-67.68855065481115; dx=-3.908187634690629E-6 evalInputDelta=4.0442774306370666E-5
New Minimum: -67.68855065481115 > -67.68863406795684
WOLFE (weak): th(27.849533001676676)=-67.68863406795684; dx=-3.907175736524167E-6 evalInputDelta=1.238559199947531E-4
New Minimum: -67.68863406795684 > -67.68900563435706
WOLFE (weak): th(111.3981320067067)=-67.68900563435706; dx=-3.906977699002216E-6 evalInputDelta=4.95422320213379E-4
New Minimum: -67.68900563435706 > -67.6910049804478
WOLFE (weak): th(556.9906600335335)=-67.6910049804478; dx=-3.906386975478334E-6 evalInputDelta=0.002494768410954862
New Minimum: -67.6910049804478 > -67.70348502492284
WOLFE (weak): th(3341.9439602012008)=-67.70348502492284; dx=-3.904021533822114E-6 evalInputDelta=0.014974812885995448
New Minimum: -67.70348502492284 > -67.79319629717058
WOLFE (weak): th(23393.607721408407)=-67.79319629717058; dx=-3.892466109329336E-6 evalInputDelta=0.10468608513373567
New Minimum: -67.79319629717058 > -68.50317576625037
WOLFE (weak): th(187148.86177126726)=-68.50317576625037; dx=-3.6701417580917793E-6 evalInputDelta=0.8146655542135193
New Minimum: -68.50317576625037 > -73.5851341302397
END: th(1684339.7559414054)=-73.5851341302397; dx=-2.297776443095647E-6 evalInputDelta=5.896623918202849
Fitness changed from -67.68851021203685 to -73.5851341302397
Iteration 2 complete. Error: -73.5851341302397 Total: 28.5876; Orientation: 0.0619; Line Search: 25.5144
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2ea1c01 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-73.5851341302397;dx=-2.1602665698103764E-6
New Minimum: -73.5851341302397 > -80.47256460164219
END: th(3628800.0000000005)=-80.47256460164219; dx=-1.2475853975564854E-6 evalInputDelta=6.887430471402496
Fitness changed from -73.5851341302397 to -80.47256460164219
Iteration 3 complete. Error: -80.47256460164219 Total: 8.0524; Orientation: 0.0623; Line Search: 5.0710
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5a510f79 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.015e+03, gradient 1.220e-03, dot -0.687; [5ed8ce2a-d9c0-4b23-ad95-374cc8141c72 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.47256460164219, -73.5851341302397, -67.68851021203685, -67.68849757366492
LBFGS Accumulation History: 3 points
Removed measurement 5a510f79 to history. Total: 3
th(0)=-80.47256460164219;dx=-1.4873933693932892E-6
New Minimum: -80.47256460164219 > -88.93191539970084
END: th(7818012.603187701)=-88.93191539970084; dx=-5.646519631412263E-7 evalInputDelta=8.45935079805865
Fitness changed from -80.47256460164219 to -88.93191539970084
Iteration 4 complete. Error: -88.93191539970084 Total: 9.1989; Orientation: 1.0648; Line Search: 5.2523
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 26aac6fb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.187e+04, gradient 1.396e-03, dot -0.441; [5ed8ce2a-d9c0-4b23-ad95-374cc8141c72 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -88.93191539970084, -73.5851341302397, -67.68851021203685, -67.68849757366492
LBFGS Accumulation History: 3 points
Removed measurement 26aac6fb to history. Total: 3
th(0)=-88.93191539970084;dx=-1.947820172451015E-6
Armijo: th(1.6843397559414055E7)=-86.11703484001376; dx=6.258663518799156E-7 evalInputDelta=-2.814880559687083
New Minimum: -88.93191539970084 > -92.15428507221331
WOLF (strong): th(8421698.779707028)=-92.15428507221331; dx=4.876719042225155E-7 evalInputDelta=3.222369672512471
New Minimum: -92.15428507221331 > -92.99442543361499
END: th(2807232.926569009)=-92.99442543361499; dx=-6.062844275657376E-7 evalInputDelta=4.062510033914151
Fitness changed from -88.93191539970084 to -92.99442543361499
Iteration 5 complete. Error: -92.99442543361499 Total: 14.1492; Orientation: 1.0748; Line Search: 10.1505
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 3bcdbc7b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.814e+04, gradient 1.054e-03, dot -0.679; [5ed8ce2a-d9c0-4b23-ad95-374cc8141c72 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -92.99442543361499, -73.5851341302397, -67.68851021203685, -67.68849757366492
LBFGS Accumulation History: 3 points
Removed measurement 3bcdbc7b to history. Total: 3
th(0)=-92.99442543361499;dx=-1.1109823905425298E-6
New Minimum: -92.99442543361499 > -97.64761466459876
END: th(6048000.000000001)=-97.64761466459876; dx=-3.7093452738122296E-7 evalInputDelta=4.65318923098377
Fitness changed from -92.99442543361499 to -97.64761466459876
Iteration 6 complete. Error: -97.64761466459876 Total: 9.1163; Orientation: 1.0715; Line Search: 5.1663
Adding measurement 14e6dbb6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.170e+04, gradient 1.283e-03, dot -0.498; [5ed8ce2a-d9c0-4b23-ad95-374cc8141c72 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.64761466459876, -73.5851341302397, -67.68851021203685, -67.68849757366492
LBFGS Accumulation History: 3 points
Removed measurement 14e6dbb6 to history. Total: 3
th(0)=-97.64761466459876;dx=-1.6456054420934773E-6
Armijo: th(1.3030021005312836E7)=-96.77639714343415; dx=5.283636573755808E-7 evalInputDelta=-0.8712175211646098
New Minimum: -97.64761466459876 > -100.57881322295482
WOLF (strong): th(6515010.502656418)=-100.57881322295482; dx=3.508606249682535E-7 evalInputDelta=2.9311985583560585
END: th(2171670.167552139)=-100.54159650245774; dx=-6.823809645941087E-7 evalInputDelta=2.8939818378589734
Fitness changed from -97.64761466459876 to -100.57881322295482
Iteration 7 complete. Error: -100.57881322295482 Total: 13.8264; Orientation: 1.0595; Line Search: 10.2661
Adding measurement 3327215f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.843e+04, gradient 1.549e-03, dot -0.319; [5ed8ce2a-d9c0-4b23-ad95-374cc8141c72 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -100.57881322295482, -73.5851341302397, -67.68851021203685, -67.68849757366492
LBFGS Accumulation History: 3 points
Removed measurement 3327215f to history. Total: 3
th(0)=-100.57881322295482;dx=-2.3981130030854205E-6
New Minimum: -100.57881322295482 > -106.10594552459538
WOLF (strong): th(4678721.544281682)=-106.10594552459538; dx=3.49842770282687E-7 evalInputDelta=5.527132301640563
END: th(2339360.772140841)=-105.32608969743164; dx=-1.0754160829935824E-6 evalInputDelta=4.74727647447682
Fitness changed from -100.57881322295482 to -106.10594552459538
Iteration 8 complete. Error: -106.10594552459538 Total: 11.1799; Orientation: 1.0369; Line Search: 7.7188
Adding measurement 73092752 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.910e+04, gradient 1.211e-03, dot -0.474; [5ed8ce2a-d9c0-4b23-ad95-374cc8141c72 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -106.10594552459538, -73.5851341302397, -67.68851021203685, -67.68849757366492
LBFGS Accumulation History: 3 points
Removed measurement 73092752 to history. Total: 3
th(0)=-106.10594552459538;dx=-1.4668083883665304E-6
New Minimum: -106.10594552459538 > -109.69517859221014
WOLF (strong): th(5040000.000000001)=-109.69517859221014; dx=1.4512078980479313E-7 evalInputDelta=3.5892330676147566
END: th(2520000.0000000005)=-109.13327975669098; dx=-6.295286771086563E-7 evalInputDelta=3.0273342320955976
Fitness changed from -106.10594552459538 to -109.69517859221014
Iteration 9 complete. Error: -109.69517859221014 Total: 11.2789; Orientation: 1.0694; Line Search: 7.7868
Adding measurement 6954f50c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.193e+04, gradient 1.185e-03, dot -0.471; [5ed8ce2a-d9c0-4b23-ad95-374cc8141c72 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -109.69517859221014, -73.5851341302397, -67.68851021203685, -67.68849757366492
LBFGS Accumulation History: 3 points
Removed measurement 6954f50c to history. Total: 3
th(0)=-109.69517859221014;dx=-1.4015660242893637E-6
New Minimum: -109.69517859221014 > -112.75842879627366
WOLF (strong): th(5429175.418880348)=-112.75842879627366; dx=2.7050589872032074E-7 evalInputDelta=3.0632502040635217
END: th(2714587.709440174)=-112.60869395690862; dx=-4.739726931876343E-7 evalInputDelta=2.9135153646984833
Fitness changed from -109.69517859221014 to -112.75842879627366
Iteration 10 complete. Error: -112.75842879627366 Total: 11.3087; Orientation: 1.0088; Line Search: 7.6401
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -112.75842879627366 (> -Infinity) after 129.691s (< 5400.000s)
Returns
-112.75842879627366