BasicOptimizer.scala:89 executed in 130.32 seconds (1.606 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 26596027102600
Reset training subject: 26598823939900
Adding measurement 13906db8 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-71.96217376727238;dx=-4.789474224185977E-6
New Minimum: -71.96217376727238 > -71.96218089995668
END: th(2.154434690031884)=-71.96218089995668; dx=-3.3705919724653176E-6 evalInputDelta=7.132684302746384E-6
Fitness changed from -71.96217376727238 to -71.96218089995668
Iteration 1 complete. Error: -71.96218089995668 Total: 13.4395; Orientation: 0.0623; Line Search: 5.5215
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 79b5d264 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-71.96218089995668;dx=-3.34483505647676E-6
New Minimum: -71.96218089995668 > -71.96219754288396
WOLFE (weak): th(4.641588833612779)=-71.96219754288396; dx=-3.342754895797212E-6 evalInputDelta=1.6642927278098796E-5
New Minimum: -71.96219754288396 > -71.96221180824713
WOLFE (weak): th(9.283177667225559)=-71.96221180824713; dx=-3.342121903796341E-6 evalInputDelta=3.090829045504506E-5
New Minimum: -71.96221180824713 > -71.96228313502061
WOLFE (weak): th(27.849533001676676)=-71.96228313502061; dx=-3.3394110902027263E-6 evalInputDelta=1.0223506393458592E-4
New Minimum: -71.96228313502061 > -71.96260172707899
WOLFE (weak): th(111.3981320067067)=-71.96260172707899; dx=-3.337003611134795E-6 evalInputDelta=4.208271223120619E-4
New Minimum: -71.96260172707899 > -71.96432067332758
WOLFE (weak): th(556.9906600335335)=-71.96432067332758; dx=-3.3366276167862217E-6 evalInputDelta=0.0021397733708994338
New Minimum: -71.96432067332758 > -71.97501858596975
WOLFE (weak): th(3341.9439602012008)=-71.97501858596975; dx=-3.3367079857206643E-6 evalInputDelta=0.012837686013071448
New Minimum: -71.97501858596975 > -72.05196817310647
WOLFE (weak): th(23393.607721408407)=-72.05196817310647; dx=-3.329850367743745E-6 evalInputDelta=0.08978727314979551
New Minimum: -72.05196817310647 > -72.67502139658598
WOLFE (weak): th(187148.86177126726)=-72.67502139658598; dx=-3.2764464252095422E-6 evalInputDelta=0.7128404966292976
New Minimum: -72.67502139658598 > -77.78391905430654
END: th(1684339.7559414054)=-77.78391905430654; dx=-2.609654450661708E-6 evalInputDelta=5.821738154349859
Fitness changed from -71.96218089995668 to -77.78391905430654
Iteration 2 complete. Error: -77.78391905430654 Total: 28.5003; Orientation: 0.0628; Line Search: 25.4805
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2e19d196 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-77.78391905430654;dx=-2.5396379393317437E-6
New Minimum: -77.78391905430654 > -85.77642937883529
END: th(3628800.0000000005)=-85.77642937883529; dx=-1.3959407980994027E-6 evalInputDelta=7.992510324528752
Fitness changed from -77.78391905430654 to -85.77642937883529
Iteration 3 complete. Error: -85.77642937883529 Total: 8.1215; Orientation: 0.0591; Line Search: 5.0682
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6352f6b6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.226e+03, gradient 1.241e-03, dot -0.671; [f789ef89-58fc-45b1-9c45-6f4bcb8cf6d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.77642937883529, -77.78391905430654, -71.96218089995668, -71.96217376727238
LBFGS Accumulation History: 3 points
Removed measurement 6352f6b6 to history. Total: 3
th(0)=-85.77642937883529;dx=-1.5392090374554264E-6
New Minimum: -85.77642937883529 > -95.09611728715517
END: th(7818012.603187701)=-95.09611728715517; dx=-6.294788215508936E-7 evalInputDelta=9.319687908319878
Fitness changed from -85.77642937883529 to -95.09611728715517
Iteration 4 complete. Error: -95.09611728715517 Total: 9.3182; Orientation: 1.0686; Line Search: 5.1947
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 6f42ddc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.298e+04, gradient 1.236e-03, dot -0.487; [f789ef89-58fc-45b1-9c45-6f4bcb8cf6d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -95.09611728715517, -77.78391905430654, -71.96218089995668, -71.96217376727238
LBFGS Accumulation History: 3 points
Removed measurement 6f42ddc to history. Total: 3
th(0)=-95.09611728715517;dx=-1.52699081838713E-6
New Minimum: -95.09611728715517 > -97.12568382614043
WOLF (strong): th(1.6843397559414055E7)=-97.12568382614043; dx=3.8168475615742844E-7 evalInputDelta=2.0295665389852644
New Minimum: -97.12568382614043 > -100.07171314460858
WOLF (strong): th(8421698.779707028)=-100.07171314460858; dx=8.223336582401731E-8 evalInputDelta=4.975595857453413
END: th(2807232.926569009)=-98.68685001593882; dx=-7.359006015061793E-7 evalInputDelta=3.5907327287836495
Fitness changed from -95.09611728715517 to -100.07171314460858
Iteration 5 complete. Error: -100.07171314460858 Total: 14.0148; Orientation: 1.0685; Line Search: 10.0526
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6350d92f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.940e+03, gradient 1.493e-03, dot -0.282; [f789ef89-58fc-45b1-9c45-6f4bcb8cf6d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -100.07171314460858, -77.78391905430654, -71.96218089995668, -71.96217376727238
LBFGS Accumulation History: 3 points
Removed measurement 6350d92f to history. Total: 3
th(0)=-100.07171314460858;dx=-2.2280488682569342E-6
New Minimum: -100.07171314460858 > -106.15309707866274
WOLF (strong): th(6048000.000000001)=-106.15309707866274; dx=4.0576898488625357E-7 evalInputDelta=6.081383934054159
END: th(3024000.0000000005)=-105.64040533226924; dx=-8.97849943695627E-7 evalInputDelta=5.568692187660659
Fitness changed from -100.07171314460858 to -106.15309707866274
Iteration 6 complete. Error: -106.15309707866274 Total: 11.7638; Orientation: 1.0860; Line Search: 7.8107
Adding measurement 1c65018e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.999e+04, gradient 1.311e-03, dot -0.387; [f789ef89-58fc-45b1-9c45-6f4bcb8cf6d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -106.15309707866274, -77.78391905430654, -71.96218089995668, -71.96217376727238
LBFGS Accumulation History: 3 points
Removed measurement 1c65018e to history. Total: 3
th(0)=-106.15309707866274;dx=-1.7179488798463054E-6
New Minimum: -106.15309707866274 > -110.18492507745364
WOLF (strong): th(6515010.502656418)=-110.18492507745364; dx=4.5653448690370574E-7 evalInputDelta=4.031827998790902
New Minimum: -110.18492507745364 > -110.3965168131494
END: th(3257505.251328209)=-110.3965168131494; dx=-5.143214992391918E-7 evalInputDelta=4.243419734486665
Fitness changed from -106.15309707866274 to -110.3965168131494
Iteration 7 complete. Error: -110.3965168131494 Total: 11.1984; Orientation: 1.0556; Line Search: 7.6824
Adding measurement 660239b1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.643e+04, gradient 8.513e-04, dot -0.680; [f789ef89-58fc-45b1-9c45-6f4bcb8cf6d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -110.3965168131494, -77.78391905430654, -71.96218089995668, -71.96217376727238
LBFGS Accumulation History: 3 points
Removed measurement 660239b1 to history. Total: 3
th(0)=-110.3965168131494;dx=-7.237008889722765E-7
New Minimum: -110.3965168131494 > -114.66631160213649
END: th(7018082.316422524)=-114.66631160213649; dx=-3.9881907549779846E-7 evalInputDelta=4.269794788987085
Fitness changed from -110.3965168131494 to -114.66631160213649
Iteration 8 complete. Error: -114.66631160213649 Total: 8.7240; Orientation: 0.9936; Line Search: 4.9990
Adding measurement 3c2fe97b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.944e+04, gradient 9.284e-04, dot -0.575; [f789ef89-58fc-45b1-9c45-6f4bcb8cf6d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -114.66631160213649, -77.78391905430654, -71.96218089995668, -71.96217376727238
LBFGS Accumulation History: 3 points
Removed measurement 3c2fe97b to history. Total: 3
th(0)=-114.66631160213649;dx=-8.61159155334941E-7
New Minimum: -114.66631160213649 > -116.68427933319674
WOLF (strong): th(1.5120000000000006E7)=-116.68427933319674; dx=1.8682889109071767E-7 evalInputDelta=2.017967731060253
New Minimum: -116.68427933319674 > -117.7527039244759
END: th(7560000.000000003)=-117.7527039244759; dx=-4.108549227411104E-8 evalInputDelta=3.0863923223394067
Fitness changed from -114.66631160213649 to -117.7527039244759
Iteration 9 complete. Error: -117.7527039244759 Total: 11.0762; Orientation: 0.9994; Line Search: 7.3937
Adding measurement b35b95e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.772e+04, gradient 1.141e-03, dot -0.406; [f789ef89-58fc-45b1-9c45-6f4bcb8cf6d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -117.7527039244759, -77.78391905430654, -71.96218089995668, -71.96217376727238
LBFGS Accumulation History: 3 points
Removed measurement b35b95e to history. Total: 3
th(0)=-117.7527039244759;dx=-1.3007692368906392E-6
Armijo: th(1.6287526256641047E7)=-113.08639836180996; dx=7.194808102526981E-7 evalInputDelta=-4.66630556266594
New Minimum: -117.7527039244759 > -119.9128756615251
WOLF (strong): th(8143763.128320524)=-119.9128756615251; dx=5.381972294376217E-7 evalInputDelta=2.160171737049211
New Minimum: -119.9128756615251 > -120.71262000150114
END: th(2714587.7094401745)=-120.71262000150114; dx=-5.850506645259802E-7 evalInputDelta=2.959916077025241
Fitness changed from -117.7527039244759 to -120.71262000150114
Iteration 10 complete. Error: -120.71262000150114 Total: 13.7216; Orientation: 1.0635; Line Search: 10.1785
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -120.71262000150114 (> -Infinity) after 130.318s (< 5400.000s)
Returns
-120.71262000150114