BasicOptimizer.scala:89 executed in 218.15 seconds (3.950 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 686344362060600
Reset training subject: 686348845903200
Adding measurement 72b665e3 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-953.0719739348125;dx=-0.007017186610284118
New Minimum: -953.0719739348125 > -953.0870894099867
WOLFE (weak): th(2.154434690031884)=-953.0870894099867; dx=-0.006425415922634024 evalInputDelta=0.015115475174184212
New Minimum: -953.0870894099867 > -953.1021062824276
WOLFE (weak): th(4.308869380063768)=-953.1021062824276; dx=-0.006423119340237704 evalInputDelta=0.0301323476151083
New Minimum: -953.1021062824276 > -953.162400905533
WOLFE (weak): th(12.926608140191302)=-953.162400905533; dx=-0.006422756325900622 evalInputDelta=0.09042697072050032
New Minimum: -953.162400905533 > -953.4335648066938
WOLFE (weak): th(51.70643256076521)=-953.4335648066938; dx=-0.006415380646074172 evalInputDelta=0.36159087188127614
New Minimum: -953.4335648066938 > -954.8780681322615
WOLFE (weak): th(258.53216280382605)=-954.8780681322615; dx=-0.006403913334837082 evalInputDelta=1.806094197449056
New Minimum: -954.8780681322615 > -963.8364747196487
WOLFE (weak): th(1551.1929768229563)=-963.8364747196487; dx=-0.0063223900129763715 evalInputDelta=10.764500784836173
New Minimum: -963.8364747196487 > -1024.1724098021778
END: th(10858.350837760694)=-1024.1724098021778; dx=-0.005579906808272152 evalInputDelta=71.10043586736526
Fitness changed from -953.0719739348125 to -1024.1724098021778
Iteration 1 complete. Error: -1024.1724098021778 Total: 49.5865; Orientation: 0.0974; Line Search: 36.2362
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 65c6ef86 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1024.1724098021778;dx=-0.00519901320578156
New Minimum: -1024.1724098021778 > -1140.611075257469
END: th(23393.607721408407)=-1140.611075257469; dx=-0.0039352467227685576 evalInputDelta=116.43866545529136
Fitness changed from -1024.1724098021778 to -1140.611075257469
Iteration 2 complete. Error: -1140.611075257469 Total: 14.5816; Orientation: 0.0848; Line Search: 9.1477
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 47456a30 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1140.611075257469;dx=-0.0036660548793379243
New Minimum: -1140.611075257469 > -1306.089487745767
END: th(50400.00000000001)=-1306.089487745767; dx=-0.002403264287741391 evalInputDelta=165.47841248829786
Fitness changed from -1140.611075257469 to -1306.089487745767
Iteration 3 complete. Error: -1306.089487745767 Total: 14.5580; Orientation: 0.0903; Line Search: 9.2868
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1ceb00cc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.090e+04, gradient 5.136e-02, dot -0.824; [bd61d458-28dd-4936-a9fb-0ce778997597 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1306.089487745767, -1140.611075257469, -1024.1724098021778, -953.0719739348125
LBFGS Accumulation History: 3 points
Removed measurement 1ceb00cc to history. Total: 3
th(0)=-1306.089487745767;dx=-0.002635480881969093
New Minimum: -1306.089487745767 > -1514.9922442045702
END: th(108583.50837760697)=-1514.9922442045702; dx=-0.0012427026267379446 evalInputDelta=208.9027564588032
Fitness changed from -1306.089487745767 to -1514.9922442045702
Iteration 4 complete. Error: -1514.9922442045702 Total: 16.5201; Orientation: 1.7213; Line Search: 9.2774
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 583ed20b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.163e+04, gradient 5.380e-02, dot -0.579; [bd61d458-28dd-4936-a9fb-0ce778997597 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1514.9922442045702, -1140.611075257469, -1024.1724098021778, -953.0719739348125
LBFGS Accumulation History: 3 points
Removed measurement 583ed20b to history. Total: 3
th(0)=-1514.9922442045702;dx=-0.002886403424032671
New Minimum: -1514.9922442045702 > -1690.8533348578758
END: th(233936.07721408413)=-1690.8533348578758; dx=-1.7843140679009288E-4 evalInputDelta=175.8610906533056
Fitness changed from -1514.9922442045702 to -1690.8533348578758
Iteration 5 complete. Error: -1690.8533348578758 Total: 16.6060; Orientation: 1.6689; Line Search: 9.1335
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 72c4d5e4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.032e+04, gradient 6.068e-02, dot -0.314; [bd61d458-28dd-4936-a9fb-0ce778997597 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1690.8533348578758, -1140.611075257469, -1024.1724098021778, -953.0719739348125
LBFGS Accumulation History: 3 points
Removed measurement 72c4d5e4 to history. Total: 3
th(0)=-1690.8533348578758;dx=-0.0036823355243017124
New Minimum: -1690.8533348578758 > -1696.5615226097755
WOLF (strong): th(504000.0000000002)=-1696.5615226097755; dx=4.775375498500147E-4 evalInputDelta=5.708187751899686
New Minimum: -1696.5615226097755 > -1859.4485741746128
WOLF (strong): th(252000.0000000001)=-1859.4485741746128; dx=5.031956029647861E-4 evalInputDelta=168.59523931673698
New Minimum: -1859.4485741746128 > -1884.875924298467
END: th(84000.00000000003)=-1884.875924298467; dx=-8.418608596819306E-4 evalInputDelta=194.02258944059122
Fitness changed from -1690.8533348578758 to -1884.875924298467
Iteration 6 complete. Error: -1884.875924298467 Total: 26.2382; Orientation: 1.8370; Line Search: 18.8201
Adding measurement 66b3fc0e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.683e+04, gradient 4.818e-02, dot -0.421; [bd61d458-28dd-4936-a9fb-0ce778997597 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1884.875924298467, -1140.611075257469, -1024.1724098021778, -953.0719739348125
LBFGS Accumulation History: 3 points
Removed measurement 66b3fc0e to history. Total: 3
th(0)=-1884.875924298467;dx=-0.0023164412382758147
New Minimum: -1884.875924298467 > -2048.776830208698
END: th(180972.5139626783)=-2048.776830208698; dx=-1.1388000807115476E-4 evalInputDelta=163.9009059102309
Fitness changed from -1884.875924298467 to -2048.776830208698
Iteration 7 complete. Error: -2048.776830208698 Total: 14.9079; Orientation: 1.6215; Line Search: 9.0417
Adding measurement 5e96cae4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.172e+04, gradient 5.904e-02, dot -0.340; [bd61d458-28dd-4936-a9fb-0ce778997597 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2048.776830208698, -1140.611075257469, -1024.1724098021778, -953.0719739348125
LBFGS Accumulation History: 3 points
Removed measurement 5e96cae4 to history. Total: 3
th(0)=-2048.776830208698;dx=-0.003478322928327467
Armijo: th(389893.4620234736)=-1981.6750490431068; dx=6.707613609899163E-4 evalInputDelta=-67.10178116559109
New Minimum: -2048.776830208698 > -2152.318401166519
WOLF (strong): th(194946.7310117368)=-2152.318401166519; dx=6.594054474958777E-4 evalInputDelta=103.54157095782102
New Minimum: -2152.318401166519 > -2190.977863877223
END: th(64982.24367057893)=-2190.977863877223; dx=-7.333420999061247E-4 evalInputDelta=142.20103366852527
Fitness changed from -2048.776830208698 to -2190.977863877223
Iteration 8 complete. Error: -2190.977863877223 Total: 24.2998; Orientation: 1.6491; Line Search: 18.0741
Adding measurement 6912efea to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.901e+04, gradient 4.304e-02, dot -0.487; [bd61d458-28dd-4936-a9fb-0ce778997597 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2190.977863877223, -1140.611075257469, -1024.1724098021778, -953.0719739348125
LBFGS Accumulation History: 3 points
Removed measurement 6912efea to history. Total: 3
th(0)=-2190.977863877223;dx=-0.0018473805547932483
New Minimum: -2190.977863877223 > -2311.5129244717623
END: th(140000.00000000006)=-2311.5129244717623; dx=-2.5262644923634126E-4 evalInputDelta=120.53506059453912
Fitness changed from -2190.977863877223 to -2311.5129244717623
Iteration 9 complete. Error: -2311.5129244717623 Total: 15.7722; Orientation: 1.6241; Line Search: 9.8274
Adding measurement 586c756d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.478e+04, gradient 5.265e-02, dot -0.397; [bd61d458-28dd-4936-a9fb-0ce778997597 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2311.5129244717623, -1140.611075257469, -1024.1724098021778, -953.0719739348125
LBFGS Accumulation History: 3 points
Removed measurement 586c756d to history. Total: 3
th(0)=-2311.5129244717623;dx=-0.0027650203977441883
Armijo: th(301620.8566044639)=-2310.0402593894332; dx=4.942429488687631E-4 evalInputDelta=-1.4726650823290584
New Minimum: -2311.5129244717623 > -2397.205247783343
WOLF (strong): th(150810.42830223194)=-2397.205247783343; dx=3.3691168508588213E-4 evalInputDelta=85.69232331158082
New Minimum: -2397.205247783343 > -2403.560171911658
END: th(50270.142767410645)=-2403.560171911658; dx=-7.382232628734648E-4 evalInputDelta=92.04724743989573
Fitness changed from -2311.5129244717623 to -2403.560171911658
Iteration 10 complete. Error: -2403.560171911658 Total: 24.1594; Orientation: 1.6426; Line Search: 18.2055
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2403.560171911658 (> -Infinity) after 218.155s (< 5400.000s)
Returns
-2403.560171911658