BasicOptimizer.scala:89 executed in 152.32 seconds (2.636 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 459239858613300
Reset training subject: 459242684485100
Adding measurement cfb03ce to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-99.25502008922759;dx=-1.3760679919609708E-5
New Minimum: -99.25502008922759 > -99.25504248210791
END: th(2.154434690031884)=-99.25504248210791; dx=-1.1094131125436483E-5 evalInputDelta=2.2392880325128317E-5
Fitness changed from -99.25502008922759 to -99.25504248210791
Iteration 1 complete. Error: -99.25504248210791 Total: 14.7648; Orientation: 0.1088; Line Search: 6.1145
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 17a6df0b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-99.25504248210791;dx=-1.1096652565936889E-5
New Minimum: -99.25504248210791 > -99.25509846428662
WOLFE (weak): th(4.641588833612779)=-99.25509846428662; dx=-1.1051894944487102E-5 evalInputDelta=5.598217870783628E-5
New Minimum: -99.25509846428662 > -99.25515444643375
WOLFE (weak): th(9.283177667225559)=-99.25515444643375; dx=-1.1055468088719243E-5 evalInputDelta=1.1196432583915339E-4
New Minimum: -99.25515444643375 > -99.25537277650587
WOLFE (weak): th(27.849533001676676)=-99.25537277650587; dx=-1.1076621837623596E-5 evalInputDelta=3.302943979548445E-4
New Minimum: -99.25537277650587 > -99.25635245681454
WOLFE (weak): th(111.3981320067067)=-99.25635245681454; dx=-1.1047612277075324E-5 evalInputDelta=0.0013099747066291911
New Minimum: -99.25635245681454 > -99.26156419350689
WOLFE (weak): th(556.9906600335335)=-99.26156419350689; dx=-1.1044536113867551E-5 evalInputDelta=0.006521711398974617
New Minimum: -99.26156419350689 > -99.29409917305604
WOLFE (weak): th(3341.9439602012008)=-99.29409917305604; dx=-1.1059820802506431E-5 evalInputDelta=0.03905669094812936
New Minimum: -99.29409917305604 > -99.52792206092161
WOLFE (weak): th(23393.607721408407)=-99.52792206092161; dx=-1.1017892049298053E-5 evalInputDelta=0.2728795788137006
New Minimum: -99.52792206092161 > -101.39727652452072
WOLFE (weak): th(187148.86177126726)=-101.39727652452072; dx=-1.0600363319285071E-5 evalInputDelta=2.1422340424128095
New Minimum: -101.39727652452072 > -115.11634967828108
END: th(1684339.7559414054)=-115.11634967828108; dx=-6.844789664065918E-6 evalInputDelta=15.861307196173172
Fitness changed from -99.25504248210791 to -115.11634967828108
Iteration 2 complete. Error: -115.11634967828108 Total: 32.9385; Orientation: 0.1100; Line Search: 29.3758
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 6d906b2 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-115.11634967828108;dx=-7.225576454055935E-6
New Minimum: -115.11634967828108 > -133.5028506578889
END: th(3628800.0000000005)=-133.5028506578889; dx=-3.1772264642698487E-6 evalInputDelta=18.386500979607817
Fitness changed from -115.11634967828108 to -133.5028506578889
Iteration 3 complete. Error: -133.5028506578889 Total: 9.6057; Orientation: 0.0973; Line Search: 5.8266
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2caa27a8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.771e+03, gradient 2.197e-03, dot -0.544; [e076677b-4811-4379-96c9-6cd2f278defb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -133.5028506578889, -115.11634967828108, -99.25504248210791, -99.25502008922759
LBFGS Accumulation History: 3 points
Removed measurement 2caa27a8 to history. Total: 3
th(0)=-133.5028506578889;dx=-4.811813349224607E-6
New Minimum: -133.5028506578889 > -152.28808374716948
END: th(7818012.603187701)=-152.28808374716948; dx=-9.263310412714837E-7 evalInputDelta=18.78523308928058
Fitness changed from -133.5028506578889 to -152.28808374716948
Iteration 4 complete. Error: -152.28808374716948 Total: 11.6363; Orientation: 1.9840; Line Search: 5.9984
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 21c03906 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.140e+04, gradient 2.380e-03, dot -0.313; [e076677b-4811-4379-96c9-6cd2f278defb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -152.28808374716948, -115.11634967828108, -99.25504248210791, -99.25502008922759
LBFGS Accumulation History: 3 points
Removed measurement 21c03906 to history. Total: 3
th(0)=-152.28808374716948;dx=-5.658506860168862E-6
New Minimum: -152.28808374716948 > -154.68956360920836
WOLF (strong): th(1.6843397559414055E7)=-154.68956360920836; dx=1.18568010203726E-6 evalInputDelta=2.401479862038883
New Minimum: -154.68956360920836 > -165.50752023993334
WOLF (strong): th(8421698.779707028)=-165.50752023993334; dx=6.853032815848817E-7 evalInputDelta=13.219436492763862
END: th(2807232.926569009)=-163.90617691086933; dx=-2.2853797894238587E-6 evalInputDelta=11.618093163699854
Fitness changed from -152.28808374716948 to -165.50752023993334
Iteration 5 complete. Error: -165.50752023993334 Total: 16.8235; Orientation: 2.0823; Line Search: 11.4832
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 46556723 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.403e+04, gradient 2.491e-03, dot -0.235; [e076677b-4811-4379-96c9-6cd2f278defb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -165.50752023993334, -115.11634967828108, -99.25504248210791, -99.25502008922759
LBFGS Accumulation History: 3 points
Removed measurement 46556723 to history. Total: 3
th(0)=-165.50752023993334;dx=-6.177495664344401E-6
New Minimum: -165.50752023993334 > -183.75253193906306
WOLF (strong): th(6048000.000000001)=-183.75253193906306; dx=2.9162534943174838E-8 evalInputDelta=18.24501169912972
END: th(3024000.0000000005)=-179.95296582597794; dx=-2.7816711583120408E-6 evalInputDelta=14.445445586044599
Fitness changed from -165.50752023993334 to -183.75253193906306
Iteration 6 complete. Error: -183.75253193906306 Total: 13.9161; Orientation: 1.9192; Line Search: 8.4398
Adding measurement 29c4e670 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.619e+04, gradient 1.894e-03, dot -0.409; [e076677b-4811-4379-96c9-6cd2f278defb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -183.75253193906306, -115.11634967828108, -99.25504248210791, -99.25502008922759
LBFGS Accumulation History: 3 points
Removed measurement 29c4e670 to history. Total: 3
th(0)=-183.75253193906306;dx=-3.585782177728519E-6
New Minimum: -183.75253193906306 > -194.95518305804646
END: th(6515010.502656418)=-194.95518305804646; dx=-1.5000310598543118E-7 evalInputDelta=11.202651118983397
Fitness changed from -183.75253193906306 to -194.95518305804646
Iteration 7 complete. Error: -194.95518305804646 Total: 11.1359; Orientation: 1.8237; Line Search: 6.1333
Adding measurement 6386822c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.200e+04, gradient 1.809e-03, dot -0.425; [e076677b-4811-4379-96c9-6cd2f278defb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -194.95518305804646, -115.11634967828108, -99.25504248210791, -99.25502008922759
LBFGS Accumulation History: 3 points
Removed measurement 6386822c to history. Total: 3
th(0)=-194.95518305804646;dx=-3.2727697221947925E-6
New Minimum: -194.95518305804646 > -198.1244409077866
WOLF (strong): th(1.4036164632845048E7)=-198.1244409077866; dx=1.017936591904562E-6 evalInputDelta=3.1692578497401485
New Minimum: -198.1244409077866 > -204.2818689128292
WOLF (strong): th(7018082.316422524)=-204.2818689128292; dx=1.9094606648004218E-7 evalInputDelta=9.326685854782738
END: th(2339360.7721408415)=-201.21717572749733; dx=-1.8449482448554605E-6 evalInputDelta=6.261992669450876
Fitness changed from -194.95518305804646 to -204.2818689128292
Iteration 8 complete. Error: -204.2818689128292 Total: 16.5124; Orientation: 1.9110; Line Search: 11.7878
Adding measurement 217c2781 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.572e+04, gradient 1.835e-03, dot -0.392; [e076677b-4811-4379-96c9-6cd2f278defb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -204.2818689128292, -115.11634967828108, -99.25504248210791, -99.25502008922759
LBFGS Accumulation History: 3 points
Removed measurement 217c2781 to history. Total: 3
th(0)=-204.2818689128292;dx=-3.3520586353755368E-6
New Minimum: -204.2818689128292 > -213.64852281628868
END: th(5040000.000000002)=-213.64852281628868; dx=-3.2207580256253465E-7 evalInputDelta=9.36665390345948
Fitness changed from -204.2818689128292 to -213.64852281628868
Iteration 9 complete. Error: -213.64852281628868 Total: 10.9048; Orientation: 1.8624; Line Search: 5.8584
Adding measurement 4bb19920 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.238e+04, gradient 1.449e-03, dot -0.514; [e076677b-4811-4379-96c9-6cd2f278defb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -213.64852281628868, -115.11634967828108, -99.25504248210791, -99.25502008922759
LBFGS Accumulation History: 3 points
Removed measurement 4bb19920 to history. Total: 3
th(0)=-213.64852281628868;dx=-2.0981314060313344E-6
New Minimum: -213.64852281628868 > -220.63801912411276
WOLF (strong): th(1.0858350837760698E7)=-220.63801912411276; dx=1.9935301080181924E-7 evalInputDelta=6.9894963078240835
END: th(5429175.418880349)=-220.4721261335432; dx=-5.063351014291334E-7 evalInputDelta=6.823603317254538
Fitness changed from -213.64852281628868 to -220.63801912411276
Iteration 10 complete. Error: -220.63801912411276 Total: 13.4474; Orientation: 1.9238; Line Search: 8.8584
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -220.63801912411276 (> -Infinity) after 152.323s (< 5400.000s)
Returns
-220.63801912411276