BasicOptimizer.scala:89 executed in 134.18 seconds (0.973 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 328190960949400
Reset training subject: 328193583103500
Adding measurement 142347d5 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-127.40008923973525;dx=-2.9794805543725606E-5
New Minimum: -127.40008923973525 > -127.40014980434258
END: th(2.154434690031884)=-127.40014980434258; dx=-2.170079116487293E-5 evalInputDelta=6.056460732395408E-5
Fitness changed from -127.40008923973525 to -127.40014980434258
Iteration 1 complete. Error: -127.40014980434258 Total: 12.9550; Orientation: 0.0635; Line Search: 5.2751
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3c39a022 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-127.40014980434258;dx=-2.1588414159012224E-5
New Minimum: -127.40014980434258 > -127.40026336290373
WOLFE (weak): th(4.641588833612779)=-127.40026336290373; dx=-2.1583589245327058E-5 evalInputDelta=1.1355856115358165E-4
New Minimum: -127.40026336290373 > -127.40036935080279
WOLFE (weak): th(9.283177667225559)=-127.40036935080279; dx=-2.1575210812216627E-5 evalInputDelta=2.195464602152697E-4
New Minimum: -127.40036935080279 > -127.40082358365724
WOLFE (weak): th(27.849533001676676)=-127.40082358365724; dx=-2.1560899774869273E-5 evalInputDelta=6.737793146669446E-4
New Minimum: -127.40082358365724 > -127.402852470635
WOLFE (weak): th(111.3981320067067)=-127.402852470635; dx=-2.1547394076455264E-5 evalInputDelta=0.0027026662924214406
New Minimum: -127.402852470635 > -127.41363228343346
WOLFE (weak): th(556.9906600335335)=-127.41363228343346; dx=-2.1540990664660352E-5 evalInputDelta=0.013482479090882293
New Minimum: -127.41363228343346 > -127.48101572437663
WOLFE (weak): th(3341.9439602012008)=-127.48101572437663; dx=-2.1520733548135138E-5 evalInputDelta=0.08086592003405713
New Minimum: -127.48101572437663 > -127.96410550984194
WOLFE (weak): th(23393.607721408407)=-127.96410550984194; dx=-2.1356442617178993E-5 evalInputDelta=0.5639557054993674
New Minimum: -127.96410550984194 > -131.75333634573514
WOLFE (weak): th(187148.86177126726)=-131.75333634573514; dx=-1.9755232463846258E-5 evalInputDelta=4.35318654139256
New Minimum: -131.75333634573514 > -152.071557589742
END: th(1684339.7559414054)=-152.071557589742; dx=-5.687621004871609E-6 evalInputDelta=24.67140778539944
Fitness changed from -127.40014980434258 to -152.071557589742
Iteration 2 complete. Error: -152.071557589742 Total: 28.9424; Orientation: 0.0665; Line Search: 25.8506
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 18f77d1 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-152.071557589742;dx=-9.80650696687079E-6
New Minimum: -152.071557589742 > -169.58727581748008
END: th(3628800.0000000005)=-169.58727581748008; dx=-8.924107387427086E-7 evalInputDelta=17.515718227738063
Fitness changed from -152.071557589742 to -169.58727581748008
Iteration 3 complete. Error: -169.58727581748008 Total: 8.2793; Orientation: 0.0623; Line Search: 5.2044
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1be95524 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.574e+03, gradient 3.120e-03, dot -0.318; [e571f0fe-7217-4a58-951c-a055a39fcdaf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -169.58727581748008, -152.071557589742, -127.40014980434258, -127.40008923973525
LBFGS Accumulation History: 3 points
Removed measurement 1be95524 to history. Total: 3
th(0)=-169.58727581748008;dx=-9.725192995196826E-6
Armijo: th(7818012.603187701)=-166.340353812711; dx=3.263015165164363E-6 evalInputDelta=-3.2469220047690897
New Minimum: -169.58727581748008 > -179.66040343285295
WOLF (strong): th(3909006.3015938504)=-179.66040343285295; dx=1.8056077825149033E-6 evalInputDelta=10.073127615372869
END: th(1303002.1005312835)=-179.00998563420347; dx=-3.666180041262468E-6 evalInputDelta=9.422709816723398
Fitness changed from -169.58727581748008 to -179.66040343285295
Iteration 4 complete. Error: -179.66040343285295 Total: 14.3108; Orientation: 1.0913; Line Search: 10.3605
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 72a7f1ce to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.384e+03, gradient 3.229e-03, dot -0.207; [e571f0fe-7217-4a58-951c-a055a39fcdaf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -179.66040343285295, -152.071557589742, -127.40014980434258, -127.40008923973525
LBFGS Accumulation History: 3 points
Removed measurement 72a7f1ce to history. Total: 3
th(0)=-179.66040343285295;dx=-1.0417666146382493E-5
New Minimum: -179.66040343285295 > -193.60493393771475
WOLF (strong): th(2807232.926569009)=-193.60493393771475; dx=6.856009237425221E-7 evalInputDelta=13.944530504861802
END: th(1403616.4632845046)=-191.20415682968533; dx=-4.3358724734206855E-6 evalInputDelta=11.543753396832386
Fitness changed from -179.66040343285295 to -193.60493393771475
Iteration 5 complete. Error: -193.60493393771475 Total: 11.7821; Orientation: 1.0495; Line Search: 7.7362
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2daeddf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.159e+04, gradient 2.501e-03, dot -0.352; [e571f0fe-7217-4a58-951c-a055a39fcdaf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -193.60493393771475, -152.071557589742, -127.40014980434258, -127.40008923973525
LBFGS Accumulation History: 3 points
Removed measurement 2daeddf to history. Total: 3
th(0)=-193.60493393771475;dx=-6.246692774923744E-6
New Minimum: -193.60493393771475 > -202.18327368239667
WOLF (strong): th(3024000.0000000005)=-202.18327368239667; dx=3.8980123717046723E-7 evalInputDelta=8.578339744681927
END: th(1512000.0000000002)=-200.78486471702746; dx=-2.509016575995549E-6 evalInputDelta=7.179930779312713
Fitness changed from -193.60493393771475 to -202.18327368239667
Iteration 6 complete. Error: -202.18327368239667 Total: 11.6971; Orientation: 1.1097; Line Search: 7.6944
Adding measurement 52862aae to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.738e+04, gradient 2.384e-03, dot -0.410; [e571f0fe-7217-4a58-951c-a055a39fcdaf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.18327368239667, -152.071557589742, -127.40014980434258, -127.40008923973525
LBFGS Accumulation History: 3 points
Removed measurement 52862aae to history. Total: 3
th(0)=-202.18327368239667;dx=-5.679747357324233E-6
New Minimum: -202.18327368239667 > -208.72023618594946
WOLF (strong): th(3257505.251328209)=-208.72023618594946; dx=1.2512598118600042E-6 evalInputDelta=6.536962503552786
New Minimum: -208.72023618594946 > -208.76212579746567
END: th(1628752.6256641045)=-208.76212579746567; dx=-1.7572771333587304E-6 evalInputDelta=6.578852115068997
Fitness changed from -202.18327368239667 to -208.76212579746567
Iteration 7 complete. Error: -208.76212579746567 Total: 11.4287; Orientation: 1.1151; Line Search: 7.8294
Adding measurement 3ccf7a0e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.231e+04, gradient 1.649e-03, dot -0.648; [e571f0fe-7217-4a58-951c-a055a39fcdaf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -208.76212579746567, -152.071557589742, -127.40014980434258, -127.40008923973525
LBFGS Accumulation History: 3 points
Removed measurement 3ccf7a0e to history. Total: 3
th(0)=-208.76212579746567;dx=-2.7094376567944844E-6
New Minimum: -208.76212579746567 > -215.7104811672525
END: th(3509041.158211262)=-215.7104811672525; dx=-1.2053269544993957E-6 evalInputDelta=6.948355369786839
Fitness changed from -208.76212579746567 to -215.7104811672525
Iteration 8 complete. Error: -215.7104811672525 Total: 9.0087; Orientation: 1.1147; Line Search: 5.4055
Adding measurement 31f5f39e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.347e+04, gradient 1.849e-03, dot -0.523; [e571f0fe-7217-4a58-951c-a055a39fcdaf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -215.7104811672525, -152.071557589742, -127.40014980434258, -127.40008923973525
LBFGS Accumulation History: 3 points
Removed measurement 31f5f39e to history. Total: 3
th(0)=-215.7104811672525;dx=-3.405982488478975E-6
New Minimum: -215.7104811672525 > -216.52679701118217
WOLF (strong): th(7560000.000000003)=-216.52679701118217; dx=1.178201648157255E-6 evalInputDelta=0.8163158439296581
New Minimum: -216.52679701118217 > -220.37996459979485
WOLF (strong): th(3780000.0000000014)=-220.37996459979485; dx=2.0547460987948375E-7 evalInputDelta=4.669483432542336
END: th(1260000.0000000005)=-219.10832830888648; dx=-1.6783614526326225E-6 evalInputDelta=3.3978471416339744
Fitness changed from -215.7104811672525 to -220.37996459979485
Iteration 9 complete. Error: -220.37996459979485 Total: 13.9817; Orientation: 1.0861; Line Search: 10.4963
Adding measurement 957a8fe to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.158e+04, gradient 2.260e-03, dot -0.361; [e571f0fe-7217-4a58-951c-a055a39fcdaf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -220.37996459979485, -152.071557589742, -127.40014980434258, -127.40008923973525
LBFGS Accumulation History: 3 points
Removed measurement 957a8fe to history. Total: 3
th(0)=-220.37996459979485;dx=-5.102922868866975E-6
New Minimum: -220.37996459979485 > -226.18835645994054
WOLF (strong): th(2714587.7094401745)=-226.18835645994054; dx=7.835068976727677E-7 evalInputDelta=5.80839186014569
END: th(1357293.8547200873)=-225.62597154755284; dx=-1.972097492098895E-6 evalInputDelta=5.246006947757991
Fitness changed from -220.37996459979485 to -226.18835645994054
Iteration 10 complete. Error: -226.18835645994054 Total: 11.3507; Orientation: 1.0514; Line Search: 7.7708
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -226.18835645994054 (> -Infinity) after 134.184s (< 5400.000s)
Returns
-226.18835645994054