BasicOptimizer.scala:89 executed in 129.18 seconds (1.915 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 35358847078900
Reset training subject: 35361484644800
Adding measurement 5eea325d to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-79.98252797913692;dx=-4.845997210832137E-6
New Minimum: -79.98252797913692 > -79.98253653573009
END: th(2.154434690031884)=-79.98253653573009; dx=-3.2781964530587917E-6 evalInputDelta=8.556593172670546E-6
Fitness changed from -79.98252797913692 to -79.98253653573009
Iteration 1 complete. Error: -79.98253653573009 Total: 12.8016; Orientation: 0.0625; Line Search: 5.1524
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 603a19e0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-79.98253653573009;dx=-3.252346440254299E-6
New Minimum: -79.98253653573009 > -79.98255364891371
WOLFE (weak): th(4.641588833612779)=-79.98255364891371; dx=-3.250834231222273E-6 evalInputDelta=1.7113183616856986E-5
New Minimum: -79.98255364891371 > -79.98257076209366
WOLFE (weak): th(9.283177667225559)=-79.98257076209366; dx=-3.2498757137064122E-6 evalInputDelta=3.4226363567313456E-5
New Minimum: -79.98257076209366 > -79.98263921477682
WOLFE (weak): th(27.849533001676676)=-79.98263921477682; dx=-3.2477843244022042E-6 evalInputDelta=1.0267904673355588E-4
New Minimum: -79.98263921477682 > -79.98294725112612
WOLFE (weak): th(111.3981320067067)=-79.98294725112612; dx=-3.2462271146080577E-6 evalInputDelta=4.1071539602910434E-4
New Minimum: -79.98294725112612 > -79.98459436980673
WOLFE (weak): th(556.9906600335335)=-79.98459436980673; dx=-3.245561234947046E-6 evalInputDelta=0.0020578340766377323
New Minimum: -79.98459436980673 > -79.99489130140806
WOLFE (weak): th(3341.9439602012008)=-79.99489130140806; dx=-3.24499437347624E-6 evalInputDelta=0.012354765677969226
New Minimum: -79.99489130140806 > -80.06894139883663
WOLFE (weak): th(23393.607721408407)=-80.06894139883663; dx=-3.2394377357395996E-6 evalInputDelta=0.08640486310653728
New Minimum: -80.06894139883663 > -80.66838881446412
WOLFE (weak): th(187148.86177126726)=-80.66838881446412; dx=-3.185660630839615E-6 evalInputDelta=0.685852278734032
New Minimum: -80.66838881446412 > -85.63292945852696
END: th(1684339.7559414054)=-85.63292945852696; dx=-2.605345284306155E-6 evalInputDelta=5.650392922796868
Fitness changed from -79.98253653573009 to -85.63292945852696
Iteration 2 complete. Error: -85.63292945852696 Total: 29.3399; Orientation: 0.0608; Line Search: 26.1427
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 55171a13 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-85.63292945852696;dx=-2.5299178994695814E-6
New Minimum: -85.63292945852696 > -93.81414297074559
END: th(3628800.0000000005)=-93.81414297074559; dx=-1.5165804281312289E-6 evalInputDelta=8.181213512218633
Fitness changed from -85.63292945852696 to -93.81414297074559
Iteration 3 complete. Error: -93.81414297074559 Total: 8.1802; Orientation: 0.0628; Line Search: 5.0089
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5c520cf9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.167e+04, gradient 1.250e-03, dot -0.734; [c84dd0f9-560d-4e48-8e9b-045a029df6fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.81414297074559, -85.63292945852696, -79.98253653573009, -79.98252797913692
LBFGS Accumulation History: 3 points
Removed measurement 5c520cf9 to history. Total: 3
th(0)=-93.81414297074559;dx=-1.5603548036285238E-6
New Minimum: -93.81414297074559 > -103.67220969958626
END: th(7818012.603187701)=-103.67220969958626; dx=-7.229959109358042E-7 evalInputDelta=9.858066728840669
Fitness changed from -93.81414297074559 to -103.67220969958626
Iteration 4 complete. Error: -103.67220969958626 Total: 9.3187; Orientation: 1.0701; Line Search: 5.1674
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 71df2a68 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.289e+04, gradient 1.164e-03, dot -0.513; [c84dd0f9-560d-4e48-8e9b-045a029df6fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -103.67220969958626, -85.63292945852696, -79.98253653573009, -79.98252797913692
LBFGS Accumulation History: 3 points
Removed measurement 71df2a68 to history. Total: 3
th(0)=-103.67220969958626;dx=-1.3530931425261287E-6
New Minimum: -103.67220969958626 > -108.91805274689813
WOLF (strong): th(1.6843397559414055E7)=-108.91805274689813; dx=2.077519492753455E-7 evalInputDelta=5.245843047311865
New Minimum: -108.91805274689813 > -109.67592363606296
END: th(8421698.779707028)=-109.67592363606296; dx=-1.5514942882756442E-7 evalInputDelta=6.0037139364767
Fitness changed from -103.67220969958626 to -109.67592363606296
Iteration 5 complete. Error: -109.67592363606296 Total: 12.0023; Orientation: 1.0747; Line Search: 7.8372
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement cb3a99 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.396e+04, gradient 1.360e-03, dot -0.369; [c84dd0f9-560d-4e48-8e9b-045a029df6fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -109.67592363606296, -85.63292945852696, -79.98253653573009, -79.98252797913692
LBFGS Accumulation History: 3 points
Removed measurement cb3a99 to history. Total: 3
th(0)=-109.67592363606296;dx=-1.8467819727795618E-6
Armijo: th(1.8144000000000004E7)=-104.60939746809791; dx=8.186537884474118E-7 evalInputDelta=-5.066526167965051
New Minimum: -109.67592363606296 > -113.28949041746208
WOLF (strong): th(9072000.000000002)=-113.28949041746208; dx=6.481946337681785E-7 evalInputDelta=3.613566781399115
New Minimum: -113.28949041746208 > -114.2628400899256
END: th(3024000.0000000005)=-114.2628400899256; dx=-7.84369045818417E-7 evalInputDelta=4.586916453862642
Fitness changed from -109.67592363606296 to -114.2628400899256
Iteration 6 complete. Error: -114.2628400899256 Total: 14.3376; Orientation: 1.0539; Line Search: 10.3689
Adding measurement 200409f4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.242e+04, gradient 9.034e-04, dot -0.675; [c84dd0f9-560d-4e48-8e9b-045a029df6fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -114.2628400899256, -85.63292945852696, -79.98253653573009, -79.98252797913692
LBFGS Accumulation History: 3 points
Removed measurement 200409f4 to history. Total: 3
th(0)=-114.2628400899256;dx=-8.161101786149442E-7
New Minimum: -114.2628400899256 > -118.8238644532637
END: th(6515010.502656418)=-118.8238644532637; dx=-4.708470135234162E-7 evalInputDelta=4.561024363338092
Fitness changed from -114.2628400899256 to -118.8238644532637
Iteration 7 complete. Error: -118.8238644532637 Total: 8.8097; Orientation: 1.0352; Line Search: 5.3155
Adding measurement 478e2a44 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.559e+04, gradient 9.187e-04, dot -0.611; [c84dd0f9-560d-4e48-8e9b-045a029df6fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -118.8238644532637, -85.63292945852696, -79.98253653573009, -79.98252797913692
LBFGS Accumulation History: 3 points
Removed measurement 478e2a44 to history. Total: 3
th(0)=-118.8238644532637;dx=-8.432056288264767E-7
New Minimum: -118.8238644532637 > -123.34532423106705
END: th(1.4036164632845048E7)=-123.34532423106705; dx=-4.607129977576912E-9 evalInputDelta=4.521459777803358
Fitness changed from -118.8238644532637 to -123.34532423106705
Iteration 8 complete. Error: -123.34532423106705 Total: 8.6331; Orientation: 1.0638; Line Search: 5.1512
Adding measurement 12e547c0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.948e+04, gradient 1.363e-03, dot -0.268; [c84dd0f9-560d-4e48-8e9b-045a029df6fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -123.34532423106705, -85.63292945852696, -79.98253653573009, -79.98252797913692
LBFGS Accumulation History: 3 points
Removed measurement 12e547c0 to history. Total: 3
th(0)=-123.34532423106705;dx=-1.8559745927151186E-6
Armijo: th(3.024000000000001E7)=-100.91003992554162; dx=8.212287947953978E-7 evalInputDelta=-22.43528430552543
Armijo: th(1.5120000000000006E7)=-119.36362626558046; dx=1.174549061084638E-6 evalInputDelta=-3.981697965486589
New Minimum: -123.34532423106705 > -129.28352964877618
END: th(5040000.000000002)=-129.28352964877618; dx=-1.196444782946919E-7 evalInputDelta=5.938205417709128
Fitness changed from -123.34532423106705 to -129.28352964877618
Iteration 9 complete. Error: -129.28352964877618 Total: 13.9503; Orientation: 0.9966; Line Search: 10.2397
Adding measurement 7b3b3f2a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.985e+04, gradient 9.084e-04, dot -0.496; [c84dd0f9-560d-4e48-8e9b-045a029df6fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -129.28352964877618, -85.63292945852696, -79.98253653573009, -79.98252797913692
LBFGS Accumulation History: 3 points
Removed measurement 7b3b3f2a to history. Total: 3
th(0)=-129.28352964877618;dx=-8.247763150247973E-7
New Minimum: -129.28352964877618 > -131.6147686975861
WOLF (strong): th(1.0858350837760698E7)=-131.6147686975861; dx=2.2890178661425848E-7 evalInputDelta=2.3312390488099197
New Minimum: -131.6147686975861 > -132.1498538578619
END: th(5429175.418880349)=-132.1498538578619; dx=-1.563962941940302E-7 evalInputDelta=2.866324209085718
Fitness changed from -129.28352964877618 to -132.1498538578619
Iteration 10 complete. Error: -132.1498538578619 Total: 11.3464; Orientation: 1.0239; Line Search: 7.7006
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -132.1498538578619 (> -Infinity) after 129.185s (< 5400.000s)
Returns
-132.1498538578619