BasicOptimizer.scala:89 executed in 83.07 seconds (1.433 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 303578222978300
Reset training subject: 303580388857200
Adding measurement 14d25b6e to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-278.85651847484553;dx=-2.486943310586163E-5
New Minimum: -278.85651847484553 > -278.8565627591129
END: th(2.154434690031884)=-278.8565627591129; dx=-1.805824309852012E-5 evalInputDelta=4.428426734648383E-5
Fitness changed from -278.85651847484553 to -278.8565627591129
Iteration 1 complete. Error: -278.8565627591129 Total: 9.6308; Orientation: 0.2624; Line Search: 4.0394
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7841bd30 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-278.8565627591129;dx=-1.7878201936289604E-5
New Minimum: -278.8565627591129 > -278.8566660890427
WOLFE (weak): th(4.641588833612779)=-278.8566660890427; dx=-1.786053078461287E-5 evalInputDelta=1.0332992980011113E-4
New Minimum: -278.8566660890427 > -278.8567546575234
WOLFE (weak): th(9.283177667225559)=-278.8567546575234; dx=-1.786090188711283E-5 evalInputDelta=1.918984105486743E-4
New Minimum: -278.8567546575234 > -278.85712369255725
WOLFE (weak): th(27.849533001676676)=-278.85712369255725; dx=-1.787135662252016E-5 evalInputDelta=5.609334443761327E-4
New Minimum: -278.85712369255725 > -278.85879172481765
WOLFE (weak): th(111.3981320067067)=-278.85879172481765; dx=-1.78637821692736E-5 evalInputDelta=0.0022289657047736
New Minimum: -278.85879172481765 > -278.86766312697983
WOLFE (weak): th(556.9906600335335)=-278.86766312697983; dx=-1.784118674124882E-5 evalInputDelta=0.011100367866959004
New Minimum: -278.86766312697983 > -278.9231878556495
WOLFE (weak): th(3341.9439602012008)=-278.9231878556495; dx=-1.7823082554645478E-5 evalInputDelta=0.06662509653659754
New Minimum: -278.9231878556495 > -279.3215731325728
WOLFE (weak): th(23393.607721408407)=-279.3215731325728; dx=-1.7720107576227064E-5 evalInputDelta=0.46501037345990426
New Minimum: -279.3215731325728 > -282.38890289671474
END: th(187148.86177126726)=-282.38890289671474; dx=-1.5906861123572595E-5 evalInputDelta=3.5323401376018637
Fitness changed from -278.8565627591129 to -282.38890289671474
Iteration 2 complete. Error: -282.38890289671474 Total: 17.3365; Orientation: 0.0468; Line Search: 15.1875
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 621392ea to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-282.38890289671474;dx=-1.5823948291547284E-5
New Minimum: -282.38890289671474 > -288.638644556161
END: th(403200.00000000006)=-288.638644556161; dx=-1.246180876718764E-5 evalInputDelta=6.249741659446272
Fitness changed from -282.38890289671474 to -288.638644556161
Iteration 3 complete. Error: -288.638644556161 Total: 5.4102; Orientation: 0.0445; Line Search: 3.4353
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 425f94d7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.182e+03, gradient 3.446e-03, dot -0.908; [83d0a5fc-8d82-461b-bd6c-365c3ad2aaea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -288.638644556161, -282.38890289671474, -278.8565627591129, -278.85651847484553
LBFGS Accumulation History: 3 points
Removed measurement 425f94d7 to history. Total: 3
th(0)=-288.638644556161;dx=-1.186189114244839E-5
New Minimum: -288.638644556161 > -298.0730709946814
END: th(868668.0670208557)=-298.0730709946814; dx=-7.983030756944683E-6 evalInputDelta=9.434426438520404
Fitness changed from -288.638644556161 to -298.0730709946814
Iteration 4 complete. Error: -298.0730709946814 Total: 6.6438; Orientation: 1.1371; Line Search: 3.6449
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 18f27a81 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.371e+03, gradient 2.764e-03, dot -0.809; [83d0a5fc-8d82-461b-bd6c-365c3ad2aaea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -298.0730709946814, -282.38890289671474, -278.8565627591129, -278.85651847484553
LBFGS Accumulation History: 3 points
Removed measurement 18f27a81 to history. Total: 3
th(0)=-298.0730709946814;dx=-7.620648001970725E-6
New Minimum: -298.0730709946814 > -310.2305603687159
END: th(1871488.617712673)=-310.2305603687159; dx=-4.692934440797948E-6 evalInputDelta=12.15748937403447
Fitness changed from -298.0730709946814 to -310.2305603687159
Iteration 5 complete. Error: -310.2305603687159 Total: 6.5049; Orientation: 1.1076; Line Search: 3.5320
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement d28a235 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.204e+03, gradient 2.238e-03, dot -0.710; [83d0a5fc-8d82-461b-bd6c-365c3ad2aaea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -310.2305603687159, -282.38890289671474, -278.8565627591129, -278.85651847484553
LBFGS Accumulation History: 3 points
Removed measurement d28a235 to history. Total: 3
th(0)=-310.2305603687159;dx=-4.979680842080176E-6
New Minimum: -310.2305603687159 > -326.05011438092674
END: th(4032000.0000000014)=-326.05011438092674; dx=-2.7126173018831988E-6 evalInputDelta=15.819554012210858
Fitness changed from -310.2305603687159 to -326.05011438092674
Iteration 6 complete. Error: -326.05011438092674 Total: 6.2507; Orientation: 1.0845; Line Search: 3.3665
Adding measurement 69c51fdb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.078e+04, gradient 2.058e-03, dot -0.619; [83d0a5fc-8d82-461b-bd6c-365c3ad2aaea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -326.05011438092674, -282.38890289671474, -278.8565627591129, -278.85651847484553
LBFGS Accumulation History: 3 points
Removed measurement 69c51fdb to history. Total: 3
th(0)=-326.05011438092674;dx=-4.232370950395644E-6
New Minimum: -326.05011438092674 > -339.4249722191614
END: th(8686680.670208558)=-339.4249722191614; dx=-1.6825268697208586E-7 evalInputDelta=13.374857838234675
Fitness changed from -326.05011438092674 to -339.4249722191614
Iteration 7 complete. Error: -339.4249722191614 Total: 5.8978; Orientation: 1.0333; Line Search: 3.2704
Adding measurement 1abd1a28 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.359e+03, gradient 2.836e-03, dot -0.193; [83d0a5fc-8d82-461b-bd6c-365c3ad2aaea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -339.4249722191614, -282.38890289671474, -278.8565627591129, -278.85651847484553
LBFGS Accumulation History: 3 points
Removed measurement 1abd1a28 to history. Total: 3
th(0)=-339.4249722191614;dx=-8.033074655232902E-6
Armijo: th(1.871488617712673E7)=-278.6100118369115; dx=3.995534421546822E-6 evalInputDelta=-60.81496038224992
Armijo: th(9357443.088563366)=-328.784518300686; dx=4.730252580924963E-6 evalInputDelta=-10.64045391847543
New Minimum: -339.4249722191614 > -352.9114016255458
END: th(3119147.6961877886)=-352.9114016255458; dx=-1.8848904814832775E-7 evalInputDelta=13.486429406384389
Fitness changed from -339.4249722191614 to -352.9114016255458
Iteration 8 complete. Error: -352.9114016255458 Total: 9.4023; Orientation: 1.0825; Line Search: 6.6850
Adding measurement 14af9f51 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.543e+04, gradient 1.890e-03, dot -0.445; [83d0a5fc-8d82-461b-bd6c-365c3ad2aaea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -352.9114016255458, -282.38890289671474, -278.8565627591129, -278.85651847484553
LBFGS Accumulation History: 3 points
Removed measurement 14af9f51 to history. Total: 3
th(0)=-352.9114016255458;dx=-3.573274258536832E-6
New Minimum: -352.9114016255458 > -357.2366698961822
WOLF (strong): th(6720000.000000003)=-357.2366698961822; dx=1.2410115450026763E-6 evalInputDelta=4.3252682706364
New Minimum: -357.2366698961822 > -359.6355508784734
END: th(3360000.0000000014)=-359.6355508784734; dx=-4.739784821126252E-7 evalInputDelta=6.724149252927589
Fitness changed from -352.9114016255458 to -359.6355508784734
Iteration 9 complete. Error: -359.6355508784734 Total: 7.7386; Orientation: 1.1142; Line Search: 5.0322
Adding measurement 4b094115 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.675e+04, gradient 1.751e-03, dot -0.473; [83d0a5fc-8d82-461b-bd6c-365c3ad2aaea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -359.6355508784734, -282.38890289671474, -278.8565627591129, -278.85651847484553
LBFGS Accumulation History: 3 points
Removed measurement 4b094115 to history. Total: 3
th(0)=-359.6355508784734;dx=-3.061844599783756E-6
New Minimum: -359.6355508784734 > -361.85372932965527
WOLF (strong): th(7238900.558507132)=-361.85372932965527; dx=1.1830784683309645E-6 evalInputDelta=2.2181784511818705
New Minimum: -361.85372932965527 > -364.96735018523253
END: th(3619450.279253566)=-364.96735018523253; dx=-1.0502240764417231E-7 evalInputDelta=5.331799306759137
Fitness changed from -359.6355508784734 to -364.96735018523253
Iteration 10 complete. Error: -364.96735018523253 Total: 7.9086; Orientation: 1.1031; Line Search: 5.1864
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -364.96735018523253 (> -Infinity) after 83.061s (< 5400.000s)
Returns
-364.96735018523253