BasicOptimizer.scala:89 executed in 218.44 seconds (3.722 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 697842003115300
Reset training subject: 697846716132500
Adding measurement 5edfb4a1 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1259.178601311188;dx=-0.01160019249490359
New Minimum: -1259.178601311188 > -1259.205156040905
WOLFE (weak): th(2.154434690031884)=-1259.205156040905; dx=-0.011412409562229664 evalInputDelta=0.026554729716963266
New Minimum: -1259.205156040905 > -1259.2318591109422
WOLFE (weak): th(4.308869380063768)=-1259.2318591109422; dx=-0.01141076290016987 evalInputDelta=0.05325779975419209
New Minimum: -1259.2318591109422 > -1259.3383183243493
WOLFE (weak): th(12.926608140191302)=-1259.3383183243493; dx=-0.011412828288589354 evalInputDelta=0.15971701316129838
New Minimum: -1259.3383183243493 > -1259.8173974826668
WOLFE (weak): th(51.70643256076521)=-1259.8173974826668; dx=-0.011406978342593091 evalInputDelta=0.6387961714788162
New Minimum: -1259.8173974826668 > -1262.368508003903
WOLFE (weak): th(258.53216280382605)=-1262.368508003903; dx=-0.011374693804441956 evalInputDelta=3.189906692714885
New Minimum: -1262.368508003903 > -1278.130323949792
WOLFE (weak): th(1551.1929768229563)=-1278.130323949792; dx=-0.011148292490523334 evalInputDelta=18.951722638603997
New Minimum: -1278.130323949792 > -1380.7125877603926
END: th(10858.350837760694)=-1380.7125877603926; dx=-0.00919453492463651 evalInputDelta=121.53398644920458
Fitness changed from -1259.178601311188 to -1380.7125877603926
Iteration 1 complete. Error: -1380.7125877603926 Total: 51.0485; Orientation: 0.0989; Line Search: 36.6539
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7aeb7664 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1380.7125877603926;dx=-0.00802509433562007
New Minimum: -1380.7125877603926 > -1551.685374036889
END: th(23393.607721408407)=-1551.685374036889; dx=-0.0055204433499841925 evalInputDelta=170.97278627649644
Fitness changed from -1380.7125877603926 to -1551.685374036889
Iteration 2 complete. Error: -1551.685374036889 Total: 14.6985; Orientation: 0.0841; Line Search: 9.1921
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 5af29050 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1551.685374036889;dx=-0.00478267259475074
New Minimum: -1551.685374036889 > -1769.2117595132586
END: th(50400.00000000001)=-1769.2117595132586; dx=-0.0032389157878286003 evalInputDelta=217.52638547636957
Fitness changed from -1551.685374036889 to -1769.2117595132586
Iteration 3 complete. Error: -1769.2117595132586 Total: 14.7572; Orientation: 0.0986; Line Search: 9.0703
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 58ec991 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.056e+04, gradient 5.623e-02, dot -0.902; [78ca3077-bfbd-4b04-91c8-2ede2332595e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1769.2117595132586, -1551.685374036889, -1380.7125877603926, -1259.178601311188
LBFGS Accumulation History: 3 points
Removed measurement 58ec991 to history. Total: 3
th(0)=-1769.2117595132586;dx=-0.003158872628709599
New Minimum: -1769.2117595132586 > -2061.548568431023
END: th(108583.50837760697)=-2061.548568431023; dx=-0.0018860162914799165 evalInputDelta=292.3368089177643
Fitness changed from -1769.2117595132586 to -2061.548568431023
Iteration 4 complete. Error: -2061.548568431023 Total: 16.0124; Orientation: 1.7088; Line Search: 8.9470
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5e4e20f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.334e+04, gradient 4.995e-02, dot -0.743; [78ca3077-bfbd-4b04-91c8-2ede2332595e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2061.548568431023, -1551.685374036889, -1380.7125877603926, -1259.178601311188
LBFGS Accumulation History: 3 points
Removed measurement 5e4e20f to history. Total: 3
th(0)=-2061.548568431023;dx=-0.002493531633383982
New Minimum: -2061.548568431023 > -2383.751979548208
END: th(233936.07721408413)=-2383.751979548208; dx=-6.207776902278743E-4 evalInputDelta=322.20341111718517
Fitness changed from -2061.548568431023 to -2383.751979548208
Iteration 5 complete. Error: -2383.751979548208 Total: 16.2626; Orientation: 1.6583; Line Search: 8.9473
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 57a4928b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.420e+04, gradient 5.896e-02, dot -0.444; [78ca3077-bfbd-4b04-91c8-2ede2332595e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2383.751979548208, -1551.685374036889, -1380.7125877603926, -1259.178601311188
LBFGS Accumulation History: 3 points
Removed measurement 57a4928b to history. Total: 3
th(0)=-2383.751979548208;dx=-0.003473580633821893
Armijo: th(504000.0000000002)=-2281.586838145767; dx=7.339775234742506E-4 evalInputDelta=-102.1651414024409
New Minimum: -2383.751979548208 > -2503.4507185083553
WOLF (strong): th(252000.0000000001)=-2503.4507185083553; dx=7.373179829809904E-4 evalInputDelta=119.69873896014724
New Minimum: -2503.4507185083553 > -2566.0504671576514
END: th(84000.00000000003)=-2566.0504671576514; dx=-7.427055037478392E-4 evalInputDelta=182.29848760944333
Fitness changed from -2383.751979548208 to -2566.0504671576514
Iteration 6 complete. Error: -2566.0504671576514 Total: 25.2342; Orientation: 1.6701; Line Search: 18.1317
Adding measurement 727b1ca9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.966e+04, gradient 4.730e-02, dot -0.558; [78ca3077-bfbd-4b04-91c8-2ede2332595e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2566.0504671576514, -1551.685374036889, -1380.7125877603926, -1259.178601311188
LBFGS Accumulation History: 3 points
Removed measurement 727b1ca9 to history. Total: 3
th(0)=-2566.0504671576514;dx=-0.002237277449922667
New Minimum: -2566.0504671576514 > -2726.6945190101515
END: th(180972.5139626783)=-2726.6945190101515; dx=-3.2254950295333384E-5 evalInputDelta=160.64405185250007
Fitness changed from -2566.0504671576514 to -2726.6945190101515
Iteration 7 complete. Error: -2726.6945190101515 Total: 15.0902; Orientation: 1.5847; Line Search: 8.9311
Adding measurement 17447f9b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.297e+04, gradient 6.013e-02, dot -0.413; [78ca3077-bfbd-4b04-91c8-2ede2332595e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2726.6945190101515, -1551.685374036889, -1380.7125877603926, -1259.178601311188
LBFGS Accumulation History: 3 points
Removed measurement 17447f9b to history. Total: 3
th(0)=-2726.6945190101515;dx=-0.0036102776030386397
Armijo: th(389893.4620234736)=-2568.3447977247915; dx=9.934484750184214E-4 evalInputDelta=-158.34972128535992
New Minimum: -2726.6945190101515 > -2809.9475084065184
WOLF (strong): th(194946.7310117368)=-2809.9475084065184; dx=0.0010750715815044934 evalInputDelta=83.25298939636696
New Minimum: -2809.9475084065184 > -2881.6257564090447
END: th(64982.24367057893)=-2881.6257564090447; dx=-9.000700910346037E-4 evalInputDelta=154.93123739889324
Fitness changed from -2726.6945190101515 to -2881.6257564090447
Iteration 8 complete. Error: -2881.6257564090447 Total: 24.6255; Orientation: 1.6369; Line Search: 18.3964
Adding measurement 3041717b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.809e+04, gradient 4.135e-02, dot -0.594; [78ca3077-bfbd-4b04-91c8-2ede2332595e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2881.6257564090447, -1551.685374036889, -1380.7125877603926, -1259.178601311188
LBFGS Accumulation History: 3 points
Removed measurement 3041717b to history. Total: 3
th(0)=-2881.6257564090447;dx=-0.0017074033855488918
New Minimum: -2881.6257564090447 > -3022.6898616960357
END: th(140000.00000000006)=-3022.6898616960357; dx=-3.8267019222490173E-4 evalInputDelta=141.06410528699098
Fitness changed from -2881.6257564090447 to -3022.6898616960357
Iteration 9 complete. Error: -3022.6898616960357 Total: 15.5308; Orientation: 1.6518; Line Search: 9.3295
Adding measurement 65ef2a5d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.190e+04, gradient 4.854e-02, dot -0.493; [78ca3077-bfbd-4b04-91c8-2ede2332595e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -3022.6898616960357, -1551.685374036889, -1380.7125877603926, -1259.178601311188
LBFGS Accumulation History: 3 points
Removed measurement 65ef2a5d to history. Total: 3
th(0)=-3022.6898616960357;dx=-0.002354813274557155
Armijo: th(301620.8566044639)=-3004.204553621474; dx=6.354402429796506E-4 evalInputDelta=-18.485308074561544
New Minimum: -3022.6898616960357 > -3105.662570209455
WOLF (strong): th(150810.42830223194)=-3105.662570209455; dx=4.0140926992101813E-4 evalInputDelta=82.97270851341955
New Minimum: -3105.662570209455 > -3105.745965142674
END: th(50270.142767410645)=-3105.745965142674; dx=-8.469515708620628E-4 evalInputDelta=83.05610344663819
Fitness changed from -3022.6898616960357 to -3105.745965142674
Iteration 10 complete. Error: -3105.745965142674 Total: 24.2328; Orientation: 1.6225; Line Search: 18.3112
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -3105.745965142674 (> -Infinity) after 218.442s (< 5400.000s)
Returns
-3105.745965142674