BasicOptimizer.scala:89 executed in 219.53 seconds (3.777 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 695896514225600
Reset training subject: 695901083520200
Adding measurement 218266de to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-918.7042505616266;dx=-0.005599814474713695
New Minimum: -918.7042505616266 > -918.7159857649152
END: th(2.154434690031884)=-918.7159857649152; dx=-0.004983573516150988 evalInputDelta=0.011735203288594676
Fitness changed from -918.7042505616266 to -918.7159857649152
Iteration 1 complete. Error: -918.7159857649152 Total: 22.7010; Orientation: 0.0979; Line Search: 9.2867
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3e0f8d0c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-918.7159857649152;dx=-0.004979796017120226
New Minimum: -918.7159857649152 > -918.7411904339546
WOLFE (weak): th(4.641588833612779)=-918.7411904339546; dx=-0.004972715787796664 evalInputDelta=0.025204669039339933
New Minimum: -918.7411904339546 > -918.7664284245479
WOLFE (weak): th(9.283177667225559)=-918.7664284245479; dx=-0.0049769504206146585 evalInputDelta=0.0504426596327221
New Minimum: -918.7664284245479 > -918.8673054364269
WOLFE (weak): th(27.849533001676676)=-918.8673054364269; dx=-0.0049721012578122625 evalInputDelta=0.15131967151171466
New Minimum: -918.8673054364269 > -919.320911053371
WOLFE (weak): th(111.3981320067067)=-919.320911053371; dx=-0.004972478681963029 evalInputDelta=0.6049252884557745
New Minimum: -919.320911053371 > -921.7359979950875
WOLFE (weak): th(556.9906600335335)=-921.7359979950875; dx=-0.00495637752246874 evalInputDelta=3.020012230172256
New Minimum: -921.7359979950875 > -936.6672634932855
WOLFE (weak): th(3341.9439602012008)=-936.6672634932855; dx=-0.004864662631829538 evalInputDelta=17.951277728370314
New Minimum: -936.6672634932855 > -1033.6592765510306
END: th(23393.607721408407)=-1033.6592765510306; dx=-0.003963717043461929 evalInputDelta=114.94329078611543
Fitness changed from -918.7159857649152 to -1033.6592765510306
Iteration 2 complete. Error: -1033.6592765510306 Total: 41.7529; Orientation: 0.0971; Line Search: 36.1184
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 82f1f67 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1033.6592765510306;dx=-0.0037987074644872726
New Minimum: -1033.6592765510306 > -1204.7125175742137
END: th(50400.00000000001)=-1204.7125175742137; dx=-0.002482800447443867 evalInputDelta=171.0532410231831
Fitness changed from -1033.6592765510306 to -1204.7125175742137
Iteration 3 complete. Error: -1204.7125175742137 Total: 14.4075; Orientation: 0.0911; Line Search: 8.8814
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2f34a397 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.573e+03, gradient 5.117e-02, dot -0.765; [9e210356-08df-47a0-bbfc-10b9820704af = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1204.7125175742137, -1033.6592765510306, -918.7159857649152, -918.7042505616266
LBFGS Accumulation History: 3 points
Removed measurement 2f34a397 to history. Total: 3
th(0)=-1204.7125175742137;dx=-0.002617181859290413
New Minimum: -1204.7125175742137 > -1429.1435372278042
END: th(108583.50837760697)=-1429.1435372278042; dx=-0.0013631495107191925 evalInputDelta=224.4310196535905
Fitness changed from -1204.7125175742137 to -1429.1435372278042
Iteration 4 complete. Error: -1429.1435372278042 Total: 16.9308; Orientation: 1.7714; Line Search: 9.5445
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5d5ebb1e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.221e+03, gradient 4.912e-02, dot -0.558; [9e210356-08df-47a0-bbfc-10b9820704af = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1429.1435372278042, -1033.6592765510306, -918.7159857649152, -918.7042505616266
LBFGS Accumulation History: 3 points
Removed measurement 5d5ebb1e to history. Total: 3
th(0)=-1429.1435372278042;dx=-0.002408402444929245
New Minimum: -1429.1435372278042 > -1656.9836299734527
END: th(233936.07721408413)=-1656.9836299734527; dx=-3.7975892465212923E-4 evalInputDelta=227.84009274564846
Fitness changed from -1429.1435372278042 to -1656.9836299734527
Iteration 5 complete. Error: -1656.9836299734527 Total: 16.6367; Orientation: 1.6748; Line Search: 9.4260
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1b0c511 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.990e+03, gradient 5.559e-02, dot -0.257; [9e210356-08df-47a0-bbfc-10b9820704af = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1656.9836299734527, -1033.6592765510306, -918.7159857649152, -918.7042505616266
LBFGS Accumulation History: 3 points
Removed measurement 1b0c511 to history. Total: 3
th(0)=-1656.9836299734527;dx=-0.003088056458521834
New Minimum: -1656.9836299734527 > -1759.9332373700997
WOLF (strong): th(504000.0000000002)=-1759.9332373700997; dx=2.659868594972999E-4 evalInputDelta=102.94960739664702
New Minimum: -1759.9332373700997 > -1844.7127825219839
WOLF (strong): th(252000.0000000001)=-1844.7127825219839; dx=1.7052512326309687E-4 evalInputDelta=187.72915254853115
END: th(84000.00000000003)=-1824.1859143190422; dx=-8.322157388543662E-4 evalInputDelta=167.20228434558953
Fitness changed from -1656.9836299734527 to -1844.7127825219839
Iteration 6 complete. Error: -1844.7127825219839 Total: 25.1600; Orientation: 1.6286; Line Search: 17.9342
Adding measurement 220f35fe to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.086e+04, gradient 5.686e-02, dot -0.213; [9e210356-08df-47a0-bbfc-10b9820704af = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1844.7127825219839, -1033.6592765510306, -918.7159857649152, -918.7042505616266
LBFGS Accumulation History: 3 points
Removed measurement 220f35fe to history. Total: 3
th(0)=-1844.7127825219839;dx=-0.0032286991579630053
New Minimum: -1844.7127825219839 > -2089.5946975430425
WOLF (strong): th(180972.5139626783)=-2089.5946975430425; dx=3.9703424862636896E-5 evalInputDelta=244.8819150210586
END: th(90486.25698133915)=-2053.784190220579; dx=-0.0010356549688668331 evalInputDelta=209.0714076985953
Fitness changed from -1844.7127825219839 to -2089.5946975430425
Iteration 7 complete. Error: -2089.5946975430425 Total: 21.1650; Orientation: 1.7516; Line Search: 14.8281
Adding measurement 115edb6e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.670e+04, gradient 5.321e-02, dot -0.267; [9e210356-08df-47a0-bbfc-10b9820704af = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2089.5946975430425, -1033.6592765510306, -918.7159857649152, -918.7042505616266
LBFGS Accumulation History: 3 points
Removed measurement 115edb6e to history. Total: 3
th(0)=-2089.5946975430425;dx=-0.0028258192685246906
New Minimum: -2089.5946975430425 > -2266.0247130161665
WOLF (strong): th(194946.7310117368)=-2266.0247130161665; dx=3.159978117408235E-4 evalInputDelta=176.43001547312406
END: th(97473.3655058684)=-2264.0841415459804; dx=-6.200870713218686E-4 evalInputDelta=174.48944400293794
Fitness changed from -2089.5946975430425 to -2266.0247130161665
Iteration 8 complete. Error: -2266.0247130161665 Total: 19.6111; Orientation: 1.7341; Line Search: 13.6362
Adding measurement 40162548 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.229e+04, gradient 5.570e-02, dot -0.263; [9e210356-08df-47a0-bbfc-10b9820704af = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2266.0247130161665, -1033.6592765510306, -918.7159857649152, -918.7042505616266
LBFGS Accumulation History: 3 points
Removed measurement 40162548 to history. Total: 3
th(0)=-2266.0247130161665;dx=-0.0031017605988062106
New Minimum: -2266.0247130161665 > -2416.39711140367
WOLF (strong): th(210000.0000000001)=-2416.39711140367; dx=6.8856874589927E-4 evalInputDelta=150.37239838750338
New Minimum: -2416.39711140367 > -2452.2463171549466
END: th(105000.00000000004)=-2452.2463171549466; dx=-3.93580496676656E-4 evalInputDelta=186.2216041387801
Fitness changed from -2266.0247130161665 to -2452.2463171549466
Iteration 9 complete. Error: -2452.2463171549466 Total: 19.7537; Orientation: 1.6096; Line Search: 13.6833
Adding measurement 4830851f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.375e+04, gradient 4.263e-02, dot -0.413; [9e210356-08df-47a0-bbfc-10b9820704af = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2452.2463171549466, -1033.6592765510306, -918.7159857649152, -918.7042505616266
LBFGS Accumulation History: 3 points
Removed measurement 4830851f to history. Total: 3
th(0)=-2452.2463171549466;dx=-0.0018163514198792836
New Minimum: -2452.2463171549466 > -2589.283588176467
WOLF (strong): th(226215.6424533479)=-2589.283588176467; dx=1.0499927142242266E-5 evalInputDelta=137.0372710215206
END: th(113107.82122667394)=-2572.3060665480693; dx=-4.5780433661396605E-4 evalInputDelta=120.05974939312273
Fitness changed from -2452.2463171549466 to -2589.283588176467
Iteration 10 complete. Error: -2589.283588176467 Total: 20.4855; Orientation: 1.5924; Line Search: 14.3721
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2589.283588176467 (> -Infinity) after 219.531s (< 5400.000s)
Returns
-2589.283588176467