Code from BasicOptimizer.scala:75 executed in 95.68 seconds (2.774 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 901099833235000
Reset training subject: 901100747310800
Adding measurement 6ee7c941 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=4.280583396553993;dx=-1.2804875357713883E-4
New Minimum: 4.280583396553993 > 4.280349977314472
WOLFE (weak): th(2.154434690031884)=4.280349977314472; dx=-1.2811479168578702E-4 evalInputDelta=2.334192395210266E-4
New Minimum: 4.280349977314472 > 4.280116558074951
WOLFE (weak): th(4.308869380063768)=4.280116558074951; dx=-1.282008561468841E-4 evalInputDelta=4.668384790420532E-4
New Minimum: 4.280116558074951 > 4.279180973768234
WOLFE (weak): th(12.926608140191302)=4.279180973768234; dx=-1.2833728197086925E-4 evalInputDelta=0.0014024227857589722
New Minimum: 4.279180973768234 > 4.274958431720734
WOLFE (weak): th(51.70643256076521)=4.274958431720734; dx=-1.2914281558794004E-4 evalInputDelta=0.0056249648332595825
New Minimum: 4.274958431720734 > 4.253507975488901
WOLFE (weak): th(258.53216280382605)=4.253507975488901; dx=-1.308026446755902E-4 evalInputDelta=0.027075421065092087
New Minimum: 4.253507975488901 > 4.118804566562176
END: th(1551.1929768229563)=4.118804566562176; dx=-1.1386879898024358E-4 evalInputDelta=0.16177882999181747
Fitness changed from 4.280583396553993 to 4.118804566562176
Iteration 1 complete. Error: 4.118804566562176 Total: 9.1514; Orientation: 0.0147; Line Search: 6.7169
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 74b1b98c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=4.118804566562176;dx=-1.1611207785368203E-4
New Minimum: 4.118804566562176 > 3.827805232256651
END: th(3341.943960201201)=3.827805232256651; dx=-8.77002276643815E-5 evalInputDelta=0.2909993343055248
Fitness changed from 4.118804566562176 to 3.827805232256651
Iteration 2 complete. Error: 3.827805232256651 Total: 2.7113; Orientation: 0.0144; Line Search: 1.8490
<a id="p-5"></a>Iteration 2
<a id=
...skipping 19041 bytes...
: 1.7240
Adding measurement 6deda1cd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.496e+02, gradient 1.385e-04, dot -0.897; [c93f7c11-d681-481d-b565-5747faf5d6be = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.16072827577590942, 0.14914777874946594, 0.13328078389167786, 0.1216362714767456
LBFGS Accumulation History: 3 points
Removed measurement 6208a618 to history. Total: 4
th(0)=0.1216362714767456;dx=-1.9176782098271515E-8
New Minimum: 0.1216362714767456 > 0.10357651114463806
END: th(1736111.111111113)=0.10357651114463806; dx=-9.078149577781997E-9 evalInputDelta=0.018059760332107544
Fitness changed from 0.1216362714767456 to 0.10357651114463806
Iteration 24 complete. Error: 0.10357651114463806 Total: 2.9374; Orientation: 0.4190; Line Search: 1.7116
Adding measurement 17b4d5ab to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.526e+02, gradient 1.735e-04, dot -0.648; [c93f7c11-d681-481d-b565-5747faf5d6be = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.14914777874946594, 0.13328078389167786, 0.1216362714767456, 0.10357651114463806
LBFGS Accumulation History: 3 points
Removed measurement 8be5379 to history. Total: 4
th(0)=0.10357651114463806;dx=-3.0095559585316716E-8
Armijo: th(3740338.0035275803)=0.17263594269752502; dx=4.459534326142948E-8 evalInputDelta=-0.06905943155288696
Armijo: th(1870169.0017637901)=0.10903486609458923; dx=2.413871949061686E-8 evalInputDelta=-0.005458354949951172
New Minimum: 0.10357651114463806 > 0.09522959589958191
END: th(623389.6672545967)=0.09522959589958191; dx=-5.330845292916875E-9 evalInputDelta=0.008346915245056152
Fitness changed from 0.10357651114463806 to 0.09522959589958191
Iteration 25 complete. Error: 0.09522959589958191 Total: 4.6414; Orientation: 0.4158; Line Search: 3.4197
<a id="p-19"></a>Iteration 25
<a id="p-18"></a>
Final threshold in iteration 26: 0.09522959589958191 (> -Infinity) after 95.682s (< 3600.000s)
0.09522959589958191