Code from BasicOptimizer.scala:75 executed in 1827.79 seconds (11.697 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 937913768478600
Reset training subject: 937959151819600
Adding measurement 6c872017 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=5.7168950363993645;dx=-0.0014470668143407041
New Minimum: 5.7168950363993645 > 5.714924678206444
WOLFE (weak): th(2.154434690031884)=5.714924678206444; dx=-0.0014155848268396043 evalInputDelta=0.001970358192920685
New Minimum: 5.714924678206444 > 5.712978184223175
WOLFE (weak): th(4.308869380063768)=5.712978184223175; dx=-0.0014107327935006509 evalInputDelta=0.003916852176189423
New Minimum: 5.712978184223175 > 5.705217458307743
WOLFE (weak): th(12.926608140191302)=5.705217458307743; dx=-0.0013841204703414342 evalInputDelta=0.011677578091621399
New Minimum: 5.705217458307743 > 5.670930400490761
WOLFE (weak): th(51.70643256076521)=5.670930400490761; dx=-0.0013291046378578271 evalInputDelta=0.04596463590860367
New Minimum: 5.670930400490761 > 5.500358439981937
END: th(258.53216280382605)=5.500358439981937; dx=-0.0011610935577273747 evalInputDelta=0.21653659641742706
Fitness changed from 5.7168950363993645 to 5.500358439981937
Iteration 1 complete. Error: 5.500358439981937 Total: 406.8038; Orientation: 0.0611; Line Search: 271.0591
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7c1336cc to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=5.500358439981937;dx=-0.0010574456975233116
New Minimum: 5.500358439981937 > 5.150064259767532
END: th(556.9906600335335)=5.150064259767532; dx=-7.763566671518839E-4 evalInputDelta=0.35029418021440506
Fitness changed from 5.500358439981937 to 5.150064259767532
Iteration 2 complete. Error: 5.150064259767532 Total: 136.3324; Orientation: 0.0653; Line Search: 90.6552
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 6efbdf0b to history. Total: 2
LBFGS Accumulation History: 3 points
...skipping 4980 bytes...
1.066e+02, gradient 5.144e-03, dot -0.723; [730b2a89-ec58-4b16-96ea-47c069973df1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.994438834488392, 3.7701734974980354, 3.665353924036026, 3.566987693309784
LBFGS Accumulation History: 3 points
Removed measurement 61793b39 to history. Total: 4
th(0)=3.566987693309784;dx=-2.6460601714542877E-5
New Minimum: 3.566987693309784 > 3.490873284637928
WOLF (strong): th(20000.000000000007)=3.490873284637928; dx=6.925791739416694E-7 evalInputDelta=0.07611440867185593
New Minimum: 3.490873284637928 > 3.4829458072781563
END: th(10000.000000000004)=3.4829458072781563; dx=-5.043944339584945E-6 evalInputDelta=0.08404188603162766
Fitness changed from 3.566987693309784 to 3.4829458072781563
Iteration 9 complete. Error: 3.4829458072781563 Total: 183.1117; Orientation: 1.9666; Line Search: 136.2060
Adding measurement 1a0b9942 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.887e+01, gradient 4.685e-03, dot -0.706; [730b2a89-ec58-4b16-96ea-47c069973df1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.7701734974980354, 3.665353924036026, 3.566987693309784, 3.4829458072781563
LBFGS Accumulation History: 3 points
Removed measurement 7221d2ab to history. Total: 4
th(0)=3.4829458072781563;dx=-2.1953204237873048E-5
New Minimum: 3.4829458072781563 > 3.424552246928215
WOLF (strong): th(21544.346900318847)=3.424552246928215; dx=3.5996039075051134E-6 evalInputDelta=0.058393560349941254
New Minimum: 3.424552246928215 > 3.4129211828112602
END: th(10772.173450159424)=3.4129211828112602; dx=-2.2315160302719006E-6 evalInputDelta=0.07002462446689606
Fitness changed from 3.4829458072781563 to 3.4129211828112602
Iteration 10 complete. Error: 3.4129211828112602 Total: 183.5519; Orientation: 1.8625; Line Search: 136.6532
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 10: 3.4129211828112602 (> -Infinity) after 1827.789s (< 1800.000s)
3.4129211828112602