Code from BasicOptimizer.scala:75 executed in 122.77 seconds (2.713 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 900964862252300
Reset training subject: 900966112183800
Adding measurement 463a0302 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=3.7206863779574633;dx=-1.806676530961935E-4
New Minimum: 3.7206863779574633 > 3.72034983150661
WOLFE (weak): th(2.154434690031884)=3.72034983150661; dx=-1.7930243613368486E-4 evalInputDelta=3.365464508533478E-4
New Minimum: 3.72034983150661 > 3.7200154289603233
WOLFE (weak): th(4.308869380063768)=3.7200154289603233; dx=-1.780749541052896E-4 evalInputDelta=6.709489971399307E-4
New Minimum: 3.7200154289603233 > 3.718706915155053
WOLFE (weak): th(12.926608140191302)=3.718706915155053; dx=-1.722331752046727E-4 evalInputDelta=0.0019794628024101257
New Minimum: 3.718706915155053 > 3.713397905230522
END: th(51.70643256076521)=3.713397905230522; dx=-1.4449156632357935E-4 evalInputDelta=0.007288472726941109
Fitness changed from 3.7206863779574633 to 3.713397905230522
Iteration 1 complete. Error: 3.713397905230522 Total: 9.6555; Orientation: 0.0144; Line Search: 6.0044
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 9a88a92 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=3.713397905230522;dx=-1.2599925733509278E-4
New Minimum: 3.713397905230522 > 3.702469479292631
END: th(111.39813200670669)=3.702469479292631; dx=-1.0518518577524473E-4 evalInputDelta=0.010928425937891006
Fitness changed from 3.713397905230522 to 3.702469479292631
Iteration 2 complete. Error: 3.702469479292631 Total: 3.5037; Orientation: 0.0145; Line Search: 2.3534
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 225fc6a2 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=3.702469479292631;dx=-1.010108435443956E-4
New Minimum: 3.702469479292631 > 3.682617239654064
WOLFE (weak): th(240.0)=3.682617239654064; dx=-9.731892001484936E-5 evalI
...skipping 18566 bytes...
4e-04, dot -0.478; [9bb7656a-b021-4303-861c-3fa311635d63 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.2066810131072998, 0.18592524528503418, 0.15560820698738098, 0.14042380452156067
LBFGS Accumulation History: 3 points
Removed measurement 30ee1a38 to history. Total: 4
th(0)=0.14042380452156067;dx=-4.6382630692916256E-8
New Minimum: 0.14042380452156067 > 0.12849533557891846
WOLF (strong): th(2777777.77777778)=0.12849533557891846; dx=8.523975150120176E-9 evalInputDelta=0.011928468942642212
New Minimum: 0.12849533557891846 > 0.1201600432395935
END: th(1388888.88888889)=0.1201600432395935; dx=-1.5981147852272647E-9 evalInputDelta=0.020263761281967163
Fitness changed from 0.14042380452156067 to 0.1201600432395935
Iteration 24 complete. Error: 0.1201600432395935 Total: 5.1462; Orientation: 0.4233; Line Search: 3.5693
Adding measurement 7e913ef1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.273e+02, gradient 1.473e-04, dot -0.560; [9bb7656a-b021-4303-861c-3fa311635d63 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.18592524528503418, 0.15560820698738098, 0.14042380452156067, 0.1201600432395935
LBFGS Accumulation History: 3 points
Removed measurement 25eadfe6 to history. Total: 4
th(0)=0.1201600432395935;dx=-2.1709650000014755E-8
New Minimum: 0.1201600432395935 > 0.11144065856933594
WOLF (strong): th(2992270.4028220633)=0.11144065856933594; dx=9.254518853066013E-9 evalInputDelta=0.008719384670257568
New Minimum: 0.11144065856933594 > 0.10492515563964844
END: th(1496135.2014110317)=0.10492515563964844; dx=-5.5159105389998826E-9 evalInputDelta=0.015234887599945068
Fitness changed from 0.1201600432395935 to 0.10492515563964844
Iteration 25 complete. Error: 0.10492515563964844 Total: 5.6464; Orientation: 0.4137; Line Search: 3.5474
<a id="p-19"></a>Iteration 25
<a id="p-18"></a>
Final threshold in iteration 26: 0.10492515563964844 (> -Infinity) after 122.771s (< 3600.000s)
0.10492515563964844