Code from BasicOptimizer.scala:75 executed in 3621.55 seconds (21.955 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 932198423607800
Reset training subject: 932244139021700
Adding measurement 64c2da43 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=6.388838589191437;dx=-0.0017678421883068735
New Minimum: 6.388838589191437 > 6.386637583374977
WOLFE (weak): th(2.154434690031884)=6.386637583374977; dx=-0.001728456340870939 evalInputDelta=0.0022010058164596558
New Minimum: 6.386637583374977 > 6.384472832083702
WOLFE (weak): th(4.308869380063768)=6.384472832083702; dx=-0.0016927278256325061 evalInputDelta=0.00436575710773468
New Minimum: 6.384472832083702 > 6.37596919387579
WOLFE (weak): th(12.926608140191302)=6.37596919387579; dx=-0.0016311380120785234 evalInputDelta=0.012869395315647125
New Minimum: 6.37596919387579 > 6.3380730003118515
END: th(51.70643256076521)=6.3380730003118515; dx=-0.0015829170433534732 evalInputDelta=0.050765588879585266
Fitness changed from 6.388838589191437 to 6.3380730003118515
Iteration 1 complete. Error: 6.3380730003118515 Total: 363.5382; Orientation: 0.0660; Line Search: 227.1429
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4a2b881e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=6.3380730003118515;dx=-0.001514480793845417
New Minimum: 6.3380730003118515 > 6.235921159386635
WOLFE (weak): th(111.39813200670669)=6.235921159386635; dx=-0.0013896767782455844 evalInputDelta=0.10215184092521667
New Minimum: 6.235921159386635 > 6.137742444872856
END: th(222.79626401341338)=6.137742444872856; dx=-0.001295877402333153 evalInputDelta=0.20033055543899536
Fitness changed from 6.3380730003118515 to 6.137742444872856
Iteration 2 complete. Error: 6.137742444872856 Total: 182.4600; Orientation: 0.0615; Line Search: 136.6789
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3e88dc68 to history. Total: 2
LBFGS Accumulation History: 3 point
...skipping 14275 bytes...
a-75f67d29241e = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.309585340321064, 3.265362113714218, 3.2164642438292503, 3.1700824797153473
LBFGS Accumulation History: 3 points
Removed measurement 74ca42d8 to history. Total: 4
th(0)=3.1700824797153473;dx=-1.5083642082092984E-5
New Minimum: 3.1700824797153473 > 3.1452017799019814
WOLF (strong): th(14961.352014110314)=3.1452017799019814; dx=3.690335632716009E-7 evalInputDelta=0.024880699813365936
END: th(7480.676007055157)=3.1474164836108685; dx=-2.34668089357734E-6 evalInputDelta=0.022665996104478836
Fitness changed from 3.1700824797153473 to 3.1452017799019814
Iteration 19 complete. Error: 3.1452017799019814 Total: 183.1797; Orientation: 1.9192; Line Search: 136.0797
Adding measurement 1049cec2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.186e+02, gradient 5.323e-03, dot -0.470; [eda703c9-5c8f-400f-b90a-75f67d29241e = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.265362113714218, 3.2164642438292503, 3.1700824797153473, 3.1452017799019814
LBFGS Accumulation History: 3 points
Removed measurement 67820145 to history. Total: 4
th(0)=3.1452017799019814;dx=-2.8330335513935555E-5
New Minimum: 3.1452017799019814 > 3.1395902559161186
WOLF (strong): th(16116.627894488827)=3.1395902559161186; dx=5.448854410221713E-6 evalInputDelta=0.005611523985862732
New Minimum: 3.1395902559161186 > 3.112032376229763
WOLF (strong): th(8058.313947244414)=3.112032376229763; dx=6.855055941391958E-7 evalInputDelta=0.03316940367221832
END: th(2686.104649081471)=3.123079165816307; dx=-7.666555107891647E-6 evalInputDelta=0.022122614085674286
Fitness changed from 3.1452017799019814 to 3.112032376229763
Iteration 20 complete. Error: 3.112032376229763 Total: 227.9566; Orientation: 1.8938; Line Search: 180.9635
<a id="p-17"></a>Iteration 20
<a id="p-16"></a>
Final threshold in iteration 20: 3.112032376229763 (> -Infinity) after 3621.549s (< 3600.000s)
3.112032376229763