Code from BasicOptimizer.scala:75 executed in 3746.43 seconds (24.871 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1283842738822700
Reset training subject: 1283896484427000
Adding measurement 5240ea03 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=1.4025031679119597;dx=-2.790918472372898E-7
New Minimum: 1.4025031679119597 > 1.4025031169723645
WOLFE (weak): th(2.154434690031884)=1.4025031169723645; dx=-2.752269865861621E-7 evalInputDelta=5.093959520863223E-8
New Minimum: 1.4025031169723645 > 1.4025028047370978
WOLFE (weak): th(4.308869380063768)=1.4025028047370978; dx=-2.7522692601802833E-7 evalInputDelta=3.631748619614683E-7
New Minimum: 1.4025028047370978 > 1.402501939589426
WOLFE (weak): th(12.926608140191302)=1.402501939589426; dx=-2.752268414146858E-7 evalInputDelta=1.2283225336862102E-6
New Minimum: 1.402501939589426 > 1.4024983265283149
WOLFE (weak): th(51.70643256076521)=1.4024983265283149; dx=-2.752262390597214E-7 evalInputDelta=4.8413836448713E-6
New Minimum: 1.4024983265283149 > 1.4024789507658542
WOLFE (weak): th(258.53216280382605)=1.4024789507658542; dx=-2.752225034727859E-7 evalInputDelta=2.4217146105565135E-5
New Minimum: 1.4024789507658542 > 1.402357054592771
WOLFE (weak): th(1551.1929768229563)=1.402357054592771; dx=-2.7521654564616624E-7 evalInputDelta=1.4611331918867876E-4
New Minimum: 1.402357054592771 > 1.4014812423602625
WOLFE (weak): th(10858.350837760694)=1.4014812423602625; dx=-2.750474180508081E-7 evalInputDelta=0.0010219255516972225
New Minimum: 1.4014812423602625 > 1.3943662008367834
WOLFE (weak): th(86866.80670208555)=1.3943662008367834; dx=-2.736300801956776E-7 evalInputDelta=0.008136967075176305
New Minimum: 1.3943662008367834 > 1.3326270536313074
WOLFE (weak): th(781801.26031877)=1.3326270536313074; dx=-2.5887106357729407E-7 evalInputDelta=0.06987611428065232
New Minimum: 1.3326270536313074 > 0.9974084164946694
END: th(7818012.6031877)=0.9974084164946694; dx=-1.3864495620932726E-7 evalInputDelta=0.40509475141729034
Fitness changed from 1.4025031679119597 to 0.9974084164946694
Iterat
...skipping 10989 bytes...
ng measurement 6135bdd3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.059e+04, gradient 1.550e-04, dot -0.688; [49755638-90bd-44ae-aad7-f6e8fd26f6f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.2681461515755823, 0.22399063116773799, 0.18705556225375086, 0.1649243768837927
LBFGS Accumulation History: 3 points
Removed measurement 539ba851 to history. Total: 4
th(0)=0.1649243768837927;dx=-2.402079269933569E-8
Armijo: th(5.482876809705099E7)=0.40251660562803715; dx=4.4728739316707125E-9 evalInputDelta=-0.23759222874424446
Armijo: th(2.7414384048525494E7)=0.16683338601758746; dx=-2.159627669440078E-9 evalInputDelta=-0.00190900913379477
New Minimum: 0.1649243768837927 > 0.12436187087128264
END: th(9138128.016175164)=0.12436187087128264; dx=-1.3875049324205025E-8 evalInputDelta=0.04056250601251005
Fitness changed from 0.1649243768837927 to 0.12436187087128264
Iteration 14 complete. Error: 0.12436187087128264 Total: 272.2224; Orientation: 1.4838; Line Search: 218.1583
Adding measurement 3edf15fb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.523e+03, gradient 1.210e-04, dot -0.881; [49755638-90bd-44ae-aad7-f6e8fd26f6f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.22399063116773799, 0.18705556225375086, 0.1649243768837927, 0.12436187087128264
LBFGS Accumulation History: 3 points
Removed measurement 2bcc8ccd to history. Total: 4
th(0)=0.12436187087128264;dx=-1.4637252966828646E-8
New Minimum: 0.12436187087128264 > 0.09408035130639891
END: th(1.968750000000001E7)=0.09408035130639891; dx=-9.909539451899086E-9 evalInputDelta=0.03028151956488373
Fitness changed from 0.12436187087128264 to 0.09408035130639891
Iteration 15 complete. Error: 0.09408035130639891 Total: 160.7302; Orientation: 1.4783; Line Search: 106.1626
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 15: 0.09408035130639891 (> -Infinity) after 3746.427s (< 3600.000s)
0.09408035130639891