Code from BasicOptimizer.scala:75 executed in 264.23 seconds (2.572 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 926725825775100
Reset training subject: 926729790136700
Adding measurement 607a6762 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=2.4647946655750275;dx=-8.85562152439701E-6
New Minimum: 2.4647946655750275 > 2.464780755341053
WOLFE (weak): th(2.154434690031884)=2.464780755341053; dx=-8.856245783782063E-6 evalInputDelta=1.3910233974456787E-5
New Minimum: 2.464780755341053 > 2.464765377342701
WOLFE (weak): th(4.308869380063768)=2.464765377342701; dx=-8.8564302285669E-6 evalInputDelta=2.928823232650757E-5
New Minimum: 2.464765377342701 > 2.4647058434784412
WOLFE (weak): th(12.926608140191302)=2.4647058434784412; dx=-8.857794429961478E-6 evalInputDelta=8.882209658622742E-5
New Minimum: 2.4647058434784412 > 2.4644398540258408
WOLFE (weak): th(51.70643256076521)=2.4644398540258408; dx=-8.83855362089834E-6 evalInputDelta=3.5481154918670654E-4
New Minimum: 2.4644398540258408 > 2.463024191558361
WOLFE (weak): th(258.53216280382605)=2.463024191558361; dx=-8.829294046521588E-6 evalInputDelta=0.0017704740166664124
New Minimum: 2.463024191558361 > 2.4542646408081055
WOLFE (weak): th(1551.1929768229563)=2.4542646408081055; dx=-8.563525595361034E-6 evalInputDelta=0.010530024766921997
New Minimum: 2.4542646408081055 > 2.399552822113037
END: th(10858.350837760694)=2.399552822113037; dx=-6.62047073380903E-6 evalInputDelta=0.06524184346199036
Fitness changed from 2.4647946655750275 to 2.399552822113037
Iteration 1 complete. Error: 2.399552822113037 Total: 43.5009; Orientation: 0.0641; Line Search: 32.0066
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 70553522 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=2.399552822113037;dx=-6.221251783401166E-6
New Minimum: 2.399552822113037 > 2.3032533526420593
END: th(23393.607721408407)=2.3032533526420593; dx=-4.367041556545229E-6 evalInputDelta=0.09629946947097778
Fitness changed from
...skipping 10218 bytes...
r: 0.9399131089448929 Total: 17.2303; Orientation: 1.8935; Line Search: 11.6573
Adding measurement 1a225e01 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.867e+02, gradient 7.912e-04, dot -0.660; [391eb732-7467-423d-8281-b6427bc42249 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 1.1651371270418167, 1.0820335894823074, 1.013094037771225, 0.9399131089448929
LBFGS Accumulation History: 3 points
Removed measurement 4d3c56c7 to history. Total: 4
th(0)=0.9399131089448929;dx=-6.259966363968482E-7
New Minimum: 0.9399131089448929 > 0.8796357959508896
END: th(270759.3486274123)=0.8796357959508896; dx=-1.7667235824777415E-8 evalInputDelta=0.060277312994003296
Fitness changed from 0.9399131089448929 to 0.8796357959508896
Iteration 14 complete. Error: 0.8796357959508896 Total: 13.3615; Orientation: 1.9075; Line Search: 7.7670
Adding measurement 289f872d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.596e+02, gradient 6.891e-04, dot -0.687; [391eb732-7467-423d-8281-b6427bc42249 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 1.0820335894823074, 1.013094037771225, 0.9399131089448929, 0.8796357959508896
LBFGS Accumulation History: 3 points
Removed measurement 3abf4fd3 to history. Total: 4
th(0)=0.8796357959508896;dx=-4.74805945890373E-7
New Minimum: 0.8796357959508896 > 0.8627185523509979
WOLF (strong): th(583333.3333333337)=0.8627185523509979; dx=1.1119540589461133E-7 evalInputDelta=0.016917243599891663
New Minimum: 0.8627185523509979 > 0.8333713412284851
END: th(291666.66666666686)=0.8333713412284851; dx=-9.438462334377542E-9 evalInputDelta=0.04626445472240448
Fitness changed from 0.8796357959508896 to 0.8333713412284851
Iteration 15 complete. Error: 0.8333713412284851 Total: 17.4185; Orientation: 1.8840; Line Search: 11.8793
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: 0.8333713412284851 (> -Infinity) after 264.231s (< 1800.000s)
0.8333713412284851