BasicOptimizer.scala:88 executed in 2075.05 seconds (9.764 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 4572741188082
Reset training subject: 4676729430354
Adding measurement 3712cffe to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=10.303982824087143;dx=-6.637720226470813E-7
New Minimum: 10.303982824087143 > 10.303980439901352
WOLFE (weak): th(2.154434690031884)=10.303980439901352; dx=-6.301172063667461E-7 evalInputDelta=2.384185791015625E-6
New Minimum: 10.303980439901352 > 10.303976327180862
WOLFE (weak): th(4.308869380063768)=10.303976327180862; dx=-6.295275765671638E-7 evalInputDelta=6.496906280517578E-6
New Minimum: 10.303976327180862 > 10.303962394595146
WOLFE (weak): th(12.926608140191302)=10.303962394595146; dx=-6.290670535362609E-7 evalInputDelta=2.0429491996765137E-5
New Minimum: 10.303962394595146 > 10.303902179002762
WOLFE (weak): th(51.70643256076521)=10.303902179002762; dx=-6.617960935235592E-7 evalInputDelta=8.064508438110352E-5
New Minimum: 10.303902179002762 > 10.303580984473228
WOLFE (weak): th(258.53216280382605)=10.303580984473228; dx=-6.557753157379381E-7 evalInputDelta=4.0183961391448975E-4
New Minimum: 10.303580984473228 > 10.301572889089584
WOLFE (weak): th(1551.1929768229563)=10.301572889089584; dx=-6.610792820547333E-7 evalInputDelta=0.0024099349975585938
New Minimum: 10.301572889089584 > 10.287136495113373
WOLFE (weak): th(10858.350837760694)=10.287136495113373; dx=-6.275080009608769E-7 evalInputDelta=0.01684632897377014
New Minimum: 10.287136495113373 > 10.170086771249771
WOLFE (weak): th(86866.80670208555)=10.170086771249771; dx=-6.320111073509451E-7 evalInputDelta=0.13389605283737183
New Minimum: 10.170086771249771 > 9.196243196725845
END: th(781801.26031877)=9.196243196725845; dx=-5.165314051030059E-7 evalInputDelta=1.1077396273612976
Fitness changed from 10.303982824087143 to 9.196243196725845
Iteration 1 complete. Error: 9.196243196725845 Total: 1417.8181; Orientation: 0.1273; Line Search: 1097.3519
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 78ee705b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=9.196243196725845;dx=-5.056231122129932E-7
New Minimum: 9.196243196725845 > 7.556043818593025
END: th(1684339.7559414052)=7.556043818593025; dx=-3.2687293945152635E-7 evalInputDelta=1.6401993781328201
Fitness changed from 9.196243196725845 to 7.556043818593025
Iteration 2 complete. Error: 7.556043818593025 Total: 325.8094; Orientation: 0.1307; Line Search: 218.8048
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4114ed4a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=7.556043818593025;dx=-3.658966397827574E-7
New Minimum: 7.556043818593025 > 5.522470474243164
END: th(3628800.0)=5.522470474243164; dx=-2.0252578596560325E-7 evalInputDelta=2.033573344349861
Fitness changed from 7.556043818593025 to 5.522470474243164
Iteration 3 complete. Error: 5.522470474243164 Total: 329.7641; Orientation: 0.7556; Line Search: 216.1389
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Final threshold in iteration 3: 5.522470474243164 (> -Infinity) after 2075.051s (< 1800.000s)
Returns
5.522470474243164