Code from BasicOptimizer.scala:88 executed in 1593.06 seconds (7.169 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 1764736977019
Reset training subject: 1781508481658
Adding measurement 73b81006 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=4.014700651168823;dx=-7.843245755249838E-8
New Minimum: 4.014700651168823 > 4.014700576663017
WOLFE (weak): th(2.154434690031884)=4.014700576663017; dx=-7.686833466393205E-8 evalInputDelta=7.450580596923828E-8
WOLFE (weak): th(4.308869380063768)=4.014700576663017; dx=-7.686809938831835E-8 evalInputDelta=7.450580596923828E-8
New Minimum: 4.014700576663017 > 4.0146999061107635
WOLFE (weak): th(12.926608140191302)=4.0146999061107635; dx=-7.686793774564425E-8 evalInputDelta=7.450580596923828E-7
New Minimum: 4.0146999061107635 > 4.014696270227432
WOLFE (weak): th(51.70643256076521)=4.014696270227432; dx=-7.686682998050703E-8 evalInputDelta=4.380941390991211E-6
New Minimum: 4.014696270227432 > 4.014678731560707
WOLFE (weak): th(258.53216280382605)=4.014678731560707; dx=-7.68558666988448E-8 evalInputDelta=2.1919608116149902E-5
New Minimum: 4.014678731560707 > 4.01456892490387
WOLFE (weak): th(1551.1929768229563)=4.01456892490387; dx=-7.686197775072645E-8 evalInputDelta=1.3172626495361328E-4
New Minimum: 4.01456892490387 > 4.013778358697891
WOLFE (weak): th(10858.350837760694)=4.013778358697891; dx=-7.683174274356761E-8 evalInputDelta=9.222924709320068E-4
New Minimum: 4.013778358697891 > 4.007335662841797
WOLFE (weak): th(86866.80670208555)=4.007335662841797; dx=-7.64977324470447E-8 evalInputDelta=0.007364988327026367
New Minimum: 4.007335662841797 > 3.9504366368055344
WOLFE (weak): th(781801.26031877)=3.9504366368055344; dx=-7.268143050560494E-8 evalInputDelta=0.06426401436328888
New Minimum: 3.9504366368055344 > 3.6255839318037033
END: th(7818012.6031877)=3.6255839318037033; dx=-4.026602071551209E-8 evalInputDelta=0.38911671936511993
Fitness changed from 4.014700651168823 to 3.6255839318037033
Iteration 1 complete. Error: 3.6255839318037033 Total: 244.4844; Orientation: 0.0364; Line Search: 192.8373
<a id="p-
...skipping 15178 bytes...
tation: 0.8944; Line Search: 53.2146
Adding measurement 3336f279 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.439e+04, gradient 1.204e-04, dot -0.286; [70b5e46b-2d91-4ec3-9921-b4b943373aab = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.1368764340877533, 3.2670154869556427, 3.6255839318037033, 4.014700651168823
LBFGS Accumulation History: 3 points
Removed measurement 3336f279 to history. Total: 3
th(0)=0.1368764340877533;dx=-1.4497534102075833E-8
Armijo: th(7.952893680000515E7)=0.747394323348999; dx=8.089301550320063E-10 evalInputDelta=-0.6105178892612457
New Minimum: 0.1368764340877533 > 0.09366342425346375
END: th(3.976446840000258E7)=0.09366342425346375; dx=-2.3652912732214903E-9 evalInputDelta=0.04321300983428955
Fitness changed from 0.1368764340877533 to 0.09366342425346375
Iteration 19 complete. Error: 0.09366342425346375 Total: 70.0582; Orientation: 0.8851; Line Search: 51.1986
Adding measurement 147aa0a7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.317e+04, gradient 1.228e-04, dot -0.263; [70b5e46b-2d91-4ec3-9921-b4b943373aab = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.09366342425346375, 3.2670154869556427, 3.6255839318037033, 4.014700651168823
LBFGS Accumulation History: 3 points
Removed measurement 147aa0a7 to history. Total: 3
th(0)=0.09366342425346375;dx=-1.5087684082083853E-8
Armijo: th(8.566995015164219E7)=0.8906146585941315; dx=1.823095259310067E-9 evalInputDelta=-0.7969512343406677
New Minimum: 0.09366342425346375 > 0.0827004462480545
END: th(4.2834975075821094E7)=0.0827004462480545; dx=-1.4082880325593494E-9 evalInputDelta=0.01096297800540924
Fitness changed from 0.09366342425346375 to 0.0827004462480545
Iteration 20 complete. Error: 0.0827004462480545 Total: 72.3446; Orientation: 0.8881; Line Search: 53.5660
<a id="p-17"></a>Iteration 20
<a id="p-16"></a>
Final threshold in iteration 21: 0.0827004462480545 (> -Infinity) after 1593.061s (< 3600.000s)
0.0827004462480545