BasicOptimizer.scala:89 executed in 130.02 seconds (1.655 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 112669532959400
Reset training subject: 112672300156700
Adding measurement 636b2cc4 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-27.862663917663347;dx=-1.396096047726431E-6
New Minimum: -27.862663917663347 > -27.862666952714555
END: th(2.154434690031884)=-27.862666952714555; dx=-1.0519939421538143E-6 evalInputDelta=3.035051207689321E-6
Fitness changed from -27.862663917663347 to -27.862666952714555
Iteration 1 complete. Error: -27.862666952714555 Total: 13.4560; Orientation: 0.0624; Line Search: 5.3018
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6c7a7d0c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-27.862666952714555;dx=-1.0530994057479707E-6
New Minimum: -27.862666952714555 > -27.86267150529075
WOLFE (weak): th(4.641588833612779)=-27.86267150529075; dx=-1.052048127329281E-6 evalInputDelta=4.552576193361801E-6
New Minimum: -27.86267150529075 > -27.86267757539118
WOLFE (weak): th(9.283177667225559)=-27.86267757539118; dx=-1.0507705872686796E-6 evalInputDelta=1.062267662632621E-5
New Minimum: -27.86267757539118 > -27.862698820732287
WOLFE (weak): th(27.849533001676676)=-27.862698820732287; dx=-1.050181660202521E-6 evalInputDelta=3.1868017732250564E-5
New Minimum: -27.862698820732287 > -27.86279594208532
WOLFE (weak): th(111.3981320067067)=-27.86279594208532; dx=-1.0491715712443137E-6 evalInputDelta=1.2898937076499806E-4
New Minimum: -27.86279594208532 > -27.863310376106558
WOLFE (weak): th(556.9906600335335)=-27.863310376106558; dx=-1.0492936339886678E-6 evalInputDelta=6.434233920025179E-4
New Minimum: -27.863310376106558 > -27.8665303048524
WOLFE (weak): th(3341.9439602012008)=-27.8665303048524; dx=-1.0484857004920478E-6 evalInputDelta=0.0038633521378450553
New Minimum: -27.8665303048524 > -27.88968401874222
WOLFE (weak): th(23393.607721408407)=-27.88968401874222; dx=-1.0471703023417168E-6 evalInputDelta=0.02701706602766407
New Minimum: -27.88968401874222 > -28.07736782405588
WOLFE (weak): th(187148.86177126726)=-28.07736782405588; dx=-1.0329715303479323E-6 evalInputDelta=0.21470087134132498
New Minimum: -28.07736782405588 > -29.65426080884321
END: th(1684339.7559414054)=-29.65426080884321; dx=-8.731979394461812E-7 evalInputDelta=1.791593856128653
Fitness changed from -27.862666952714555 to -29.65426080884321
Iteration 2 complete. Error: -29.65426080884321 Total: 29.9463; Orientation: 0.0635; Line Search: 26.8237
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 47721034 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-29.65426080884321;dx=-8.841125208091669E-7
New Minimum: -29.65426080884321 > -32.45740660131221
END: th(3628800.0000000005)=-32.45740660131221; dx=-5.75507818231862E-7 evalInputDelta=2.8031457924689995
Fitness changed from -29.65426080884321 to -32.45740660131221
Iteration 3 complete. Error: -32.45740660131221 Total: 8.4371; Orientation: 0.0542; Line Search: 5.3080
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 22174fe5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.000e+04, gradient 7.678e-04, dot -0.788; [78732b79-1497-47da-a76f-2179810879c7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -32.45740660131221, -29.65426080884321, -27.862666952714555, -27.862663917663347
LBFGS Accumulation History: 3 points
Removed measurement 22174fe5 to history. Total: 3
th(0)=-32.45740660131221;dx=-5.889980809649166E-7
New Minimum: -32.45740660131221 > -36.29133046063014
END: th(7818012.603187701)=-36.29133046063014; dx=-3.251286604010152E-7 evalInputDelta=3.8339238593179346
Fitness changed from -32.45740660131221 to -36.29133046063014
Iteration 4 complete. Error: -36.29133046063014 Total: 9.7109; Orientation: 1.0724; Line Search: 5.3633
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 47b182ce to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.055e+04, gradient 6.880e-04, dot -0.609; [78732b79-1497-47da-a76f-2179810879c7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -36.29133046063014, -29.65426080884321, -27.862666952714555, -27.862663917663347
LBFGS Accumulation History: 3 points
Removed measurement 47b182ce to history. Total: 3
th(0)=-36.29133046063014;dx=-4.7230381890787775E-7
New Minimum: -36.29133046063014 > -40.522424984426976
END: th(1.6843397559414055E7)=-40.522424984426976; dx=-1.1657484396297881E-7 evalInputDelta=4.231094523796834
Fitness changed from -36.29133046063014 to -40.522424984426976
Iteration 5 complete. Error: -40.522424984426976 Total: 9.4643; Orientation: 1.0719; Line Search: 5.3190
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 370ad2e9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.063e+04, gradient 7.537e-04, dot -0.345; [78732b79-1497-47da-a76f-2179810879c7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -40.522424984426976, -29.65426080884321, -27.862666952714555, -27.862663917663347
LBFGS Accumulation History: 3 points
Removed measurement 370ad2e9 to history. Total: 3
th(0)=-40.522424984426976;dx=-5.659381019398671E-7
New Minimum: -40.522424984426976 > -42.24820634902925
WOLF (strong): th(3.628800000000001E7)=-42.24820634902925; dx=5.6636294378385724E-8 evalInputDelta=1.7257813646022768
New Minimum: -42.24820634902925 > -43.58523722678924
WOLF (strong): th(1.8144000000000004E7)=-43.58523722678924; dx=3.925669519687791E-8 evalInputDelta=3.062812242362263
END: th(6048000.000000001)=-43.15080642294382; dx=-2.2755760355059947E-7 evalInputDelta=2.628381438516847
Fitness changed from -40.522424984426976 to -43.58523722678924
Iteration 6 complete. Error: -43.58523722678924 Total: 14.8288; Orientation: 1.0199; Line Search: 10.6701
Adding measurement 4fe8e670 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.340e+04, gradient 7.927e-04, dot -0.272; [78732b79-1497-47da-a76f-2179810879c7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -43.58523722678924, -29.65426080884321, -27.862666952714555, -27.862663917663347
LBFGS Accumulation History: 3 points
Removed measurement 4fe8e670 to history. Total: 3
th(0)=-43.58523722678924;dx=-6.27486120564056E-7
New Minimum: -43.58523722678924 > -47.895184130883266
WOLF (strong): th(1.3030021005312836E7)=-47.895184130883266; dx=7.863613749097217E-10 evalInputDelta=4.309946904094026
END: th(6515010.502656418)=-46.98648702159002; dx=-2.995604002468901E-7 evalInputDelta=3.4012497948007834
Fitness changed from -43.58523722678924 to -47.895184130883266
Iteration 7 complete. Error: -47.895184130883266 Total: 11.3253; Orientation: 1.0313; Line Search: 7.6892
Adding measurement 446db512 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.133e+04, gradient 6.606e-04, dot -0.391; [78732b79-1497-47da-a76f-2179810879c7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -47.895184130883266, -29.65426080884321, -27.862666952714555, -27.862663917663347
LBFGS Accumulation History: 3 points
Removed measurement 446db512 to history. Total: 3
th(0)=-47.895184130883266;dx=-4.3416302982681495E-7
New Minimum: -47.895184130883266 > -50.50824624749796
WOLF (strong): th(1.4036164632845048E7)=-50.50824624749796; dx=2.6233081457030818E-8 evalInputDelta=2.6130621166146923
END: th(7018082.316422524)=-50.17887743633089; dx=-1.5824941681412506E-7 evalInputDelta=2.2836933054476276
Fitness changed from -47.895184130883266 to -50.50824624749796
Iteration 8 complete. Error: -50.50824624749796 Total: 11.6043; Orientation: 1.0066; Line Search: 7.9534
Adding measurement 10277ca2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.589e+04, gradient 6.658e-04, dot -0.380; [78732b79-1497-47da-a76f-2179810879c7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -50.50824624749796, -29.65426080884321, -27.862666952714555, -27.862663917663347
LBFGS Accumulation History: 3 points
Removed measurement 10277ca2 to history. Total: 3
th(0)=-50.50824624749796;dx=-4.428080833822027E-7
New Minimum: -50.50824624749796 > -52.76273534306385
WOLF (strong): th(1.5120000000000006E7)=-52.76273534306385; dx=7.856042164358859E-8 evalInputDelta=2.2544890955658943
New Minimum: -52.76273534306385 > -52.87927923595152
END: th(7560000.000000003)=-52.87927923595152; dx=-1.1882777245321783E-7 evalInputDelta=2.371032988453564
Fitness changed from -50.50824624749796 to -52.87927923595152
Iteration 9 complete. Error: -52.87927923595152 Total: 11.5118; Orientation: 0.9924; Line Search: 7.8770
Adding measurement 41e4ca8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.386e+04, gradient 4.831e-04, dot -0.580; [78732b79-1497-47da-a76f-2179810879c7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -52.87927923595152, -29.65426080884321, -27.862666952714555, -27.862663917663347
LBFGS Accumulation History: 3 points
Removed measurement 41e4ca8 to history. Total: 3
th(0)=-52.87927923595152;dx=-2.3262578308193338E-7
New Minimum: -52.87927923595152 > -55.100099187282346
END: th(1.6287526256641047E7)=-55.100099187282346; dx=-6.334491966238303E-8 evalInputDelta=2.2208199513308244
Fitness changed from -52.87927923595152 to -55.100099187282346
Iteration 10 complete. Error: -55.100099187282346 Total: 9.1489; Orientation: 1.2045; Line Search: 5.3961
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -55.100099187282346 (> -Infinity) after 130.023s (< 5400.000s)
Returns
-55.100099187282346