BasicOptimizer.scala:89 executed in 128.66 seconds (1.744 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 114899941157400
Reset training subject: 114902602901000
Adding measurement 66fcbe01 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-17.344005969895232;dx=-1.8287433450984262E-6
New Minimum: -17.344005969895232 > -17.344008407757933
END: th(2.154434690031884)=-17.344008407757933; dx=-1.53774945221976E-6 evalInputDelta=2.437862701043514E-6
Fitness changed from -17.344005969895232 to -17.344008407757933
Iteration 1 complete. Error: -17.344008407757933 Total: 13.0859; Orientation: 0.0625; Line Search: 5.2818
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6a23dfcb to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-17.344008407757933;dx=-1.537185657531275E-6
New Minimum: -17.344008407757933 > -17.344016330809342
WOLFE (weak): th(4.641588833612779)=-17.344016330809342; dx=-1.5371405757608596E-6 evalInputDelta=7.923051409619575E-6
New Minimum: -17.344016330809342 > -17.34402547278724
WOLFE (weak): th(9.283177667225559)=-17.34402547278724; dx=-1.5366146522422826E-6 evalInputDelta=1.7065029307872237E-5
New Minimum: -17.34402547278724 > -17.3440559460121
WOLFE (weak): th(27.849533001676676)=-17.3440559460121; dx=-1.5358728042400729E-6 evalInputDelta=4.753825416869972E-5
New Minimum: -17.3440559460121 > -17.34419795053387
WOLFE (weak): th(111.3981320067067)=-17.34419795053387; dx=-1.5345105221024312E-6 evalInputDelta=1.8954277593863367E-4
New Minimum: -17.34419795053387 > -17.344953053762772
WOLFE (weak): th(556.9906600335335)=-17.344953053762772; dx=-1.535128719442585E-6 evalInputDelta=9.446460048394556E-4
New Minimum: -17.344953053762772 > -17.34967124741674
WOLFE (weak): th(3341.9439602012008)=-17.34967124741674; dx=-1.5351989825667413E-6 evalInputDelta=0.005662839658807428
New Minimum: -17.34967124741674 > -17.383603465687596
WOLFE (weak): th(23393.607721408407)=-17.383603465687596; dx=-1.5320851798158679E-6 evalInputDelta=0.03959505792966311
New Minimum: -17.383603465687596 > -17.6586488533137
WOLFE (weak): th(187148.86177126726)=-17.6586488533137; dx=-1.5108456803619566E-6 evalInputDelta=0.3146404455557672
New Minimum: -17.6586488533137 > -19.909408495859214
END: th(1684339.7559414054)=-19.909408495859214; dx=-1.1952319007705663E-6 evalInputDelta=2.5654000881012813
Fitness changed from -17.344008407757933 to -19.909408495859214
Iteration 2 complete. Error: -19.909408495859214 Total: 29.3143; Orientation: 0.0590; Line Search: 26.1571
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3eeaddc4 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-19.909408495859214;dx=-1.226240110763096E-6
New Minimum: -19.909408495859214 > -23.676517672795864
END: th(3628800.0000000005)=-23.676517672795864; dx=-7.046601182520325E-7 evalInputDelta=3.76710917693665
Fitness changed from -19.909408495859214 to -23.676517672795864
Iteration 3 complete. Error: -23.676517672795864 Total: 8.6024; Orientation: 0.0577; Line Search: 5.2202
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 116c45b7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.937e+03, gradient 9.049e-04, dot -0.679; [803f0cd3-3359-4886-9a24-3044cadcfc90 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.676517672795864, -19.909408495859214, -17.344008407757933, -17.344005969895232
LBFGS Accumulation History: 3 points
Removed measurement 116c45b7 to history. Total: 3
th(0)=-23.676517672795864;dx=-8.16475961221314E-7
New Minimum: -23.676517672795864 > -28.23137917113164
END: th(7818012.603187701)=-28.23137917113164; dx=-3.2433616449652247E-7 evalInputDelta=4.554861498335775
Fitness changed from -23.676517672795864 to -28.23137917113164
Iteration 4 complete. Error: -28.23137917113164 Total: 9.5386; Orientation: 1.1526; Line Search: 5.2069
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 11b8f530 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.524e+03, gradient 8.413e-04, dot -0.468; [803f0cd3-3359-4886-9a24-3044cadcfc90 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -28.23137917113164, -19.909408495859214, -17.344008407757933, -17.344005969895232
LBFGS Accumulation History: 3 points
Removed measurement 11b8f530 to history. Total: 3
th(0)=-28.23137917113164;dx=-7.070784280780926E-7
New Minimum: -28.23137917113164 > -32.653770636272675
END: th(1.6843397559414055E7)=-32.653770636272675; dx=-8.40565910487815E-8 evalInputDelta=4.422391465141036
Fitness changed from -28.23137917113164 to -32.653770636272675
Iteration 5 complete. Error: -32.653770636272675 Total: 9.4901; Orientation: 1.0460; Line Search: 5.2306
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 51253885 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.037e+04, gradient 8.663e-04, dot -0.281; [803f0cd3-3359-4886-9a24-3044cadcfc90 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -32.653770636272675, -19.909408495859214, -17.344008407757933, -17.344005969895232
LBFGS Accumulation History: 3 points
Removed measurement 51253885 to history. Total: 3
th(0)=-32.653770636272675;dx=-7.494987014104936E-7
New Minimum: -32.653770636272675 > -36.43183394557809
WOLF (strong): th(3.628800000000001E7)=-36.43183394557809; dx=5.420010437310438E-8 evalInputDelta=3.7780633093054163
New Minimum: -36.43183394557809 > -37.588219396644604
WOLF (strong): th(1.8144000000000004E7)=-37.588219396644604; dx=1.6044093528276706E-8 evalInputDelta=4.934448760371929
END: th(6048000.000000001)=-36.27590385105106; dx=-3.3880901340743324E-7 evalInputDelta=3.622133214778387
Fitness changed from -32.653770636272675 to -37.588219396644604
Iteration 6 complete. Error: -37.588219396644604 Total: 14.6860; Orientation: 1.0683; Line Search: 10.7037
Adding measurement f36087c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.420e+04, gradient 8.232e-04, dot -0.268; [803f0cd3-3359-4886-9a24-3044cadcfc90 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -37.588219396644604, -19.909408495859214, -17.344008407757933, -17.344005969895232
LBFGS Accumulation History: 3 points
Removed measurement f36087c to history. Total: 3
th(0)=-37.588219396644604;dx=-6.753217180074163E-7
New Minimum: -37.588219396644604 > -42.55345072719145
END: th(1.3030021005312836E7)=-42.55345072719145; dx=-5.6239214469003586E-8 evalInputDelta=4.96523133054685
Fitness changed from -37.588219396644604 to -42.55345072719145
Iteration 7 complete. Error: -42.55345072719145 Total: 8.9085; Orientation: 0.9985; Line Search: 5.3004
Adding measurement 756292bc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.228e+04, gradient 6.756e-04, dot -0.390; [803f0cd3-3359-4886-9a24-3044cadcfc90 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -42.55345072719145, -19.909408495859214, -17.344008407757933, -17.344005969895232
LBFGS Accumulation History: 3 points
Removed measurement 756292bc to history. Total: 3
th(0)=-42.55345072719145;dx=-4.555483801446532E-7
New Minimum: -42.55345072719145 > -45.07646262944315
WOLF (strong): th(2.8072329265690096E7)=-45.07646262944315; dx=5.6932324847802616E-8 evalInputDelta=2.523011902251696
New Minimum: -45.07646262944315 > -45.70614076304548
END: th(1.4036164632845048E7)=-45.70614076304548; dx=-2.4915358604685502E-8 evalInputDelta=3.152690035854029
Fitness changed from -42.55345072719145 to -45.70614076304548
Iteration 8 complete. Error: -45.70614076304548 Total: 11.4597; Orientation: 1.0313; Line Search: 7.8984
Adding measurement 56b80c4e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.772e+04, gradient 6.650e-04, dot -0.398; [803f0cd3-3359-4886-9a24-3044cadcfc90 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -45.70614076304548, -19.909408495859214, -17.344008407757933, -17.344005969895232
LBFGS Accumulation History: 3 points
Removed measurement 56b80c4e to history. Total: 3
th(0)=-45.70614076304548;dx=-4.420098752947125E-7
New Minimum: -45.70614076304548 > -47.17344716135758
WOLF (strong): th(3.024000000000001E7)=-47.17344716135758; dx=7.525541699956274E-8 evalInputDelta=1.4673063983120969
New Minimum: -47.17344716135758 > -48.47501522464546
WOLF (strong): th(1.5120000000000006E7)=-48.47501522464546; dx=2.911023601769197E-8 evalInputDelta=2.768874461599978
END: th(5040000.000000002)=-47.64467990715158; dx=-2.544780149831935E-7 evalInputDelta=1.9385391441060946
Fitness changed from -45.70614076304548 to -48.47501522464546
Iteration 9 complete. Error: -48.47501522464546 Total: 14.2884; Orientation: 0.9960; Line Search: 10.6319
Adding measurement 530e5780 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.028e+04, gradient 6.751e-04, dot -0.368; [803f0cd3-3359-4886-9a24-3044cadcfc90 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.47501522464546, -19.909408495859214, -17.344008407757933, -17.344005969895232
LBFGS Accumulation History: 3 points
Removed measurement 530e5780 to history. Total: 3
th(0)=-48.47501522464546;dx=-4.55146974758593E-7
New Minimum: -48.47501522464546 > -51.360635723258135
END: th(1.0858350837760698E7)=-51.360635723258135; dx=-3.5711856226227984E-8 evalInputDelta=2.885620498612674
Fitness changed from -48.47501522464546 to -51.360635723258135
Iteration 10 complete. Error: -51.360635723258135 Total: 8.7616; Orientation: 1.0425; Line Search: 5.3080
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -51.360635723258135 (> -Infinity) after 128.657s (< 5400.000s)
Returns
-51.360635723258135