BasicOptimizer.scala:89 executed in 133.42 seconds (1.882 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 115168823882500
Reset training subject: 115171510566500
Adding measurement 71f16f3f to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-27.981191580128534;dx=-1.3264964369810932E-6
New Minimum: -27.981191580128534 > -27.98119309122598
END: th(2.154434690031884)=-27.98119309122598; dx=-1.0178125701008351E-6 evalInputDelta=1.511097444506504E-6
Fitness changed from -27.981191580128534 to -27.98119309122598
Iteration 1 complete. Error: -27.98119309122598 Total: 13.0582; Orientation: 0.0654; Line Search: 5.1182
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5516b209 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-27.98119309122598;dx=-1.0181253565370296E-6
New Minimum: -27.98119309122598 > -27.981199135614936
WOLFE (weak): th(4.641588833612779)=-27.981199135614936; dx=-1.0172110944842324E-6 evalInputDelta=6.044388957349156E-6
New Minimum: -27.981199135614936 > -27.9812036689058
WOLFE (weak): th(9.283177667225559)=-27.9812036689058; dx=-1.0169895973536856E-6 evalInputDelta=1.0577679820045205E-5
New Minimum: -27.9812036689058 > -27.98122482425344
WOLFE (weak): th(27.849533001676676)=-27.98122482425344; dx=-1.0160538633895516E-6 evalInputDelta=3.173302746262152E-5
New Minimum: -27.98122482425344 > -27.981318512029308
WOLFE (weak): th(111.3981320067067)=-27.981318512029308; dx=-1.015852215047958E-6 evalInputDelta=1.2542080332877958E-4
New Minimum: -27.981318512029308 > -27.981812634302273
WOLFE (weak): th(556.9906600335335)=-27.981812634302273; dx=-1.0147162313264045E-6 evalInputDelta=6.195430762936383E-4
New Minimum: -27.981812634302273 > -27.984907122154155
WOLFE (weak): th(3341.9439602012008)=-27.984907122154155; dx=-1.015297544787538E-6 evalInputDelta=0.0037140309281760153
New Minimum: -27.984907122154155 > -28.007161338813177
WOLFE (weak): th(23393.607721408407)=-28.007161338813177; dx=-1.0140139657459287E-6 evalInputDelta=0.025968247587197624
New Minimum: -28.007161338813177 > -28.18766922894873
WOLFE (weak): th(187148.86177126726)=-28.18766922894873; dx=-1.0013462797487266E-6 evalInputDelta=0.20647613772275264
New Minimum: -28.18766922894873 > -29.704509130838876
END: th(1684339.7559414054)=-29.704509130838876; dx=-8.454108394917091E-7 evalInputDelta=1.7233160396128966
Fitness changed from -27.98119309122598 to -29.704509130838876
Iteration 2 complete. Error: -29.704509130838876 Total: 30.4958; Orientation: 0.0609; Line Search: 27.4527
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 71646685 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-29.704509130838876;dx=-8.460203708896379E-7
New Minimum: -29.704509130838876 > -32.401656513982026
END: th(3628800.0000000005)=-32.401656513982026; dx=-5.596186142600672E-7 evalInputDelta=2.6971473831431503
Fitness changed from -29.704509130838876 to -32.401656513982026
Iteration 3 complete. Error: -32.401656513982026 Total: 8.6566; Orientation: 0.0617; Line Search: 5.2419
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 23ff8121 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.684e+03, gradient 7.578e-04, dot -0.790; [006cff36-c95c-4b42-b4b2-5f9f523e511e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -32.401656513982026, -29.704509130838876, -27.98119309122598, -27.981191580128534
LBFGS Accumulation History: 3 points
Removed measurement 23ff8121 to history. Total: 3
th(0)=-32.401656513982026;dx=-5.720310407785729E-7
New Minimum: -32.401656513982026 > -36.114835543530596
END: th(7818012.603187701)=-36.114835543530596; dx=-3.200955501379622E-7 evalInputDelta=3.71317902954857
Fitness changed from -32.401656513982026 to -36.114835543530596
Iteration 4 complete. Error: -36.114835543530596 Total: 9.5500; Orientation: 1.0981; Line Search: 5.4139
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 261437f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.048e+04, gradient 6.877e-04, dot -0.607; [006cff36-c95c-4b42-b4b2-5f9f523e511e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -36.114835543530596, -29.704509130838876, -27.98119309122598, -27.981191580128534
LBFGS Accumulation History: 3 points
Removed measurement 261437f to history. Total: 3
th(0)=-36.114835543530596;dx=-4.719104200528199E-7
New Minimum: -36.114835543530596 > -40.39668860477566
END: th(1.6843397559414055E7)=-40.39668860477566; dx=-1.2524491777315132E-7 evalInputDelta=4.281853061245066
Fitness changed from -36.114835543530596 to -40.39668860477566
Iteration 5 complete. Error: -40.39668860477566 Total: 9.2575; Orientation: 1.0488; Line Search: 5.1311
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 59954b8a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.186e+04, gradient 7.484e-04, dot -0.366; [006cff36-c95c-4b42-b4b2-5f9f523e511e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -40.39668860477566, -29.704509130838876, -27.98119309122598, -27.981191580128534
LBFGS Accumulation History: 3 points
Removed measurement 59954b8a to history. Total: 3
th(0)=-40.39668860477566;dx=-5.59542525480207E-7
New Minimum: -40.39668860477566 > -42.78626876165919
WOLF (strong): th(3.628800000000001E7)=-42.78626876165919; dx=4.748455921541237E-8 evalInputDelta=2.3895801568835253
New Minimum: -42.78626876165919 > -43.76848341392084
WOLF (strong): th(1.8144000000000004E7)=-43.76848341392084; dx=1.969796332627563E-8 evalInputDelta=3.371794809145179
END: th(6048000.000000001)=-43.04289919429832; dx=-2.3740067771562303E-7 evalInputDelta=2.64621058952266
Fitness changed from -40.39668860477566 to -43.76848341392084
Iteration 6 complete. Error: -43.76848341392084 Total: 14.8961; Orientation: 1.0978; Line Search: 10.7152
Adding measurement 5561944c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.433e+04, gradient 7.846e-04, dot -0.285; [006cff36-c95c-4b42-b4b2-5f9f523e511e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -43.76848341392084, -29.704509130838876, -27.98119309122598, -27.981191580128534
LBFGS Accumulation History: 3 points
Removed measurement 5561944c to history. Total: 3
th(0)=-43.76848341392084;dx=-6.146305593861913E-7
New Minimum: -43.76848341392084 > -48.08389771909493
END: th(1.3030021005312836E7)=-48.08389771909493; dx=-1.549074486618925E-8 evalInputDelta=4.315414305174087
Fitness changed from -43.76848341392084 to -48.08389771909493
Iteration 7 complete. Error: -48.08389771909493 Total: 9.8162; Orientation: 1.0964; Line Search: 5.8895
Adding measurement 2d735fe9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.262e+04, gradient 6.555e-04, dot -0.399; [006cff36-c95c-4b42-b4b2-5f9f523e511e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.08389771909493, -29.704509130838876, -27.98119309122598, -27.981191580128534
LBFGS Accumulation History: 3 points
Removed measurement 2d735fe9 to history. Total: 3
th(0)=-48.08389771909493;dx=-4.2956590933372345E-7
New Minimum: -48.08389771909493 > -49.4852711100198
WOLF (strong): th(2.8072329265690096E7)=-49.4852711100198; dx=8.789455370592668E-8 evalInputDelta=1.4013733909248742
New Minimum: -49.4852711100198 > -50.73132937574394
WOLF (strong): th(1.4036164632845048E7)=-50.73132937574394; dx=1.713232226054165E-8 evalInputDelta=2.6474316566490117
END: th(4678721.544281683)=-49.84063931892641; dx=-2.531105857440923E-7 evalInputDelta=1.7567415998314786
Fitness changed from -48.08389771909493 to -50.73132937574394
Iteration 8 complete. Error: -50.73132937574394 Total: 15.3073; Orientation: 1.2518; Line Search: 11.3228
Adding measurement 5ea54a6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.743e+04, gradient 6.685e-04, dot -0.384; [006cff36-c95c-4b42-b4b2-5f9f523e511e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -50.73132937574394, -29.704509130838876, -27.98119309122598, -27.981191580128534
LBFGS Accumulation History: 3 points
Removed measurement 5ea54a6 to history. Total: 3
th(0)=-50.73132937574394;dx=-4.4632074417315803E-7
New Minimum: -50.73132937574394 > -53.24888551032154
END: th(1.0080000000000004E7)=-53.24888551032154; dx=-2.054447769234665E-8 evalInputDelta=2.517556134577603
Fitness changed from -50.73132937574394 to -53.24888551032154
Iteration 9 complete. Error: -53.24888551032154 Total: 9.7288; Orientation: 1.2174; Line Search: 5.9086
Adding measurement 6e1b5735 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.344e+04, gradient 5.594e-04, dot -0.478; [006cff36-c95c-4b42-b4b2-5f9f523e511e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.24888551032154, -29.704509130838876, -27.98119309122598, -27.981191580128534
LBFGS Accumulation History: 3 points
Removed measurement 6e1b5735 to history. Total: 3
th(0)=-53.24888551032154;dx=-3.1252849276897557E-7
New Minimum: -53.24888551032154 > -54.672406280083834
WOLF (strong): th(2.1716701675521396E7)=-54.672406280083834; dx=4.2448358415626003E-8 evalInputDelta=1.4235207697622911
New Minimum: -54.672406280083834 > -55.05919532128913
END: th(1.0858350837760698E7)=-55.05919532128913; dx=-2.5017132007489843E-8 evalInputDelta=1.8103098109675884
Fitness changed from -53.24888551032154 to -55.05919532128913
Iteration 10 complete. Error: -55.05919532128913 Total: 12.0505; Orientation: 1.2403; Line Search: 7.9052
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -55.05919532128913 (> -Infinity) after 133.415s (< 5400.000s)
Returns
-55.05919532128913