BasicOptimizer.scala:89 executed in 91.22 seconds (1.085 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 282766102909000
Reset training subject: 282768064984500
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -55.899275747578834 > -55.97808010530415
th(0)=-55.97808010530415;dx=-5.288246496963994E-6
New Minimum: -55.97808010530415 > -55.97808847554315
END: th(2.154434690031884)=-55.97808847554315; dx=-3.4979921888225023E-6 evalInputDelta=8.370239001465052E-6
Fitness changed from -55.899275747578834 to -55.97808847554315
Iteration 1 complete. Error: -55.97808847554315 Total: 9.3729; Orientation: 0.0352; Line Search: 3.6609
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 10084f5a to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-55.97808847554315;dx=-3.505628971704834E-6
New Minimum: -55.97808847554315 > -55.9781052160174
WOLFE (weak): th(4.641588833612779)=-55.9781052160174; dx=-3.50560539528148E-6 evalInputDelta=1.674047424415903E-5
New Minimum: -55.9781052160174 > -55.97812195648664
WOLFE (weak): th(9.283177667225559)=-55.97812195648664; dx=-3.5056073820763565E-6 evalInputDelta=3.34809434860972E-5
New Minimum: -55.97812195648664 > -55.97818724426884
WOLFE (weak): th(27.849533001676676)=-55.97818724426884; dx=-3.5056114066455446E-6 evalInputDelta=9.876872568526096E-5
New Minimum: -55.97818724426884 > -55.97847852729249
WOLFE (weak): th(111.3981320067067)=-55.97847852729249; dx=-3.505551183369599E-6 evalInputDelta=3.900517493349298E-4
New Minimum: -55.97847852729249 > -55.98004205509083
WOLFE (weak): th(556.9906600335335)=-55.98004205509083; dx=-3.5052938765338505E-6 evalInputDelta=0.001953579547674167
New Minimum: -55.98004205509083 > -55.989805582979
WOLFE (weak): th(3341.9439602012008)=-55.989805582979; dx=-3.504770773172059E-6 evalInputDelta=0.011717107435849528
New Minimum: -55.989805582979 > -56.06000999397619
WOLFE (weak): th(23393.607721408407)=-56.06000999397619; dx=-3.498121891847163E-6 evalInputDelta=0.08192151843303463
New Minimum: -56.06000999397619 > -56.62847611096342
WOLFE (weak): th(187148.86177126726)=-56.62847611096342; dx=-3.4419715826890718E-6 evalInputDelta=0.650387635420266
New Minimum: -56.62847611096342 > -61.35106183840185
END: th(1684339.7559414054)=-61.35106183840185; dx=-2.8544480188104408E-6 evalInputDelta=5.372973362858694
Fitness changed from -55.97808847554315 to -61.35106183840185
Iteration 2 complete. Error: -61.35106183840185 Total: 20.9962; Orientation: 0.0583; Line Search: 18.8818
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement c0a3de4 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-61.35106183840185;dx=-2.603347493837286E-6
New Minimum: -61.35106183840185 > -69.18555762362939
END: th(3628800.0000000005)=-69.18555762362939; dx=-1.694008417599338E-6 evalInputDelta=7.834495785227546
Fitness changed from -61.35106183840185 to -69.18555762362939
Iteration 3 complete. Error: -69.18555762362939 Total: 5.8840; Orientation: 0.0584; Line Search: 3.7267
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6b1242f8 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-69.18555762362939;dx=-1.6032741274307087E-6
New Minimum: -69.18555762362939 > -78.37578939296482
END: th(7818012.603187701)=-78.37578939296482; dx=-7.651113677169766E-7 evalInputDelta=9.190231769335426
Fitness changed from -69.18555762362939 to -78.37578939296482
Iteration 4 complete. Error: -78.37578939296482 Total: 5.9866; Orientation: 0.0561; Line Search: 3.6297
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 92153e7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.237e+04, gradient 1.051e-03, dot -0.709; [01b1506f-9760-48e2-a4a3-85bc4550e060 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -78.37578939296482, -69.18555762362939, -61.35106183840185, -55.97808847554315
LBFGS Accumulation History: 3 points
Removed measurement 92153e7 to history. Total: 3
th(0)=-78.37578939296482;dx=-1.104504709144673E-6
New Minimum: -78.37578939296482 > -86.80907901722308
END: th(1.6843397559414055E7)=-86.80907901722308; dx=-1.3741395234476906E-7 evalInputDelta=8.433289624258265
Fitness changed from -78.37578939296482 to -86.80907901722308
Iteration 5 complete. Error: -86.80907901722308 Total: 7.0719; Orientation: 1.0196; Line Search: 3.9278
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 465061d8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.199e+04, gradient 1.237e-03, dot -0.466; [01b1506f-9760-48e2-a4a3-85bc4550e060 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.80907901722308, -69.18555762362939, -61.35106183840185, -55.97808847554315
LBFGS Accumulation History: 3 points
Removed measurement 465061d8 to history. Total: 3
th(0)=-86.80907901722308;dx=-1.5312747068607483E-6
Armijo: th(3.628800000000001E7)=-81.9559525148566; dx=3.7893994189645205E-7 evalInputDelta=-4.853126502366479
New Minimum: -86.80907901722308 > -90.07778211684074
WOLF (strong): th(1.8144000000000004E7)=-90.07778211684074; dx=4.868209590023163E-7 evalInputDelta=3.268703099617653
New Minimum: -90.07778211684074 > -92.78504166988155
END: th(6048000.000000001)=-92.78504166988155; dx=-4.0446648738510627E-7 evalInputDelta=5.975962652658467
Fitness changed from -86.80907901722308 to -92.78504166988155
Iteration 6 complete. Error: -92.78504166988155 Total: 10.3758; Orientation: 0.9862; Line Search: 7.3438
Adding measurement 6909221e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.177e+04, gradient 8.545e-04, dot -0.625; [01b1506f-9760-48e2-a4a3-85bc4550e060 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -92.78504166988155, -69.18555762362939, -61.35106183840185, -55.97808847554315
LBFGS Accumulation History: 3 points
Removed measurement 6909221e to history. Total: 3
th(0)=-92.78504166988155;dx=-7.301030175343829E-7
New Minimum: -92.78504166988155 > -97.50613251283792
END: th(1.3030021005312836E7)=-97.50613251283792; dx=-1.000829573637592E-7 evalInputDelta=4.721090842956372
Fitness changed from -92.78504166988155 to -97.50613251283792
Iteration 7 complete. Error: -97.50613251283792 Total: 6.4590; Orientation: 0.9829; Line Search: 3.6934
Adding measurement 7351e955 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.426e+04, gradient 1.016e-03, dot -0.487; [01b1506f-9760-48e2-a4a3-85bc4550e060 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.50613251283792, -69.18555762362939, -61.35106183840185, -55.97808847554315
LBFGS Accumulation History: 3 points
Removed measurement 7351e955 to history. Total: 3
th(0)=-97.50613251283792;dx=-1.0322926584315994E-6
Armijo: th(2.8072329265690096E7)=-95.68331350884053; dx=3.1412933360801633E-7 evalInputDelta=-1.8228190039973953
New Minimum: -97.50613251283792 > -100.37231675254556
WOLF (strong): th(1.4036164632845048E7)=-100.37231675254556; dx=3.05978669145453E-7 evalInputDelta=2.8661842397076356
New Minimum: -100.37231675254556 > -100.95693743196752
END: th(4678721.544281683)=-100.95693743196752; dx=-4.0311790088895613E-7 evalInputDelta=3.4508049191295953
Fitness changed from -97.50613251283792 to -100.95693743196752
Iteration 8 complete. Error: -100.95693743196752 Total: 10.1098; Orientation: 0.9166; Line Search: 7.3244
Adding measurement 2a59932b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.012e+04, gradient 6.952e-04, dot -0.680; [01b1506f-9760-48e2-a4a3-85bc4550e060 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -100.95693743196752, -69.18555762362939, -61.35106183840185, -55.97808847554315
LBFGS Accumulation History: 3 points
Removed measurement 2a59932b to history. Total: 3
th(0)=-100.95693743196752;dx=-4.833121811915869E-7
New Minimum: -100.95693743196752 > -104.42770755286483
END: th(1.0080000000000004E7)=-104.42770755286483; dx=-2.308569832661746E-7 evalInputDelta=3.4707701208973134
Fitness changed from -100.95693743196752 to -104.42770755286483
Iteration 9 complete. Error: -104.42770755286483 Total: 6.3696; Orientation: 0.9118; Line Search: 3.6118
Adding measurement 26ce3538 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.192e+04, gradient 7.462e-04, dot -0.597; [01b1506f-9760-48e2-a4a3-85bc4550e060 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.42770755286483, -69.18555762362939, -61.35106183840185, -55.97808847554315
LBFGS Accumulation History: 3 points
Removed measurement 26ce3538 to history. Total: 3
th(0)=-104.42770755286483;dx=-5.568560470967763E-7
New Minimum: -104.42770755286483 > -107.045905813024
WOLF (strong): th(2.1716701675521396E7)=-107.045905813024; dx=5.8039288530307E-8 evalInputDelta=2.6181982601591756
New Minimum: -107.045905813024 > -107.22238831380221
END: th(1.0858350837760698E7)=-107.22238831380221; dx=-5.2512262507351055E-8 evalInputDelta=2.794680760937382
Fitness changed from -104.42770755286483 to -107.22238831380221
Iteration 10 complete. Error: -107.22238831380221 Total: 8.2944; Orientation: 0.9983; Line Search: 5.5150
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -107.22238831380221 (> -Infinity) after 91.223s (< 5400.000s)
Returns
-107.22238831380221