BasicOptimizer.scala:89 executed in 213.89 seconds (3.559 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 690536605815300
Reset training subject: 690541155004100
Adding measurement 539161ae to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-816.636240929828;dx=-0.00683624456458997
New Minimum: -816.636240929828 > -816.6510882867909
WOLFE (weak): th(2.154434690031884)=-816.6510882867909; dx=-0.006318432453477612 evalInputDelta=0.014847356962945923
New Minimum: -816.6510882867909 > -816.6658588431379
WOLFE (weak): th(4.308869380063768)=-816.6658588431379; dx=-0.00631820055593884 evalInputDelta=0.029617913309948563
New Minimum: -816.6658588431379 > -816.7252444978054
WOLFE (weak): th(12.926608140191302)=-816.7252444978054; dx=-0.006319569388956165 evalInputDelta=0.0890035679774428
New Minimum: -816.7252444978054 > -816.9921587751011
WOLFE (weak): th(51.70643256076521)=-816.9921587751011; dx=-0.006316727205476902 evalInputDelta=0.35591784527309756
New Minimum: -816.9921587751011 > -818.4132513589941
WOLFE (weak): th(258.53216280382605)=-818.4132513589941; dx=-0.006299764333004979 evalInputDelta=1.7770104291661255
New Minimum: -818.4132513589941 > -827.2052345095502
WOLFE (weak): th(1551.1929768229563)=-827.2052345095502; dx=-0.006188910640543837 evalInputDelta=10.568993579722246
New Minimum: -827.2052345095502 > -885.4305802828362
END: th(10858.350837760694)=-885.4305802828362; dx=-0.005249291289399813 evalInputDelta=68.79433935300824
Fitness changed from -816.636240929828 to -885.4305802828362
Iteration 1 complete. Error: -885.4305802828362 Total: 49.8395; Orientation: 0.1137; Line Search: 36.3470
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 106d6059 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-885.4305802828362;dx=-0.004872170021359524
New Minimum: -885.4305802828362 > -993.6272880210165
END: th(23393.607721408407)=-993.6272880210165; dx=-0.0036056221311139575 evalInputDelta=108.1967077381803
Fitness changed from -885.4305802828362 to -993.6272880210165
Iteration 2 complete. Error: -993.6272880210165 Total: 14.6373; Orientation: 0.0854; Line Search: 9.1673
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3d826767 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-993.6272880210165;dx=-0.003519403425232683
New Minimum: -993.6272880210165 > -1149.3187112372268
END: th(50400.00000000001)=-1149.3187112372268; dx=-0.0022088201421641166 evalInputDelta=155.6914232162103
Fitness changed from -993.6272880210165 to -1149.3187112372268
Iteration 3 complete. Error: -1149.3187112372268 Total: 14.5419; Orientation: 0.0977; Line Search: 8.9469
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 128cf713 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.169e+04, gradient 5.422e-02, dot -0.769; [7eb0c7d0-3926-48d5-8d60-717010f145dc = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1149.3187112372268, -993.6272880210165, -885.4305802828362, -816.636240929828
LBFGS Accumulation History: 3 points
Removed measurement 128cf713 to history. Total: 3
th(0)=-1149.3187112372268;dx=-0.0029373211690331977
New Minimum: -1149.3187112372268 > -1335.7285933152737
END: th(108583.50837760697)=-1335.7285933152737; dx=-9.861944286990935E-4 evalInputDelta=186.40988207804685
Fitness changed from -1149.3187112372268 to -1335.7285933152737
Iteration 4 complete. Error: -1335.7285933152737 Total: 16.6612; Orientation: 1.8042; Line Search: 9.2264
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 8bfe5a5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.071e+04, gradient 5.850e-02, dot -0.501; [7eb0c7d0-3926-48d5-8d60-717010f145dc = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1335.7285933152737, -993.6272880210165, -885.4305802828362, -816.636240929828
LBFGS Accumulation History: 3 points
Removed measurement 8bfe5a5 to history. Total: 3
th(0)=-1335.7285933152737;dx=-0.003418050965992548
New Minimum: -1335.7285933152737 > -1495.0822719837192
END: th(233936.07721408413)=-1495.0822719837192; dx=-2.469645290133318E-5 evalInputDelta=159.35367866844558
Fitness changed from -1335.7285933152737 to -1495.0822719837192
Iteration 5 complete. Error: -1495.0822719837192 Total: 17.0406; Orientation: 1.7374; Line Search: 9.7026
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 61bdd4d0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.130e+04, gradient 6.473e-02, dot -0.284; [7eb0c7d0-3926-48d5-8d60-717010f145dc = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1495.0822719837192, -993.6272880210165, -885.4305802828362, -816.636240929828
LBFGS Accumulation History: 3 points
Removed measurement 61bdd4d0 to history. Total: 3
th(0)=-1495.0822719837192;dx=-0.004183268800799843
Armijo: th(504000.0000000002)=-1421.5144213127069; dx=6.495481685700572E-4 evalInputDelta=-73.56785067101237
New Minimum: -1495.0822719837192 > -1641.3460939119452
WOLF (strong): th(252000.0000000001)=-1641.3460939119452; dx=7.370075644712168E-4 evalInputDelta=146.26382192822598
New Minimum: -1641.3460939119452 > -1709.2608051435568
END: th(84000.00000000003)=-1709.2608051435568; dx=-7.92765695774543E-4 evalInputDelta=214.17853315983757
Fitness changed from -1495.0822719837192 to -1709.2608051435568
Iteration 6 complete. Error: -1709.2608051435568 Total: 25.7036; Orientation: 1.7028; Line Search: 18.4665
Adding measurement 7aa73ac6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.803e+04, gradient 5.055e-02, dot -0.375; [7eb0c7d0-3926-48d5-8d60-717010f145dc = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1709.2608051435568, -993.6272880210165, -885.4305802828362, -816.636240929828
LBFGS Accumulation History: 3 points
Removed measurement 7aa73ac6 to history. Total: 3
th(0)=-1709.2608051435568;dx=-0.0025523006071123833
New Minimum: -1709.2608051435568 > -1875.4612765930412
WOLF (strong): th(180972.5139626783)=-1875.4612765930412; dx=8.574959134674347E-5 evalInputDelta=166.20047144948444
END: th(90486.25698133915)=-1856.5636267039167; dx=-7.099061273216929E-4 evalInputDelta=147.30282156035992
Fitness changed from -1709.2608051435568 to -1875.4612765930412
Iteration 7 complete. Error: -1875.4612765930412 Total: 19.7018; Orientation: 1.6108; Line Search: 13.6094
Adding measurement 5717c288 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.458e+04, gradient 6.611e-02, dot -0.301; [7eb0c7d0-3926-48d5-8d60-717010f145dc = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1875.4612765930412, -993.6272880210165, -885.4305802828362, -816.636240929828
LBFGS Accumulation History: 3 points
Removed measurement 5717c288 to history. Total: 3
th(0)=-1875.4612765930412;dx=-0.0043620078292712595
New Minimum: -1875.4612765930412 > -1935.9761749567065
WOLF (strong): th(194946.7310117368)=-1935.9761749567065; dx=0.0011790739749230614 evalInputDelta=60.514898363665225
New Minimum: -1935.9761749567065 > -2041.9123389607107
WOLF (strong): th(97473.3655058684)=-2041.9123389607107; dx=3.2947186895173616E-4 evalInputDelta=166.45106236766946
END: th(32491.121835289465)=-1992.775702380978; dx=-0.002275120116530395 evalInputDelta=117.31442578793667
Fitness changed from -1875.4612765930412 to -2041.9123389607107
Iteration 8 complete. Error: -2041.9123389607107 Total: 24.6284; Orientation: 1.6289; Line Search: 18.4602
Adding measurement 4b8ff566 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.986e+04, gradient 5.467e-02, dot -0.358; [7eb0c7d0-3926-48d5-8d60-717010f145dc = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2041.9123389607107, -993.6272880210165, -885.4305802828362, -816.636240929828
LBFGS Accumulation History: 3 points
Removed measurement 4b8ff566 to history. Total: 3
th(0)=-2041.9123389607107;dx=-0.002983874229034369
New Minimum: -2041.9123389607107 > -2166.7760613409037
END: th(70000.00000000003)=-2166.7760613409037; dx=-5.46497769687858E-4 evalInputDelta=124.86372238019294
Fitness changed from -2041.9123389607107 to -2166.7760613409037
Iteration 9 complete. Error: -2166.7760613409037 Total: 15.0638; Orientation: 1.6428; Line Search: 9.2420
Adding measurement 54983746 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.108e+04, gradient 4.414e-02, dot -0.476; [7eb0c7d0-3926-48d5-8d60-717010f145dc = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2166.7760613409037, -993.6272880210165, -885.4305802828362, -816.636240929828
LBFGS Accumulation History: 3 points
Removed measurement 54983746 to history. Total: 3
th(0)=-2166.7760613409037;dx=-0.0019455631883840943
New Minimum: -2166.7760613409037 > -2274.809442568762
END: th(150810.42830223194)=-2274.809442568762; dx=-5.4501104944160586E-5 evalInputDelta=108.03338122785817
Fitness changed from -2166.7760613409037 to -2274.809442568762
Iteration 10 complete. Error: -2274.809442568762 Total: 15.1956; Orientation: 1.6275; Line Search: 9.0438
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2274.809442568762 (> -Infinity) after 213.890s (< 5400.000s)
Returns
-2274.809442568762