BasicOptimizer.scala:88 executed in 4658.37 seconds (32.455 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 16246721019708
Reset training subject: 16350065226638
Adding measurement 6ddd1d04 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=8.440755501389503;dx=-7.075884528697686E-7
New Minimum: 8.440755501389503 > 8.440752640366554
WOLFE (weak): th(2.154434690031884)=8.440752640366554; dx=-7.488223835270541E-7 evalInputDelta=2.86102294921875E-6
New Minimum: 8.440752640366554 > 8.440746828913689
WOLFE (weak): th(4.308869380063768)=8.440746828913689; dx=-7.209641803779441E-7 evalInputDelta=8.672475814819336E-6
New Minimum: 8.440746828913689 > 8.440729394555092
WOLFE (weak): th(12.926608140191302)=8.440729394555092; dx=-7.582412607890848E-7 evalInputDelta=2.6106834411621094E-5
New Minimum: 8.440729394555092 > 8.440650314092636
WOLFE (weak): th(51.70643256076521)=8.440650314092636; dx=-7.369723207688738E-7 evalInputDelta=1.051872968673706E-4
New Minimum: 8.440650314092636 > 8.44022886455059
WOLFE (weak): th(258.53216280382605)=8.44022886455059; dx=-7.321480338757835E-7 evalInputDelta=5.266368389129639E-4
New Minimum: 8.44022886455059 > 8.437596037983894
WOLFE (weak): th(1551.1929768229563)=8.437596037983894; dx=-7.368759970831248E-7 evalInputDelta=0.003159463405609131
New Minimum: 8.437596037983894 > 8.418653070926666
WOLFE (weak): th(10858.350837760694)=8.418653070926666; dx=-7.565172948138183E-7 evalInputDelta=0.02210243046283722
New Minimum: 8.418653070926666 > 8.265038952231407
WOLFE (weak): th(86866.80670208555)=8.265038952231407; dx=-7.136807331862334E-7 evalInputDelta=0.1757165491580963
New Minimum: 8.265038952231407 > 6.981414750218391
END: th(781801.26031877)=6.981414750218391; dx=-6.084929242873549E-7 evalInputDelta=1.459340751171112
Fitness changed from 8.440755501389503 to 6.981414750218391
Iteration 1 complete. Error: 6.981414750218391 Total: 1366.4869; Orientation: 0.1002; Line Search: 1055.0525
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7d5d230c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=6.981414750218391;dx=-6.05506005858142E-7
New Minimum: 6.981414750218391 > 4.7310784459114075
END: th(1684339.7559414052)=4.7310784459114075; dx=-4.395404955526792E-7 evalInputDelta=2.250336304306984
Fitness changed from 6.981414750218391 to 4.7310784459114075
Iteration 2 complete. Error: 4.7310784459114075 Total: 316.9200; Orientation: 0.0941; Line Search: 211.8319
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7db40027 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=4.7310784459114075;dx=-4.5821941368682765E-7
New Minimum: 4.7310784459114075 > 1.9925563037395477
END: th(3628800.0)=1.9925563037395477; dx=-2.501919516764992E-7 evalInputDelta=2.7385221421718597
Fitness changed from 4.7310784459114075 to 1.9925563037395477
Iteration 3 complete. Error: 1.9925563037395477 Total: 314.0385; Orientation: 0.0981; Line Search: 206.0512
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7c536248 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.473e+04, gradient 5.950e-04, dot -0.708; [8c1b87af-190f-4eee-99e2-04cc6337bd81 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 1.9925563037395477, 4.7310784459114075, 6.981414750218391, 8.440755501389503
LBFGS Accumulation History: 3 points
Removed measurement 7c536248 to history. Total: 3
th(0)=1.9925563037395477;dx=-3.5175213845758825E-7
New Minimum: 1.9925563037395477 > -1.3748992830514908
END: th(7818012.6031877)=-1.3748992830514908; dx=-1.493135427786076E-7 evalInputDelta=3.3674555867910385
Fitness changed from 1.9925563037395477 to -1.3748992830514908
Iteration 4 complete. Error: -1.3748992830514908 Total: 320.4700; Orientation: 2.4583; Line Search: 210.7911
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 48e80e4d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.332e+04, gradient 4.951e-04, dot -0.568; [8c1b87af-190f-4eee-99e2-04cc6337bd81 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.3748992830514908, 4.7310784459114075, 6.981414750218391, 8.440755501389503
LBFGS Accumulation History: 3 points
Removed measurement 48e80e4d to history. Total: 3
th(0)=-1.3748992830514908;dx=-2.431524678619294E-7
New Minimum: -1.3748992830514908 > -4.574822470545769
END: th(1.684339755941405E7)=-4.574822470545769; dx=-6.271781723880137E-8 evalInputDelta=3.199923187494278
Fitness changed from -1.3748992830514908 to -4.574822470545769
Iteration 5 complete. Error: -4.574822470545769 Total: 319.7407; Orientation: 2.4988; Line Search: 211.9861
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6c0a867b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.065e+04, gradient 4.089e-04, dot -0.412; [8c1b87af-190f-4eee-99e2-04cc6337bd81 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -4.574822470545769, 4.7310784459114075, 6.981414750218391, 8.440755501389503
LBFGS Accumulation History: 3 points
Removed measurement 6c0a867b to history. Total: 3
th(0)=-4.574822470545769;dx=-1.6950402290718508E-7
New Minimum: -4.574822470545769 > -6.23943268507719
END: th(3.6288E7)=-6.23943268507719; dx=-6.387329279025774E-9 evalInputDelta=1.6646102145314217
Fitness changed from -4.574822470545769 to -6.23943268507719
Iteration 6 complete. Error: -6.23943268507719 Total: 320.4874; Orientation: 2.4455; Line Search: 211.3814
Adding measurement 62611634 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.801e+03, gradient 3.632e-04, dot -0.217; [8c1b87af-190f-4eee-99e2-04cc6337bd81 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -6.23943268507719, 4.7310784459114075, 6.981414750218391, 8.440755501389503
LBFGS Accumulation History: 3 points
Removed measurement 62611634 to history. Total: 3
th(0)=-6.23943268507719;dx=-1.312509451051011E-7
Armijo: th(7.8180126031877E7)=-4.7181558310985565; dx=1.2710279980786428E-8 evalInputDelta=-1.5212768539786339
New Minimum: -6.23943268507719 > -7.092353031039238
WOLF (strong): th(3.90900630159385E7)=-7.092353031039238; dx=4.842354679809527E-9 evalInputDelta=0.8529203459620476
New Minimum: -7.092353031039238 > -7.639561899006367
END: th(1.3030021005312832E7)=-7.639561899006367; dx=-1.571760316870148E-8 evalInputDelta=1.4001292139291763
Fitness changed from -6.23943268507719 to -7.639561899006367
Iteration 7 complete. Error: -7.639561899006367 Total: 531.4519; Orientation: 2.4938; Line Search: 421.8825
Adding measurement 4bbdf659 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.523e+03, gradient 2.916e-04, dot -0.236; [8c1b87af-190f-4eee-99e2-04cc6337bd81 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -7.639561899006367, 4.7310784459114075, 6.981414750218391, 8.440755501389503
LBFGS Accumulation History: 3 points
Removed measurement 4bbdf659 to history. Total: 3
th(0)=-7.639561899006367;dx=-8.866613495854954E-8
Armijo: th(2.807232926569009E7)=-6.402612313628197; dx=1.7775475059184536E-8 evalInputDelta=-1.23694958537817
New Minimum: -7.639561899006367 > -8.024690553545952
WOLF (strong): th(1.4036164632845044E7)=-8.024690553545952; dx=6.893506244626225E-9 evalInputDelta=0.3851286545395851
New Minimum: -8.024690553545952 > -8.324637852609158
END: th(4678721.544281681)=-8.324637852609158; dx=-3.729216793720509E-8 evalInputDelta=0.6850759536027908
Fitness changed from -7.639561899006367 to -8.324637852609158
Iteration 8 complete. Error: -8.324637852609158 Total: 526.6480; Orientation: 2.4157; Line Search: 418.1101
Adding measurement 14509835 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.940e+03, gradient 2.055e-04, dot -0.323; [8c1b87af-190f-4eee-99e2-04cc6337bd81 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -8.324637852609158, 4.7310784459114075, 6.981414750218391, 8.440755501389503
LBFGS Accumulation History: 3 points
Removed measurement 14509835 to history. Total: 3
th(0)=-8.324637852609158;dx=-3.9012926823809755E-8
New Minimum: -8.324637852609158 > -8.871996216475964
END: th(1.008E7)=-8.871996216475964; dx=-2.58573230586997E-8 evalInputDelta=0.547358363866806
Fitness changed from -8.324637852609158 to -8.871996216475964
Iteration 9 complete. Error: -8.871996216475964 Total: 315.4932; Orientation: 2.5798; Line Search: 208.3908
Adding measurement 6f37bc2e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.227e+03, gradient 1.825e-04, dot -0.446; [8c1b87af-190f-4eee-99e2-04cc6337bd81 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -8.871996216475964, 4.7310784459114075, 6.981414750218391, 8.440755501389503
LBFGS Accumulation History: 3 points
Removed measurement 6f37bc2e to history. Total: 3
th(0)=-8.871996216475964;dx=-3.21829432146884E-8
New Minimum: -8.871996216475964 > -9.33242941647768
END: th(2.171670167552139E7)=-9.33242941647768; dx=-9.744470629226929E-9 evalInputDelta=0.4604332000017166
Fitness changed from -8.871996216475964 to -9.33242941647768
Iteration 10 complete. Error: -9.33242941647768 Total: 325.0790; Orientation: 2.5299; Line Search: 217.3386
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -9.33242941647768 (> -Infinity) after 4658.365s (< 5400.000s)
Returns
-9.33242941647768