BasicOptimizer.scala:89 executed in 94.57 seconds (1.220 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 284126021975500
Reset training subject: 284127983506100
Adding measurement 56a48892 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-56.38706926674811;dx=-5.136291332709095E-6
New Minimum: -56.38706926674811 > -56.38707591437031
END: th(2.154434690031884)=-56.38707591437031; dx=-3.46792048562474E-6 evalInputDelta=6.647622200262049E-6
Fitness changed from -56.38706926674811 to -56.38707591437031
Iteration 1 complete. Error: -56.38707591437031 Total: 9.5445; Orientation: 0.0605; Line Search: 3.7396
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7233789c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-56.38707591437031;dx=-3.4679365691310325E-6
New Minimum: -56.38707591437031 > -56.387092533422376
WOLFE (weak): th(4.641588833612779)=-56.387092533422376; dx=-3.4679397317116268E-6 evalInputDelta=1.661905206873371E-5
New Minimum: -56.387092533422376 > -56.38711247627839
WOLFE (weak): th(9.283177667225559)=-56.38711247627839; dx=-3.4679223233388497E-6 evalInputDelta=3.656190808243309E-5
New Minimum: -56.38711247627839 > -56.387175628609235
WOLFE (weak): th(27.849533001676676)=-56.387175628609235; dx=-3.4679717561721697E-6 evalInputDelta=9.971423892807252E-5
New Minimum: -56.387175628609235 > -56.38746812269285
WOLFE (weak): th(111.3981320067067)=-56.38746812269285; dx=-3.4679616775463183E-6 evalInputDelta=3.9220832254471816E-4
New Minimum: -56.38746812269285 > -56.389013662831374
WOLFE (weak): th(556.9906600335335)=-56.389013662831374; dx=-3.4679172783616116E-6 evalInputDelta=0.0019377484610672013
New Minimum: -56.389013662831374 > -56.39866817521088
WOLFE (weak): th(3341.9439602012008)=-56.39866817521088; dx=-3.467288660200427E-6 evalInputDelta=0.011592260840572521
New Minimum: -56.39866817521088 > -56.46814189404016
WOLFE (weak): th(23393.607721408407)=-56.46814189404016; dx=-3.4611013650444662E-6 evalInputDelta=0.08106597966985163
New Minimum: -56.46814189404016 > -57.03002121922147
WOLFE (weak): th(187148.86177126726)=-57.03002121922147; dx=-3.400813091344095E-6 evalInputDelta=0.6429453048511604
New Minimum: -57.03002121922147 > -61.66387806913516
END: th(1684339.7559414054)=-61.66387806913516; dx=-2.76339258321915E-6 evalInputDelta=5.276802154764852
Fitness changed from -56.38707591437031 to -61.66387806913516
Iteration 2 complete. Error: -61.66387806913516 Total: 21.2406; Orientation: 0.0580; Line Search: 19.0502
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2267f7f8 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-61.66387806913516;dx=-2.473574955068256E-6
New Minimum: -61.66387806913516 > -68.93346701763531
END: th(3628800.0000000005)=-68.93346701763531; dx=-1.5217738033350705E-6 evalInputDelta=7.26958894850015
Fitness changed from -61.66387806913516 to -68.93346701763531
Iteration 3 complete. Error: -68.93346701763531 Total: 6.1913; Orientation: 0.0669; Line Search: 3.9781
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement f45cd82 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.533e+03, gradient 1.209e-03, dot -0.763; [1d39868a-24ad-4656-ae23-5750148cb552 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.93346701763531, -61.66387806913516, -56.38707591437031, -56.38706926674811
LBFGS Accumulation History: 3 points
Removed measurement f45cd82 to history. Total: 3
th(0)=-68.93346701763531;dx=-1.4613765194144254E-6
New Minimum: -68.93346701763531 > -77.12983025082998
END: th(7818012.603187701)=-77.12983025082998; dx=-6.765000321826446E-7 evalInputDelta=8.196363233194674
Fitness changed from -68.93346701763531 to -77.12983025082998
Iteration 4 complete. Error: -77.12983025082998 Total: 7.0974; Orientation: 1.0193; Line Search: 3.9472
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 56387c77 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.987e+03, gradient 1.035e-03, dot -0.540; [1d39868a-24ad-4656-ae23-5750148cb552 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -77.12983025082998, -61.66387806913516, -56.38707591437031, -56.38706926674811
LBFGS Accumulation History: 3 points
Removed measurement 56387c77 to history. Total: 3
th(0)=-77.12983025082998;dx=-1.0702073625205532E-6
New Minimum: -77.12983025082998 > -83.96397679513166
END: th(1.6843397559414055E7)=-83.96397679513166; dx=-5.0713545517728994E-8 evalInputDelta=6.8341465443016745
Fitness changed from -77.12983025082998 to -83.96397679513166
Iteration 5 complete. Error: -83.96397679513166 Total: 7.0181; Orientation: 1.0180; Line Search: 3.8749
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1e3db894 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.318e+03, gradient 1.286e-03, dot -0.211; [1d39868a-24ad-4656-ae23-5750148cb552 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -83.96397679513166, -61.66387806913516, -56.38707591437031, -56.38706926674811
LBFGS Accumulation History: 3 points
Removed measurement 1e3db894 to history. Total: 3
th(0)=-83.96397679513166;dx=-1.6532095122048535E-6
Armijo: th(3.628800000000001E7)=-77.70225300869005; dx=3.8439151871636866E-7 evalInputDelta=-6.261723786441607
New Minimum: -83.96397679513166 > -86.55735574083815
WOLF (strong): th(1.8144000000000004E7)=-86.55735574083815; dx=5.714918096462087E-7 evalInputDelta=2.5933789457064904
New Minimum: -86.55735574083815 > -90.29270612447569
END: th(6048000.000000001)=-90.29270612447569; dx=-3.831414388541509E-7 evalInputDelta=6.3287293293440285
Fitness changed from -83.96397679513166 to -90.29270612447569
Iteration 6 complete. Error: -90.29270612447569 Total: 10.8259; Orientation: 1.0024; Line Search: 7.6984
Adding measurement 4800b22c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.547e+04, gradient 8.586e-04, dot -0.498; [1d39868a-24ad-4656-ae23-5750148cb552 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -90.29270612447569, -61.66387806913516, -56.38707591437031, -56.38706926674811
LBFGS Accumulation History: 3 points
Removed measurement 4800b22c to history. Total: 3
th(0)=-90.29270612447569;dx=-7.372487623737975E-7
New Minimum: -90.29270612447569 > -94.73026822005049
END: th(1.3030021005312836E7)=-94.73026822005049; dx=-5.0918815423316175E-8 evalInputDelta=4.437562095574805
Fitness changed from -90.29270612447569 to -94.73026822005049
Iteration 7 complete. Error: -94.73026822005049 Total: 6.4892; Orientation: 0.9530; Line Search: 3.7227
Adding measurement 4313de9e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.740e+04, gradient 1.046e-03, dot -0.349; [1d39868a-24ad-4656-ae23-5750148cb552 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.73026822005049, -61.66387806913516, -56.38707591437031, -56.38706926674811
LBFGS Accumulation History: 3 points
Removed measurement 4313de9e to history. Total: 3
th(0)=-94.73026822005049;dx=-1.094621273440945E-6
Armijo: th(2.8072329265690096E7)=-91.50185885735472; dx=3.620876455808518E-7 evalInputDelta=-3.2284093626957713
New Minimum: -94.73026822005049 > -97.13040384958835
WOLF (strong): th(1.4036164632845048E7)=-97.13040384958835; dx=3.837599281536215E-7 evalInputDelta=2.400135629537857
New Minimum: -97.13040384958835 > -98.26702791508406
END: th(4678721.544281683)=-98.26702791508406; dx=-3.833826974144134E-7 evalInputDelta=3.5367596950335667
Fitness changed from -94.73026822005049 to -98.26702791508406
Iteration 8 complete. Error: -98.26702791508406 Total: 10.4963; Orientation: 1.0206; Line Search: 7.6343
Adding measurement 40d75649 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.336e+04, gradient 6.858e-04, dot -0.616; [1d39868a-24ad-4656-ae23-5750148cb552 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -98.26702791508406, -61.66387806913516, -56.38707591437031, -56.38706926674811
LBFGS Accumulation History: 3 points
Removed measurement 40d75649 to history. Total: 3
th(0)=-98.26702791508406;dx=-4.703385427350179E-7
New Minimum: -98.26702791508406 > -101.65152423271256
END: th(1.0080000000000004E7)=-101.65152423271256; dx=-2.2481777381374047E-7 evalInputDelta=3.3844963176285034
Fitness changed from -98.26702791508406 to -101.65152423271256
Iteration 9 complete. Error: -101.65152423271256 Total: 6.5911; Orientation: 1.0079; Line Search: 3.7546
Adding measurement 57d0f1eb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.537e+04, gradient 7.407e-04, dot -0.532; [1d39868a-24ad-4656-ae23-5750148cb552 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -101.65152423271256, -61.66387806913516, -56.38707591437031, -56.38706926674811
LBFGS Accumulation History: 3 points
Removed measurement 57d0f1eb to history. Total: 3
th(0)=-101.65152423271256;dx=-5.486090839170043E-7
New Minimum: -101.65152423271256 > -103.98552160267987
WOLF (strong): th(2.1716701675521396E7)=-103.98552160267987; dx=8.660949180317566E-8 evalInputDelta=2.3339973699673067
New Minimum: -103.98552160267987 > -104.3746525009952
END: th(1.0858350837760698E7)=-104.3746525009952; dx=-4.463919117087103E-8 evalInputDelta=2.723128268282636
Fitness changed from -101.65152423271256 to -104.3746525009952
Iteration 10 complete. Error: -104.3746525009952 Total: 8.7061; Orientation: 1.0856; Line Search: 5.8160
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -104.3746525009952 (> -Infinity) after 94.568s (< 5400.000s)
Returns
-104.3746525009952