BasicOptimizer.scala:89 executed in 131.55 seconds (1.700 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 34441518637800
Reset training subject: 34444050613900
Adding measurement e920fc1 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-67.72266816487246;dx=-4.687886869020489E-6
New Minimum: -67.72266816487246 > -67.72267574406976
END: th(2.154434690031884)=-67.72267574406976; dx=-3.386995680178894E-6 evalInputDelta=7.5791973017658165E-6
Fitness changed from -67.72266816487246 to -67.72267574406976
Iteration 1 complete. Error: -67.72267574406976 Total: 12.6361; Orientation: 0.0609; Line Search: 5.0369
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 502db8bd to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-67.72267574406976;dx=-3.3613901534511555E-6
New Minimum: -67.72267574406976 > -67.72269342886015
WOLFE (weak): th(4.641588833612779)=-67.72269342886015; dx=-3.3592682115304723E-6 evalInputDelta=1.768479039299109E-5
New Minimum: -67.72269342886015 > -67.72271111364594
WOLFE (weak): th(9.283177667225559)=-67.72271111364594; dx=-3.3591304716972215E-6 evalInputDelta=3.536957618166525E-5
New Minimum: -67.72271111364594 > -67.72278437913783
WOLFE (weak): th(27.849533001676676)=-67.72278437913783; dx=-3.3569571891965877E-6 evalInputDelta=1.086350680736814E-4
New Minimum: -67.72278437913783 > -67.72310523053083
WOLFE (weak): th(111.3981320067067)=-67.72310523053083; dx=-3.35527383852627E-6 evalInputDelta=4.2948646107277E-4
New Minimum: -67.72310523053083 > -67.7248206228197
WOLFE (weak): th(556.9906600335335)=-67.7248206228197; dx=-3.3540359870027594E-6 evalInputDelta=0.0021448787499451782
New Minimum: -67.7248206228197 > -67.73554399779016
WOLFE (weak): th(3341.9439602012008)=-67.73554399779016; dx=-3.353314588059851E-6 evalInputDelta=0.01286825372039857
New Minimum: -67.73554399779016 > -67.8126744866956
WOLFE (weak): th(23393.607721408407)=-67.8126744866956; dx=-3.348278598261381E-6 evalInputDelta=0.08999874262583774
New Minimum: -67.8126744866956 > -68.43610197154709
WOLFE (weak): th(187148.86177126726)=-68.43610197154709; dx=-3.282851994565952E-6 evalInputDelta=0.7134262274773278
New Minimum: -68.43610197154709 > -73.42092975913825
END: th(1684339.7559414054)=-73.42092975913825; dx=-2.47042214418065E-6 evalInputDelta=5.6982540150684855
Fitness changed from -67.72267574406976 to -73.42092975913825
Iteration 2 complete. Error: -73.42092975913825 Total: 29.0328; Orientation: 0.0613; Line Search: 25.8781
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3178551f to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-73.42092975913825;dx=-2.34545918120219E-6
New Minimum: -73.42092975913825 > -80.6950957749209
END: th(3628800.0000000005)=-80.6950957749209; dx=-1.2576305088510976E-6 evalInputDelta=7.274166015782654
Fitness changed from -73.42092975913825 to -80.6950957749209
Iteration 3 complete. Error: -80.6950957749209 Total: 8.7850; Orientation: 0.0615; Line Search: 5.8095
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 52b9b95b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.158e+03, gradient 1.210e-03, dot -0.644; [5642d520-111a-4e20-b1b7-00f25b8d4802 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.6950957749209, -73.42092975913825, -67.72267574406976, -67.72266816487246
LBFGS Accumulation History: 3 points
Removed measurement 52b9b95b to history. Total: 3
th(0)=-80.6950957749209;dx=-1.464978554541897E-6
New Minimum: -80.6950957749209 > -89.33552645989518
END: th(7818012.603187701)=-89.33552645989518; dx=-5.924333867292744E-7 evalInputDelta=8.640430684974277
Fitness changed from -80.6950957749209 to -89.33552645989518
Iteration 4 complete. Error: -89.33552645989518 Total: 9.5982; Orientation: 1.0558; Line Search: 5.2257
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 51e86f55 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.376e+04, gradient 1.280e-03, dot -0.499; [5642d520-111a-4e20-b1b7-00f25b8d4802 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -89.33552645989518, -73.42092975913825, -67.72267574406976, -67.72266816487246
LBFGS Accumulation History: 3 points
Removed measurement 51e86f55 to history. Total: 3
th(0)=-89.33552645989518;dx=-1.6384459626400642E-6
Armijo: th(1.6843397559414055E7)=-89.3139013486362; dx=4.964891367158115E-7 evalInputDelta=-0.021625111258984475
New Minimum: -89.33552645989518 > -93.5633836822089
WOLF (strong): th(8421698.779707028)=-93.5633836822089; dx=2.438221334134747E-7 evalInputDelta=4.227857222313716
END: th(2807232.926569009)=-93.01186176516458; dx=-6.822944681200712E-7 evalInputDelta=3.6763353052694043
Fitness changed from -89.33552645989518 to -93.5633836822089
Iteration 5 complete. Error: -93.5633836822089 Total: 14.3308; Orientation: 1.0395; Line Search: 10.3521
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1e563750 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.672e+03, gradient 1.624e-03, dot -0.233; [5642d520-111a-4e20-b1b7-00f25b8d4802 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.5633836822089, -73.42092975913825, -67.72267574406976, -67.72266816487246
LBFGS Accumulation History: 3 points
Removed measurement 1e563750 to history. Total: 3
th(0)=-93.5633836822089;dx=-2.636459997902702E-6
New Minimum: -93.5633836822089 > -100.04004413988828
WOLF (strong): th(6048000.000000001)=-100.04004413988828; dx=6.576323795395908E-7 evalInputDelta=6.476660457679387
END: th(3024000.0000000005)=-99.95028020200341; dx=-9.449052470663678E-7 evalInputDelta=6.386896519794519
Fitness changed from -93.5633836822089 to -100.04004413988828
Iteration 6 complete. Error: -100.04004413988828 Total: 11.5270; Orientation: 1.0005; Line Search: 7.5593
Adding measurement 6a1c630c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.108e+04, gradient 1.437e-03, dot -0.362; [5642d520-111a-4e20-b1b7-00f25b8d4802 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -100.04004413988828, -73.42092975913825, -67.72267574406976, -67.72266816487246
LBFGS Accumulation History: 3 points
Removed measurement 6a1c630c to history. Total: 3
th(0)=-100.04004413988828;dx=-2.06431385539252E-6
New Minimum: -100.04004413988828 > -104.09472390268049
WOLF (strong): th(6515010.502656418)=-104.09472390268049; dx=7.216078160153675E-7 evalInputDelta=4.054679762792205
New Minimum: -104.09472390268049 > -104.92784938721952
END: th(3257505.251328209)=-104.92784938721952; dx=-4.932504331342599E-7 evalInputDelta=4.887805247331244
Fitness changed from -100.04004413988828 to -104.92784938721952
Iteration 7 complete. Error: -104.92784938721952 Total: 11.7438; Orientation: 1.1767; Line Search: 8.0072
Adding measurement 4ff6f035 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.900e+04, gradient 8.925e-04, dot -0.670; [5642d520-111a-4e20-b1b7-00f25b8d4802 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.92784938721952, -73.42092975913825, -67.72267574406976, -67.72266816487246
LBFGS Accumulation History: 3 points
Removed measurement 4ff6f035 to history. Total: 3
th(0)=-104.92784938721952;dx=-7.958231081707231E-7
New Minimum: -104.92784938721952 > -109.27068557169015
END: th(7018082.316422524)=-109.27068557169015; dx=-3.541310766517873E-7 evalInputDelta=4.342836184470627
Fitness changed from -104.92784938721952 to -109.27068557169015
Iteration 8 complete. Error: -109.27068557169015 Total: 8.7774; Orientation: 1.0459; Line Search: 5.2444
Adding measurement 32cb4c3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.328e+04, gradient 1.026e-03, dot -0.541; [5642d520-111a-4e20-b1b7-00f25b8d4802 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -109.27068557169015, -73.42092975913825, -67.72267574406976, -67.72266816487246
LBFGS Accumulation History: 3 points
Removed measurement 32cb4c3 to history. Total: 3
th(0)=-109.27068557169015;dx=-1.0514096998788438E-6
New Minimum: -109.27068557169015 > -109.27889624441019
WOLF (strong): th(1.5120000000000006E7)=-109.27889624441019; dx=3.7478960760762834E-7 evalInputDelta=0.008210672720039724
New Minimum: -109.27889624441019 > -112.03238000837283
WOLF (strong): th(7560000.000000003)=-112.03238000837283; dx=1.357669902535901E-7 evalInputDelta=2.7616944366826743
END: th(2520000.000000001)=-111.47221819643205; dx=-5.002475646812169E-7 evalInputDelta=2.201532624741901
Fitness changed from -109.27068557169015 to -112.03238000837283
Iteration 9 complete. Error: -112.03238000837283 Total: 13.5364; Orientation: 1.0372; Line Search: 10.1221
Adding measurement a77b29d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.897e+04, gradient 1.299e-03, dot -0.358; [5642d520-111a-4e20-b1b7-00f25b8d4802 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -112.03238000837283, -73.42092975913825, -67.72267574406976, -67.72266816487246
LBFGS Accumulation History: 3 points
Removed measurement a77b29d to history. Total: 3
th(0)=-112.03238000837283;dx=-1.6855072362360253E-6
New Minimum: -112.03238000837283 > -116.17967154438809
WOLF (strong): th(5429175.418880349)=-116.17967154438809; dx=3.610913195254444E-7 evalInputDelta=4.14729153601526
END: th(2714587.7094401745)=-115.83012254316435; dx=-7.068317736818002E-7 evalInputDelta=3.7977425347915243
Fitness changed from -112.03238000837283 to -116.17967154438809
Iteration 10 complete. Error: -116.17967154438809 Total: 11.1010; Orientation: 1.0232; Line Search: 7.6637
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -116.17967154438809 (> -Infinity) after 131.555s (< 5400.000s)
Returns
-116.17967154438809