BasicOptimizer.scala:89 executed in 111.44 seconds (0.992 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 40585345115200
Reset training subject: 40587739512000
Adding measurement 1b022498 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-53.13413672639801;dx=-1.7167117327770718E-6
New Minimum: -53.13413672639801 > -53.13414001813987
END: th(2.154434690031884)=-53.13414001813987; dx=-1.2842071447990197E-6 evalInputDelta=3.2917418550937327E-6
Fitness changed from -53.13413672639801 to -53.13414001813987
Iteration 1 complete. Error: -53.13414001813987 Total: 11.6193; Orientation: 0.0719; Line Search: 4.7448
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 658a321a to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-53.13414001813987;dx=-1.2668635486759196E-6
New Minimum: -53.13414001813987 > -53.13414495575228
WOLFE (weak): th(4.641588833612779)=-53.13414495575228; dx=-1.265500621191697E-6 evalInputDelta=4.937612409605663E-6
New Minimum: -53.13414495575228 > -53.13415318510526
WOLFE (weak): th(9.283177667225559)=-53.13415318510526; dx=-1.2658084124075641E-6 evalInputDelta=1.3166965395328134E-5
New Minimum: -53.13415318510526 > -53.134174581417064
WOLFE (weak): th(27.849533001676676)=-53.134174581417064; dx=-1.2645660005582615E-6 evalInputDelta=3.4563277196753006E-5
New Minimum: -53.134174581417064 > -53.13429143804487
WOLFE (weak): th(111.3981320067067)=-53.13429143804487; dx=-1.2624942986248611E-6 evalInputDelta=1.5141990500211477E-4
New Minimum: -53.13429143804487 > -53.13490369673914
WOLFE (weak): th(556.9906600335335)=-53.13490369673914; dx=-1.2620346869502869E-6 evalInputDelta=7.636785992701789E-4
New Minimum: -53.13490369673914 > -53.13871534219207
WOLFE (weak): th(3341.9439602012008)=-53.13871534219207; dx=-1.262597608659863E-6 evalInputDelta=0.004575324052204621
New Minimum: -53.13871534219207 > -53.166173821901864
WOLFE (weak): th(23393.607721408407)=-53.166173821901864; dx=-1.2619315796430048E-6 evalInputDelta=0.032033803761997603
New Minimum: -53.166173821901864 > -53.389117167561096
WOLFE (weak): th(187148.86177126726)=-53.389117167561096; dx=-1.2474036991465084E-6 evalInputDelta=0.2549771494212294
New Minimum: -53.389117167561096 > -55.30676691346049
END: th(1684339.7559414054)=-55.30676691346049; dx=-1.1187507476686679E-6 evalInputDelta=2.172626895320626
Fitness changed from -53.13414001813987 to -55.30676691346049
Iteration 2 complete. Error: -55.30676691346049 Total: 25.7405; Orientation: 0.0641; Line Search: 23.0965
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 39ea0da4 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-55.30676691346049;dx=-1.1225007703907684E-6
New Minimum: -55.30676691346049 > -59.03564364667174
END: th(3628800.0000000005)=-59.03564364667174; dx=-8.440457275995269E-7 evalInputDelta=3.7288767332112442
Fitness changed from -55.30676691346049 to -59.03564364667174
Iteration 3 complete. Error: -59.03564364667174 Total: 7.1136; Orientation: 0.0615; Line Search: 4.2931
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 621eb29e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.724e+04, gradient 8.923e-04, dot -0.900; [af938bbc-c623-4ebe-8acf-715e5994c8ea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.03564364667174, -55.30676691346049, -53.13414001813987, -53.13413672639801
LBFGS Accumulation History: 3 points
Removed measurement 621eb29e to history. Total: 3
th(0)=-59.03564364667174;dx=-7.944504136090554E-7
New Minimum: -59.03564364667174 > -64.5880515169734
END: th(7818012.603187701)=-64.5880515169734; dx=-5.450096838749918E-7 evalInputDelta=5.552407870301657
Fitness changed from -59.03564364667174 to -64.5880515169734
Iteration 4 complete. Error: -64.5880515169734 Total: 8.4064; Orientation: 1.1156; Line Search: 4.5858
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 1c1ddede to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.394e+04, gradient 7.439e-04, dot -0.778; [af938bbc-c623-4ebe-8acf-715e5994c8ea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.5880515169734, -55.30676691346049, -53.13414001813987, -53.13413672639801
LBFGS Accumulation History: 3 points
Removed measurement 1c1ddede to history. Total: 3
th(0)=-64.5880515169734;dx=-5.527975881893817E-7
New Minimum: -64.5880515169734 > -72.17457223543376
END: th(1.6843397559414055E7)=-72.17457223543376; dx=-3.192226737015431E-7 evalInputDelta=7.586520718460363
Fitness changed from -64.5880515169734 to -72.17457223543376
Iteration 5 complete. Error: -72.17457223543376 Total: 8.4574; Orientation: 1.1506; Line Search: 4.6873
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2c2f5416 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.703e+04, gradient 6.616e-04, dot -0.627; [af938bbc-c623-4ebe-8acf-715e5994c8ea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.17457223543376, -55.30676691346049, -53.13414001813987, -53.13413672639801
LBFGS Accumulation History: 3 points
Removed measurement 2c2f5416 to history. Total: 3
th(0)=-72.17457223543376;dx=-4.3661046206249544E-7
New Minimum: -72.17457223543376 > -80.70445734758282
END: th(3.628800000000001E7)=-80.70445734758282; dx=-9.864171779165949E-8 evalInputDelta=8.52988511214906
Fitness changed from -72.17457223543376 to -80.70445734758282
Iteration 6 complete. Error: -80.70445734758282 Total: 8.4779; Orientation: 1.1995; Line Search: 4.5929
Adding measurement 1ca8bdfd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.860e+04, gradient 8.055e-04, dot -0.308; [af938bbc-c623-4ebe-8acf-715e5994c8ea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.70445734758282, -55.30676691346049, -53.13414001813987, -53.13413672639801
LBFGS Accumulation History: 3 points
Removed measurement 1ca8bdfd to history. Total: 3
th(0)=-80.70445734758282;dx=-6.482014702490066E-7
Armijo: th(7.818012603187701E7)=-73.89739818840604; dx=1.605674190363066E-7 evalInputDelta=-6.807059159176774
New Minimum: -80.70445734758282 > -82.5784279066738
WOLF (strong): th(3.9090063015938506E7)=-82.5784279066738; dx=1.8951075667996538E-7 evalInputDelta=1.8739705590909779
New Minimum: -82.5784279066738 > -85.8724593493044
END: th(1.3030021005312836E7)=-85.8724593493044; dx=-1.274957344638997E-7 evalInputDelta=5.1680020017215895
Fitness changed from -80.70445734758282 to -85.8724593493044
Iteration 7 complete. Error: -85.8724593493044 Total: 12.4728; Orientation: 1.1176; Line Search: 9.1671
Adding measurement 6b6e693c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.032e+04, gradient 5.838e-04, dot -0.531; [af938bbc-c623-4ebe-8acf-715e5994c8ea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.8724593493044, -55.30676691346049, -53.13414001813987, -53.13413672639801
LBFGS Accumulation History: 3 points
Removed measurement 6b6e693c to history. Total: 3
th(0)=-85.8724593493044;dx=-3.3992320197454106E-7
New Minimum: -85.8724593493044 > -90.20995615749659
END: th(2.8072329265690096E7)=-90.20995615749659; dx=-2.8685568482513024E-8 evalInputDelta=4.337496808192185
Fitness changed from -85.8724593493044 to -90.20995615749659
Iteration 8 complete. Error: -90.20995615749659 Total: 7.8064; Orientation: 1.0628; Line Search: 4.5520
Adding measurement 5856a63d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.177e+04, gradient 7.394e-04, dot -0.350; [af938bbc-c623-4ebe-8acf-715e5994c8ea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -90.20995615749659, -55.30676691346049, -53.13414001813987, -53.13413672639801
LBFGS Accumulation History: 3 points
Removed measurement 5856a63d to history. Total: 3
th(0)=-90.20995615749659;dx=-5.459347016203747E-7
Armijo: th(6.048000000000002E7)=-85.07203171454753; dx=1.7402524381855605E-7 evalInputDelta=-5.137924442949057
New Minimum: -90.20995615749659 > -92.1277493024819
WOLF (strong): th(3.024000000000001E7)=-92.1277493024819; dx=1.842978199660783E-7 evalInputDelta=1.9177931449853105
New Minimum: -92.1277493024819 > -94.02693855075364
END: th(1.0080000000000004E7)=-94.02693855075364; dx=-1.7072303654664207E-7 evalInputDelta=3.8169823932570495
Fitness changed from -90.20995615749659 to -94.02693855075364
Iteration 9 complete. Error: -94.02693855075364 Total: 13.0008; Orientation: 1.1693; Line Search: 9.3210
Adding measurement 7a3a503b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.239e+04, gradient 4.809e-04, dot -0.609; [af938bbc-c623-4ebe-8acf-715e5994c8ea = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.02693855075364, -55.30676691346049, -53.13414001813987, -53.13413672639801
LBFGS Accumulation History: 3 points
Removed measurement 7a3a503b to history. Total: 3
th(0)=-94.02693855075364;dx=-2.3070956195858399E-7
New Minimum: -94.02693855075364 > -97.5517996426304
END: th(2.1716701675521396E7)=-97.5517996426304; dx=-1.0940955577767289E-7 evalInputDelta=3.5248610918767582
Fitness changed from -94.02693855075364 to -97.5517996426304
Iteration 10 complete. Error: -97.5517996426304 Total: 7.9443; Orientation: 1.1544; Line Search: 4.6863
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -97.5517996426304 (> -Infinity) after 111.441s (< 5400.000s)
Returns
-97.5517996426304