BasicOptimizer.scala:89 executed in 152.23 seconds (2.709 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 458183157585000
Reset training subject: 458186203434300
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -100.194878142981 > -100.19641983786634
th(0)=-100.19641983786634;dx=-1.532300629310179E-5
New Minimum: -100.19641983786634 > -100.19644202035344
END: th(2.154434690031884)=-100.19644202035344; dx=-1.2378980578144454E-5 evalInputDelta=2.2182487100508297E-5
Fitness changed from -100.194878142981 to -100.19644202035344
Iteration 1 complete. Error: -100.19644202035344 Total: 14.8143; Orientation: 0.0700; Line Search: 6.0223
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 66a12341 to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-100.19644202035344;dx=-1.2369738053841702E-5
New Minimum: -100.19644202035344 > -100.1965085677853
WOLFE (weak): th(4.641588833612779)=-100.1965085677853; dx=-1.2345469477808017E-5 evalInputDelta=6.654743185663392E-5
New Minimum: -100.1965085677853 > -100.196569569559
WOLFE (weak): th(9.283177667225559)=-100.196569569559; dx=-1.2344871802269823E-5 evalInputDelta=1.275492055583527E-4
New Minimum: -100.196569569559 > -100.19681357628242
WOLFE (weak): th(27.849533001676676)=-100.19681357628242; dx=-1.23342411028199E-5 evalInputDelta=3.7155592897875067E-4
New Minimum: -100.19681357628242 > -100.19788941702265
WOLFE (weak): th(111.3981320067067)=-100.19788941702265; dx=-1.2335795837931362E-5 evalInputDelta=0.0014473966692065687
New Minimum: -100.19788941702265 > -100.20367324940877
WOLFE (weak): th(556.9906600335335)=-100.20367324940877; dx=-1.2323278624600124E-5 evalInputDelta=0.007231229055321364
New Minimum: -100.20367324940877 > -100.23979385374012
WOLFE (weak): th(3341.9439602012008)=-100.23979385374012; dx=-1.2325182700276452E-5 evalInputDelta=0.04335183338668003
New Minimum: -100.23979385374012 > -100.49926334564884
WOLFE (weak): th(23393.607721408407)=-100.49926334564884; dx=-1.2255762996576294E-5 evalInputDelta=0.3028213252953975
New Minimum: -100.49926334564884 > -102.57293983233623
WOLFE (weak): th(187148.86177126726)=-102.57293983233623; dx=-1.180063007380898E-5 evalInputDelta=2.3764978119827873
New Minimum: -102.57293983233623 > -117.71051325707369
END: th(1684339.7559414054)=-117.71051325707369; dx=-7.503483195868802E-6 evalInputDelta=17.51407123672024
Fitness changed from -100.19644202035344 to -117.71051325707369
Iteration 2 complete. Error: -117.71051325707369 Total: 32.3753; Orientation: 0.0942; Line Search: 28.8666
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2e6c98d0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-117.71051325707369;dx=-7.744547449901145E-6
New Minimum: -117.71051325707369 > -136.91454515041917
END: th(3628800.0000000005)=-136.91454515041917; dx=-3.199897836348036E-6 evalInputDelta=19.204031893345487
Fitness changed from -117.71051325707369 to -136.91454515041917
Iteration 3 complete. Error: -136.91454515041917 Total: 9.1231; Orientation: 0.1094; Line Search: 5.6215
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3222b70a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-136.91454515041917;dx=-5.044725313893637E-6
New Minimum: -136.91454515041917 > -154.11685138886872
END: th(7818012.603187701)=-154.11685138886872; dx=-5.984124112053025E-7 evalInputDelta=17.20230623844955
Fitness changed from -136.91454515041917 to -154.11685138886872
Iteration 4 complete. Error: -154.11685138886872 Total: 9.5579; Orientation: 0.1156; Line Search: 5.9866
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 48e4c6c8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.674e+04, gradient 2.510e-03, dot -0.479; [f041e714-411f-454e-bb58-14c4dbfa522d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -154.11685138886872, -136.91454515041917, -117.71051325707369, -100.19644202035344
LBFGS Accumulation History: 3 points
Removed measurement 48e4c6c8 to history. Total: 3
th(0)=-154.11685138886872;dx=-6.27716438839777E-6
Armijo: th(1.6843397559414055E7)=-147.30072107724314; dx=1.7716109309848513E-6 evalInputDelta=-6.816130311625585
New Minimum: -154.11685138886872 > -164.66304313300736
WOLF (strong): th(8421698.779707028)=-164.66304313300736; dx=1.4124135396876604E-6 evalInputDelta=10.546191744138639
New Minimum: -164.66304313300736 > -166.40114658985527
END: th(2807232.926569009)=-166.40114658985527; dx=-2.186035063328076E-6 evalInputDelta=12.284295200986548
Fitness changed from -154.11685138886872 to -166.40114658985527
Iteration 5 complete. Error: -166.40114658985527 Total: 16.8262; Orientation: 1.9729; Line Search: 11.3755
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 497e03e6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.742e+04, gradient 1.747e-03, dot -0.643; [f041e714-411f-454e-bb58-14c4dbfa522d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -166.40114658985527, -136.91454515041917, -117.71051325707369, -100.19644202035344
LBFGS Accumulation History: 3 points
Removed measurement 497e03e6 to history. Total: 3
th(0)=-166.40114658985527;dx=-3.037299895084421E-6
New Minimum: -166.40114658985527 > -177.24366941334986
END: th(6048000.000000001)=-177.24366941334986; dx=-8.910531028158526E-7 evalInputDelta=10.84252282349459
Fitness changed from -166.40114658985527 to -177.24366941334986
Iteration 6 complete. Error: -177.24366941334986 Total: 11.1265; Orientation: 2.0235; Line Search: 5.8173
Adding measurement 6c81269d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.530e+04, gradient 1.902e-03, dot -0.559; [f041e714-411f-454e-bb58-14c4dbfa522d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -177.24366941334986, -136.91454515041917, -117.71051325707369, -100.19644202035344
LBFGS Accumulation History: 3 points
Removed measurement 6c81269d to history. Total: 3
th(0)=-177.24366941334986;dx=-3.6146377489720074E-6
New Minimum: -177.24366941334986 > -179.6662055998667
WOLF (strong): th(1.3030021005312836E7)=-179.6662055998667; dx=8.973863515871696E-7 evalInputDelta=2.4225361865168225
New Minimum: -179.6662055998667 > -185.09725006027082
WOLF (strong): th(6515010.502656418)=-185.09725006027082; dx=2.1581856219063758E-7 evalInputDelta=7.85358064692096
END: th(2171670.167552139)=-183.14332261343756; dx=-1.7076262325320178E-6 evalInputDelta=5.899653200087698
Fitness changed from -177.24366941334986 to -185.09725006027082
Iteration 7 complete. Error: -185.09725006027082 Total: 16.9883; Orientation: 1.8648; Line Search: 12.0913
Adding measurement 4fb0ffd6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.822e+04, gradient 2.112e-03, dot -0.467; [f041e714-411f-454e-bb58-14c4dbfa522d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -185.09725006027082, -136.91454515041917, -117.71051325707369, -100.19644202035344
LBFGS Accumulation History: 3 points
Removed measurement 4fb0ffd6 to history. Total: 3
th(0)=-185.09725006027082;dx=-4.4588127887236615E-6
New Minimum: -185.09725006027082 > -195.37510513372118
END: th(4678721.544281682)=-195.37510513372118; dx=-2.7733183600163213E-8 evalInputDelta=10.277855073450354
Fitness changed from -185.09725006027082 to -195.37510513372118
Iteration 8 complete. Error: -195.37510513372118 Total: 10.7664; Orientation: 1.8899; Line Search: 5.9830
Adding measurement 6c78f2e8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.809e+04, gradient 1.705e-03, dot -0.553; [f041e714-411f-454e-bb58-14c4dbfa522d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -195.37510513372118, -136.91454515041917, -117.71051325707369, -100.19644202035344
LBFGS Accumulation History: 3 points
Removed measurement 6c78f2e8 to history. Total: 3
th(0)=-195.37510513372118;dx=-2.8906034627381375E-6
New Minimum: -195.37510513372118 > -199.7482779488727
WOLF (strong): th(1.0080000000000002E7)=-199.7482779488727; dx=7.781688138518537E-7 evalInputDelta=4.37317281515152
New Minimum: -199.7482779488727 > -202.47096716555717
END: th(5040000.000000001)=-202.47096716555717; dx=-2.0585135789635208E-7 evalInputDelta=7.095862031835992
Fitness changed from -195.37510513372118 to -202.47096716555717
Iteration 9 complete. Error: -202.47096716555717 Total: 13.3169; Orientation: 1.8217; Line Search: 8.6702
Adding measurement 3aafb280 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.336e+04, gradient 1.666e-03, dot -0.544; [f041e714-411f-454e-bb58-14c4dbfa522d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.47096716555717, -136.91454515041917, -117.71051325707369, -100.19644202035344
LBFGS Accumulation History: 3 points
Removed measurement 3aafb280 to history. Total: 3
th(0)=-202.47096716555717;dx=-2.7538899908789325E-6
New Minimum: -202.47096716555717 > -205.04691723293388
WOLF (strong): th(1.0858350837760696E7)=-205.04691723293388; dx=8.629980282551916E-7 evalInputDelta=2.5759500673767093
New Minimum: -205.04691723293388 > -208.89443896275293
WOLF (strong): th(5429175.418880348)=-208.89443896275293; dx=4.951446884137909E-8 evalInputDelta=6.423471797195759
END: th(1809725.1396267826)=-206.56745928719982; dx=-1.6412218773204856E-6 evalInputDelta=4.096492121642655
Fitness changed from -202.47096716555717 to -208.89443896275293
Iteration 10 complete. Error: -208.89443896275293 Total: 16.6262; Orientation: 1.8101; Line Search: 11.9463
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -208.89443896275293 (> -Infinity) after 152.230s (< 5400.000s)
Returns
-208.89443896275293