BasicOptimizer.scala:89 executed in 152.93 seconds (2.657 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 457923153495900
Reset training subject: 457926068269100
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -102.52155084673598 > -102.52247763703356
th(0)=-102.52247763703356;dx=-1.495580088558143E-5
New Minimum: -102.52247763703356 > -102.52251015583923
END: th(2.154434690031884)=-102.52251015583923; dx=-1.2063445587999225E-5 evalInputDelta=3.251880566779164E-5
Fitness changed from -102.52155084673598 to -102.52251015583923
Iteration 1 complete. Error: -102.52251015583923 Total: 14.8083; Orientation: 0.0699; Line Search: 6.0603
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 10143e5a to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-102.52251015583923;dx=-1.2046733798241496E-5
New Minimum: -102.52251015583923 > -102.52256977362283
WOLFE (weak): th(4.641588833612779)=-102.52256977362283; dx=-1.2085927491705302E-5 evalInputDelta=5.9617783605858676E-5
New Minimum: -102.52256977362283 > -102.52262397157784
WOLFE (weak): th(9.283177667225559)=-102.52262397157784; dx=-1.2087323105974274E-5 evalInputDelta=1.1381573861513061E-4
New Minimum: -102.52262397157784 > -102.52285702245791
WOLFE (weak): th(27.849533001676676)=-102.52285702245791; dx=-1.2078006007881725E-5 evalInputDelta=3.468666186847713E-4
New Minimum: -102.52285702245791 > -102.52392471390279
WOLFE (weak): th(111.3981320067067)=-102.52392471390279; dx=-1.2075232308906296E-5 evalInputDelta=0.001414558063558502
New Minimum: -102.52392471390279 > -102.5295881704224
WOLFE (weak): th(556.9906600335335)=-102.5295881704224; dx=-1.2047232302614324E-5 evalInputDelta=0.007078014583171921
New Minimum: -102.5295881704224 > -102.56498175163772
WOLFE (weak): th(3341.9439602012008)=-102.56498175163772; dx=-1.2066679780091407E-5 evalInputDelta=0.04247159579848869
New Minimum: -102.56498175163772 > -102.81930780498392
WOLFE (weak): th(23393.607721408407)=-102.81930780498392; dx=-1.2010775136328223E-5 evalInputDelta=0.2967976491446933
New Minimum: -102.81930780498392 > -104.8554495545046
WOLFE (weak): th(187148.86177126726)=-104.8554495545046; dx=-1.156851474059346E-5 evalInputDelta=2.332939398665374
New Minimum: -104.8554495545046 > -119.90007550960678
END: th(1684339.7559414054)=-119.90007550960678; dx=-7.541352507567252E-6 evalInputDelta=17.37756535376755
Fitness changed from -102.52251015583923 to -119.90007550960678
Iteration 2 complete. Error: -119.90007550960678 Total: 32.4755; Orientation: 0.1218; Line Search: 29.0285
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 6144b569 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-119.90007550960678;dx=-7.685031100591832E-6
New Minimum: -119.90007550960678 > -139.33975875452322
END: th(3628800.0000000005)=-139.33975875452322; dx=-3.2664152220860777E-6 evalInputDelta=19.439683244916438
Fitness changed from -119.90007550960678 to -139.33975875452322
Iteration 3 complete. Error: -139.33975875452322 Total: 9.5156; Orientation: 0.1140; Line Search: 5.9458
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 67786171 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-139.33975875452322;dx=-4.947785756111598E-6
New Minimum: -139.33975875452322 > -157.04572984164386
END: th(7818012.603187701)=-157.04572984164386; dx=-6.929322377513975E-7 evalInputDelta=17.705971087120645
Fitness changed from -139.33975875452322 to -157.04572984164386
Iteration 4 complete. Error: -157.04572984164386 Total: 9.2153; Orientation: 0.1134; Line Search: 5.6426
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 1885014d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.718e+04, gradient 2.447e-03, dot -0.485; [97261819-e654-4e53-9320-8b40d9ece541 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -157.04572984164386, -139.33975875452322, -119.90007550960678, -102.52251015583923
LBFGS Accumulation History: 3 points
Removed measurement 1885014d to history. Total: 3
th(0)=-157.04572984164386;dx=-5.968957915060546E-6
Armijo: th(1.6843397559414055E7)=-151.80382632988224; dx=1.658962770193879E-6 evalInputDelta=-5.24190351176162
New Minimum: -157.04572984164386 > -167.8782500897874
WOLF (strong): th(8421698.779707028)=-167.8782500897874; dx=1.2229314962227066E-6 evalInputDelta=10.832520248143538
New Minimum: -167.8782500897874 > -168.85362238498763
END: th(2807232.926569009)=-168.85362238498763; dx=-2.180199309717452E-6 evalInputDelta=11.807892543343769
Fitness changed from -157.04572984164386 to -168.85362238498763
Iteration 5 complete. Error: -168.85362238498763 Total: 17.6166; Orientation: 2.1217; Line Search: 11.9266
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 673d73d7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.815e+04, gradient 1.732e-03, dot -0.651; [97261819-e654-4e53-9320-8b40d9ece541 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -168.85362238498763, -139.33975875452322, -119.90007550960678, -102.52251015583923
LBFGS Accumulation History: 3 points
Removed measurement 673d73d7 to history. Total: 3
th(0)=-168.85362238498763;dx=-2.9882534559256174E-6
New Minimum: -168.85362238498763 > -179.77982595549014
END: th(6048000.000000001)=-179.77982595549014; dx=-9.457200838367717E-7 evalInputDelta=10.926203570502508
Fitness changed from -168.85362238498763 to -179.77982595549014
Iteration 6 complete. Error: -179.77982595549014 Total: 11.1362; Orientation: 1.8931; Line Search: 5.8406
Adding measurement 72e6111f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.638e+04, gradient 1.884e-03, dot -0.567; [97261819-e654-4e53-9320-8b40d9ece541 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -179.77982595549014, -139.33975875452322, -119.90007550960678, -102.52251015583923
LBFGS Accumulation History: 3 points
Removed measurement 72e6111f to history. Total: 3
th(0)=-179.77982595549014;dx=-3.549316862945754E-6
New Minimum: -179.77982595549014 > -182.98201422618106
WOLF (strong): th(1.3030021005312836E7)=-182.98201422618106; dx=8.113637272329317E-7 evalInputDelta=3.2021882706909253
New Minimum: -182.98201422618106 > -187.8585248908365
WOLF (strong): th(6515010.502656418)=-187.8585248908365; dx=1.3627477597695298E-7 evalInputDelta=8.078698935346353
END: th(2171670.167552139)=-185.6364004267536; dx=-1.7339773867013644E-6 evalInputDelta=5.856574471263457
Fitness changed from -179.77982595549014 to -187.8585248908365
Iteration 7 complete. Error: -187.8585248908365 Total: 16.8327; Orientation: 1.8414; Line Search: 11.8642
Adding measurement 42ca638a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.965e+04, gradient 2.090e-03, dot -0.474; [97261819-e654-4e53-9320-8b40d9ece541 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -187.8585248908365, -139.33975875452322, -119.90007550960678, -102.52251015583923
LBFGS Accumulation History: 3 points
Removed measurement 42ca638a to history. Total: 3
th(0)=-187.8585248908365;dx=-4.354528032218308E-6
New Minimum: -187.8585248908365 > -198.04439386684206
END: th(4678721.544281682)=-198.04439386684206; dx=-4.3859819569708155E-8 evalInputDelta=10.185868976005565
Fitness changed from -187.8585248908365 to -198.04439386684206
Iteration 8 complete. Error: -198.04439386684206 Total: 10.7244; Orientation: 1.9202; Line Search: 6.1735
Adding measurement 5e49db82 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.904e+04, gradient 1.698e-03, dot -0.557; [97261819-e654-4e53-9320-8b40d9ece541 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -198.04439386684206, -139.33975875452322, -119.90007550960678, -102.52251015583923
LBFGS Accumulation History: 3 points
Removed measurement 5e49db82 to history. Total: 3
th(0)=-198.04439386684206;dx=-2.878672508868506E-6
New Minimum: -198.04439386684206 > -202.47873901993944
WOLF (strong): th(1.0080000000000002E7)=-202.47873901993944; dx=7.581610980881428E-7 evalInputDelta=4.434345153097382
New Minimum: -202.47873901993944 > -205.1256077421862
END: th(5040000.000000001)=-205.1256077421862; dx=-2.0910166849830252E-7 evalInputDelta=7.081213875344133
Fitness changed from -198.04439386684206 to -205.1256077421862
Iteration 9 complete. Error: -205.1256077421862 Total: 13.3994; Orientation: 1.8041; Line Search: 8.7317
Adding measurement 3ed361d9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.428e+04, gradient 1.663e-03, dot -0.546; [97261819-e654-4e53-9320-8b40d9ece541 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -205.1256077421862, -139.33975875452322, -119.90007550960678, -102.52251015583923
LBFGS Accumulation History: 3 points
Removed measurement 3ed361d9 to history. Total: 3
th(0)=-205.1256077421862;dx=-2.759006355470613E-6
New Minimum: -205.1256077421862 > -207.64989069834016
WOLF (strong): th(1.0858350837760696E7)=-207.64989069834016; dx=8.693692367313421E-7 evalInputDelta=2.524282956153968
New Minimum: -207.64989069834016 > -211.5502659232716
WOLF (strong): th(5429175.418880348)=-211.5502659232716; dx=5.115366243051874E-8 evalInputDelta=6.4246581810854195
END: th(1809725.1396267826)=-209.22688262058276; dx=-1.6297076757093459E-6 evalInputDelta=4.101274878396566
Fitness changed from -205.1256077421862 to -211.5502659232716
Iteration 10 complete. Error: -211.5502659232716 Total: 16.4264; Orientation: 1.8229; Line Search: 11.6844
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -211.5502659232716 (> -Infinity) after 152.926s (< 5400.000s)
Returns
-211.5502659232716