BasicOptimizer.scala:89 executed in 125.76 seconds (1.339 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 25909557908000
Reset training subject: 25912144105400
Adding measurement 6fcbb7ae to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-75.58520668715724;dx=-4.815525416831001E-6
New Minimum: -75.58520668715724 > -75.58521574154736
END: th(2.154434690031884)=-75.58521574154736; dx=-3.7694374001045633E-6 evalInputDelta=9.054390119445088E-6
Fitness changed from -75.58520668715724 to -75.58521574154736
Iteration 1 complete. Error: -75.58521574154736 Total: 12.6773; Orientation: 0.0617; Line Search: 5.1396
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 750fae53 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-75.58521574154736;dx=-3.7348732352084044E-6
New Minimum: -75.58521574154736 > -75.58523611392117
WOLFE (weak): th(4.641588833612779)=-75.58523611392117; dx=-3.7335824053725646E-6 evalInputDelta=2.037237381102841E-5
New Minimum: -75.58523611392117 > -75.5852564862895
WOLFE (weak): th(9.283177667225559)=-75.5852564862895; dx=-3.735360068513103E-6 evalInputDelta=4.07447421366669E-5
New Minimum: -75.5852564862895 > -75.58533344852026
WOLFE (weak): th(27.849533001676676)=-75.58533344852026; dx=-3.734715966697128E-6 evalInputDelta=1.1770697290103271E-4
New Minimum: -75.58533344852026 > -75.5856888319224
WOLFE (weak): th(111.3981320067067)=-75.5856888319224; dx=-3.7340315610736455E-6 evalInputDelta=4.730903750385096E-4
New Minimum: -75.5856888319224 > -75.58758795439196
WOLFE (weak): th(556.9906600335335)=-75.58758795439196; dx=-3.734180880692535E-6 evalInputDelta=0.002372212844605315
New Minimum: -75.58758795439196 > -75.59945921791589
WOLFE (weak): th(3341.9439602012008)=-75.59945921791589; dx=-3.7316078228571175E-6 evalInputDelta=0.014243476368534402
New Minimum: -75.59945921791589 > -75.68466032890811
WOLFE (weak): th(23393.607721408407)=-75.68466032890811; dx=-3.709939145385306E-6 evalInputDelta=0.09944458736075035
New Minimum: -75.68466032890811 > -76.35140148159073
WOLFE (weak): th(187148.86177126726)=-76.35140148159073; dx=-3.432819365051592E-6 evalInputDelta=0.7661857400433689
New Minimum: -76.35140148159073 > -80.7265966741337
END: th(1684339.7559414054)=-80.7265966741337; dx=-1.755794576865578E-6 evalInputDelta=5.141380932586344
Fitness changed from -75.58521574154736 to -80.7265966741337
Iteration 2 complete. Error: -80.7265966741337 Total: 27.9922; Orientation: 0.0544; Line Search: 24.9644
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 77db4bfd to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-80.7265966741337;dx=-1.8100485585480938E-6
New Minimum: -80.7265966741337 > -86.5330682293367
END: th(3628800.0000000005)=-86.5330682293367; dx=-1.0986233483645115E-6 evalInputDelta=5.806471555203004
Fitness changed from -80.7265966741337 to -86.5330682293367
Iteration 3 complete. Error: -86.5330682293367 Total: 8.0660; Orientation: 0.0625; Line Search: 5.1689
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 342ca509 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.550e+03, gradient 1.181e-03, dot -0.709; [48a7f2dc-4abd-47d6-91fe-a4fab41493a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.5330682293367, -80.7265966741337, -75.58521574154736, -75.58520668715724
LBFGS Accumulation History: 3 points
Removed measurement 342ca509 to history. Total: 3
th(0)=-86.5330682293367;dx=-1.3934941916553605E-6
New Minimum: -86.5330682293367 > -93.26557154432331
END: th(7818012.603187701)=-93.26557154432331; dx=-3.8493223051495245E-7 evalInputDelta=6.732503314986602
Fitness changed from -86.5330682293367 to -93.26557154432331
Iteration 4 complete. Error: -93.26557154432331 Total: 9.0203; Orientation: 1.0710; Line Search: 5.1130
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2afcc6a7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.494e+03, gradient 1.471e-03, dot -0.366; [48a7f2dc-4abd-47d6-91fe-a4fab41493a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.26557154432331, -80.7265966741337, -75.58521574154736, -75.58520668715724
LBFGS Accumulation History: 3 points
Removed measurement 2afcc6a7 to history. Total: 3
th(0)=-93.26557154432331;dx=-2.1623673574647E-6
Armijo: th(1.6843397559414055E7)=-86.66298051853165; dx=7.489065909596536E-7 evalInputDelta=-6.602591025791654
New Minimum: -93.26557154432331 > -94.65005253011452
WOLF (strong): th(8421698.779707028)=-94.65005253011452; dx=8.237329333358676E-7 evalInputDelta=1.384480985791214
New Minimum: -94.65005253011452 > -97.51495242244587
END: th(2807232.926569009)=-97.51495242244587; dx=-4.6651657357246667E-7 evalInputDelta=4.249380878122565
Fitness changed from -93.26557154432331 to -97.51495242244587
Iteration 5 complete. Error: -97.51495242244587 Total: 13.7975; Orientation: 1.0651; Line Search: 9.9232
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 420c730b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.903e+04, gradient 1.016e-03, dot -0.676; [48a7f2dc-4abd-47d6-91fe-a4fab41493a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.51495242244587, -80.7265966741337, -75.58521574154736, -75.58520668715724
LBFGS Accumulation History: 3 points
Removed measurement 420c730b to history. Total: 3
th(0)=-97.51495242244587;dx=-1.0322818399549879E-6
New Minimum: -97.51495242244587 > -101.41195951496344
END: th(6048000.000000001)=-101.41195951496344; dx=-2.198315318305616E-7 evalInputDelta=3.897007092517569
Fitness changed from -97.51495242244587 to -101.41195951496344
Iteration 6 complete. Error: -101.41195951496344 Total: 9.0583; Orientation: 1.0622; Line Search: 5.0800
Adding measurement 47c21023 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.004e+04, gradient 1.290e-03, dot -0.471; [48a7f2dc-4abd-47d6-91fe-a4fab41493a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -101.41195951496344, -80.7265966741337, -75.58521574154736, -75.58520668715724
LBFGS Accumulation History: 3 points
Removed measurement 47c21023 to history. Total: 3
th(0)=-101.41195951496344;dx=-1.6620088527475437E-6
Armijo: th(1.3030021005312836E7)=-97.89065954450021; dx=7.34964166565523E-7 evalInputDelta=-3.5212999704632324
New Minimum: -101.41195951496344 > -103.3630193478993
WOLF (strong): th(6515010.502656418)=-103.3630193478993; dx=5.882711949050214E-7 evalInputDelta=1.9510598329358544
New Minimum: -103.3630193478993 > -104.2239588853737
END: th(2171670.167552139)=-104.2239588853737; dx=-5.815417965874612E-7 evalInputDelta=2.8119993704102626
Fitness changed from -101.41195951496344 to -104.2239588853737
Iteration 7 complete. Error: -104.2239588853737 Total: 13.7084; Orientation: 1.0776; Line Search: 10.2346
Adding measurement 52f387a8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.854e+04, gradient 8.427e-04, dot -0.800; [48a7f2dc-4abd-47d6-91fe-a4fab41493a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.2239588853737, -80.7265966741337, -75.58521574154736, -75.58520668715724
LBFGS Accumulation History: 3 points
Removed measurement 52f387a8 to history. Total: 3
th(0)=-104.2239588853737;dx=-7.095694290212059E-7
New Minimum: -104.2239588853737 > -107.41452706431848
END: th(4678721.544281682)=-107.41452706431848; dx=-5.231079119417075E-7 evalInputDelta=3.1905681789447726
Fitness changed from -104.2239588853737 to -107.41452706431848
Iteration 8 complete. Error: -107.41452706431848 Total: 8.5683; Orientation: 1.0094; Line Search: 4.9443
Adding measurement 3b0b1ee8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.235e+04, gradient 8.692e-04, dot -0.750; [48a7f2dc-4abd-47d6-91fe-a4fab41493a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -107.41452706431848, -80.7265966741337, -75.58521574154736, -75.58520668715724
LBFGS Accumulation History: 3 points
Removed measurement 3b0b1ee8 to history. Total: 3
th(0)=-107.41452706431848;dx=-7.553067816128842E-7
New Minimum: -107.41452706431848 > -111.78096712774874
END: th(1.0080000000000002E7)=-111.78096712774874; dx=-1.754555665231232E-7 evalInputDelta=4.366440063430261
Fitness changed from -107.41452706431848 to -111.78096712774874
Iteration 9 complete. Error: -111.78096712774874 Total: 8.7043; Orientation: 1.0079; Line Search: 5.0507
Adding measurement 5ff48a61 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.046e+04, gradient 1.295e-03, dot -0.407; [48a7f2dc-4abd-47d6-91fe-a4fab41493a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -111.78096712774874, -80.7265966741337, -75.58521574154736, -75.58520668715724
LBFGS Accumulation History: 3 points
Removed measurement 5ff48a61 to history. Total: 3
th(0)=-111.78096712774874;dx=-1.6757400753189965E-6
Armijo: th(2.1716701675521392E7)=-98.508807173831; dx=8.118087248471545E-7 evalInputDelta=-13.272159953917736
Armijo: th(1.0858350837760696E7)=-110.14527200431992; dx=9.479589408329598E-7 evalInputDelta=-1.6356951234288175
New Minimum: -111.78096712774874 > -115.64046514013786
END: th(3619450.2792535652)=-115.64046514013786; dx=-1.3542950561489398E-7 evalInputDelta=3.8594980123891247
Fitness changed from -111.78096712774874 to -115.64046514013786
Iteration 10 complete. Error: -115.64046514013786 Total: 13.6905; Orientation: 1.0338; Line Search: 10.1893
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -115.64046514013786 (> -Infinity) after 125.758s (< 5400.000s)
Returns
-115.64046514013786