BasicOptimizer.scala:89 executed in 133.91 seconds (1.706 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 333922329040500
Reset training subject: 333924986500700
Adding measurement 506b5aa0 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-127.63459160970702;dx=-2.95705864529173E-5
New Minimum: -127.63459160970702 > -127.63464450637437
END: th(2.154434690031884)=-127.63464450637437; dx=-2.1857033627209877E-5 evalInputDelta=5.289666735563969E-5
Fitness changed from -127.63459160970702 to -127.63464450637437
Iteration 1 complete. Error: -127.63464450637437 Total: 12.6293; Orientation: 0.0604; Line Search: 4.9772
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement b7daacc to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-127.63464450637437;dx=-2.1753470279072168E-5
New Minimum: -127.63464450637437 > -127.63476541296032
WOLFE (weak): th(4.641588833612779)=-127.63476541296032; dx=-2.1744653629185086E-5 evalInputDelta=1.2090658594843262E-4
New Minimum: -127.63476541296032 > -127.63487120612906
WOLFE (weak): th(9.283177667225559)=-127.63487120612906; dx=-2.173939858305069E-5 evalInputDelta=2.266997546911398E-4
New Minimum: -127.63487120612906 > -127.6353246044305
WOLFE (weak): th(27.849533001676676)=-127.6353246044305; dx=-2.1729868614475582E-5 evalInputDelta=6.800980561223469E-4
New Minimum: -127.6353246044305 > -127.63737243335993
WOLFE (weak): th(111.3981320067067)=-127.63737243335993; dx=-2.1716650839902568E-5 evalInputDelta=0.0027279269855569055
New Minimum: -127.63737243335993 > -127.64826844660995
WOLFE (weak): th(556.9906600335335)=-127.64826844660995; dx=-2.1712236667405276E-5 evalInputDelta=0.01362394023557556
New Minimum: -127.64826844660995 > -127.71632858895212
WOLFE (weak): th(3341.9439602012008)=-127.71632858895212; dx=-2.1693247906798114E-5 evalInputDelta=0.08168408257775184
New Minimum: -127.71632858895212 > -128.20433208026486
WOLFE (weak): th(23393.607721408407)=-128.20433208026486; dx=-2.152730182874417E-5 evalInputDelta=0.5696875738904907
New Minimum: -128.20433208026486 > -132.02720946354353
WOLFE (weak): th(187148.86177126726)=-132.02720946354353; dx=-1.9876517966738095E-5 evalInputDelta=4.3925649571691565
New Minimum: -132.02720946354353 > -151.99404055921383
END: th(1684339.7559414054)=-151.99404055921383; dx=-5.4321750283125584E-6 evalInputDelta=24.359396052839458
Fitness changed from -127.63464450637437 to -151.99404055921383
Iteration 2 complete. Error: -151.99404055921383 Total: 28.7883; Orientation: 0.0589; Line Search: 25.8098
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 53f258c2 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-151.99404055921383;dx=-9.877275308057639E-6
New Minimum: -151.99404055921383 > -169.21698148185308
END: th(3628800.0000000005)=-169.21698148185308; dx=-7.166205067465993E-7 evalInputDelta=17.222940922639253
Fitness changed from -151.99404055921383 to -169.21698148185308
Iteration 3 complete. Error: -169.21698148185308 Total: 8.5141; Orientation: 0.0647; Line Search: 5.2886
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4ca1c466 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.532e+03, gradient 3.168e-03, dot -0.322; [23f42809-5a35-43fe-864f-dc1d3ac83c84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -169.21698148185308, -151.99404055921383, -127.63464450637437, -127.63459160970702
LBFGS Accumulation History: 3 points
Removed measurement 4ca1c466 to history. Total: 3
th(0)=-169.21698148185308;dx=-1.0024741810181128E-5
Armijo: th(7818012.603187701)=-165.03721734367562; dx=3.436858900929577E-6 evalInputDelta=-4.179764138177461
New Minimum: -169.21698148185308 > -179.250976140676
WOLF (strong): th(3909006.3015938504)=-179.250976140676; dx=2.00736483798347E-6 evalInputDelta=10.033994658822905
END: th(1303002.1005312835)=-178.97525170349243; dx=-3.771834826241233E-6 evalInputDelta=9.75827022163935
Fitness changed from -169.21698148185308 to -179.250976140676
Iteration 4 complete. Error: -179.250976140676 Total: 14.4310; Orientation: 1.0620; Line Search: 10.2538
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4660d590 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.433e+03, gradient 3.288e-03, dot -0.202; [23f42809-5a35-43fe-864f-dc1d3ac83c84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -179.250976140676, -151.99404055921383, -127.63464450637437, -127.63459160970702
LBFGS Accumulation History: 3 points
Removed measurement 4660d590 to history. Total: 3
th(0)=-179.250976140676;dx=-1.0804118379900838E-5
New Minimum: -179.250976140676 > -193.73745307499212
WOLF (strong): th(2807232.926569009)=-193.73745307499212; dx=8.112457997765742E-7 evalInputDelta=14.48647693431613
END: th(1403616.4632845046)=-191.3108141539544; dx=-4.480579324317317E-6 evalInputDelta=12.059838013278409
Fitness changed from -179.250976140676 to -193.73745307499212
Iteration 5 complete. Error: -193.73745307499212 Total: 12.0472; Orientation: 1.0291; Line Search: 7.9284
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4696d4dc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.165e+04, gradient 2.533e-03, dot -0.347; [23f42809-5a35-43fe-864f-dc1d3ac83c84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -193.73745307499212, -151.99404055921383, -127.63464450637437, -127.63459160970702
LBFGS Accumulation History: 3 points
Removed measurement 4696d4dc to history. Total: 3
th(0)=-193.73745307499212;dx=-6.4021134950685855E-6
New Minimum: -193.73745307499212 > -202.4339928336598
WOLF (strong): th(3024000.0000000005)=-202.4339928336598; dx=4.859730179722214E-7 evalInputDelta=8.696539758667683
END: th(1512000.0000000002)=-201.11348938799802; dx=-2.5368827116340354E-6 evalInputDelta=7.376036313005898
Fitness changed from -193.73745307499212 to -202.4339928336598
Iteration 6 complete. Error: -202.4339928336598 Total: 11.7869; Orientation: 1.0805; Line Search: 7.8590
Adding measurement 75516709 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.718e+04, gradient 2.414e-03, dot -0.400; [23f42809-5a35-43fe-864f-dc1d3ac83c84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.4339928336598, -151.99404055921383, -127.63464450637437, -127.63459160970702
LBFGS Accumulation History: 3 points
Removed measurement 75516709 to history. Total: 3
th(0)=-202.4339928336598;dx=-5.824476204838935E-6
New Minimum: -202.4339928336598 > -208.85405387028666
WOLF (strong): th(3257505.251328209)=-208.85405387028666; dx=1.3637529443027401E-6 evalInputDelta=6.420061036626862
New Minimum: -208.85405387028666 > -209.09578741095083
END: th(1628752.6256641045)=-209.09578741095083; dx=-1.7004534780353944E-6 evalInputDelta=6.661794577291033
Fitness changed from -202.4339928336598 to -209.09578741095083
Iteration 7 complete. Error: -209.09578741095083 Total: 11.4081; Orientation: 0.9694; Line Search: 7.6852
Adding measurement 1b4a55bb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.222e+04, gradient 1.660e-03, dot -0.640; [23f42809-5a35-43fe-864f-dc1d3ac83c84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -209.09578741095083, -151.99404055921383, -127.63464450637437, -127.63459160970702
LBFGS Accumulation History: 3 points
Removed measurement 1b4a55bb to history. Total: 3
th(0)=-209.09578741095083;dx=-2.7488404875889342E-6
New Minimum: -209.09578741095083 > -215.91366570722096
END: th(3509041.158211262)=-215.91366570722096; dx=-1.1195627581907946E-6 evalInputDelta=6.817878296270123
Fitness changed from -209.09578741095083 to -215.91366570722096
Iteration 8 complete. Error: -215.91366570722096 Total: 8.6449; Orientation: 0.9943; Line Search: 5.1381
Adding measurement 4fcd34dc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.300e+04, gradient 1.885e-03, dot -0.505; [23f42809-5a35-43fe-864f-dc1d3ac83c84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -215.91366570722096, -151.99404055921383, -127.63464450637437, -127.63459160970702
LBFGS Accumulation History: 3 points
Removed measurement 4fcd34dc to history. Total: 3
th(0)=-215.91366570722096;dx=-3.5448864175226396E-6
Armijo: th(7560000.000000003)=-215.21011512015798; dx=1.4112949220587629E-6 evalInputDelta=-0.7035505870629777
New Minimum: -215.91366570722096 > -220.1859303351416
WOLF (strong): th(3780000.0000000014)=-220.1859303351416; dx=3.942356342007907E-7 evalInputDelta=4.272264627920634
END: th(1260000.0000000005)=-219.38306333357806; dx=-1.6277327302050108E-6 evalInputDelta=3.4693976263571074
Fitness changed from -215.91366570722096 to -220.1859303351416
Iteration 9 complete. Error: -220.1859303351416 Total: 13.8312; Orientation: 0.9893; Line Search: 10.1564
Adding measurement 51ecdcb7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.093e+04, gradient 2.303e-03, dot -0.346; [23f42809-5a35-43fe-864f-dc1d3ac83c84 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -220.1859303351416, -151.99404055921383, -127.63464450637437, -127.63459160970702
LBFGS Accumulation History: 3 points
Removed measurement 51ecdcb7 to history. Total: 3
th(0)=-220.1859303351416;dx=-5.298959249962502E-6
New Minimum: -220.1859303351416 > -226.24490855964336
WOLF (strong): th(2714587.7094401745)=-226.24490855964336; dx=8.925664021693516E-7 evalInputDelta=6.058978224501772
END: th(1357293.8547200873)=-225.69675013383866; dx=-2.052044753340758E-6 evalInputDelta=5.510819798697071
Fitness changed from -220.1859303351416 to -226.24490855964336
Iteration 10 complete. Error: -226.24490855964336 Total: 11.3820; Orientation: 1.0333; Line Search: 7.9375
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -226.24490855964336 (> -Infinity) after 133.915s (< 5400.000s)
Returns
-226.24490855964336