BasicOptimizer.scala:89 executed in 50.40 seconds (0.968 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 137640172467500
Reset training subject: 137641140111699
Adding measurement 1517daf2 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1.3792215367420153;dx=-3.796819045657588E-6
New Minimum: -1.3792215367420153 > -1.3792300309944667
WOLFE (weak): th(2.154434690031884)=-1.3792300309944667; dx=-3.834571794923958E-6 evalInputDelta=8.49425245141866E-6
New Minimum: -1.3792300309944667 > -1.3792383527240564
WOLFE (weak): th(4.308869380063768)=-1.3792383527240564; dx=-3.841506978590554E-6 evalInputDelta=1.6815982041062938E-5
New Minimum: -1.3792383527240564 > -1.3792720271896686
WOLFE (weak): th(12.926608140191302)=-1.3792720271896686; dx=-3.818229091024066E-6 evalInputDelta=5.049044765326194E-5
New Minimum: -1.3792720271896686 > -1.3794233581085815
WOLFE (weak): th(51.70643256076521)=-1.3794233581085815; dx=-3.844915920675545E-6 evalInputDelta=2.0182136656621275E-4
New Minimum: -1.3794233581085815 > -1.380230736245502
WOLFE (weak): th(258.53216280382605)=-1.380230736245502; dx=-3.8162408706160405E-6 evalInputDelta=0.0010091995034866574
New Minimum: -1.380230736245502 > -1.3852708570082506
WOLFE (weak): th(1551.1929768229563)=-1.3852708570082506; dx=-3.848195186755008E-6 evalInputDelta=0.006049320266235281
New Minimum: -1.3852708570082506 > -1.4213873317597168
WOLFE (weak): th(10858.350837760694)=-1.4213873317597168; dx=-3.822400005867892E-6 evalInputDelta=0.04216579501770146
New Minimum: -1.4213873317597168 > -1.6969498847602418
END: th(86866.80670208555)=-1.6969498847602418; dx=-3.4128415321350108E-6 evalInputDelta=0.31772834801822647
Fitness changed from -1.3792215367420153 to -1.6969498847602418
Iteration 1 complete. Error: -1.6969498847602418 Total: 14.3555; Orientation: 0.0258; Line Search: 10.5477
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 251b597d to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1.6969498847602418;dx=-3.90128279597857E-6
New Minimum: -1.6969498847602418 > -2.3338366816600624
END: th(187148.86177126726)=-2.3338366816600624; dx=-2.89169904418971E-6 evalInputDelta=0.6368867968998206
Fitness changed from -1.6969498847602418 to -2.3338366816600624
Iteration 2 complete. Error: -2.3338366816600624 Total: 2.7917; Orientation: 0.0174; Line Search: 1.7674
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 30c20c20 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-2.3338366816600624;dx=-4.048291220688139E-6
New Minimum: -2.3338366816600624 > -3.367825422522623
END: th(403200.00000000006)=-3.367825422522623; dx=-1.790998537675308E-6 evalInputDelta=1.0339887408625605
Fitness changed from -2.3338366816600624 to -3.367825422522623
Iteration 3 complete. Error: -3.367825422522623 Total: 3.0081; Orientation: 0.0154; Line Search: 2.0562
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5edfbab7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.583e+04, gradient 2.419e-03, dot -0.306; [04d46c71-c5f2-44f6-87f4-bced8ab601ed = 1.000/1.000e+00]
Orientation rejected. Popping history element from -3.367825422522623, -2.3338366816600624, -1.6969498847602418, -1.3792215367420153
LBFGS Accumulation History: 3 points
Removed measurement 5edfbab7 to history. Total: 3
th(0)=-3.367825422522623;dx=-5.834020538549419E-6
New Minimum: -3.367825422522623 > -4.281941199475302
END: th(868668.0670208557)=-4.281941199475302; dx=-5.198985966981901E-7 evalInputDelta=0.9141157769526789
Fitness changed from -3.367825422522623 to -4.281941199475302
Iteration 4 complete. Error: -4.281941199475302 Total: 3.0790; Orientation: 0.3079; Line Search: 1.7855
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2ea90765 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.189e+04, gradient 2.538e-03, dot -0.189; [04d46c71-c5f2-44f6-87f4-bced8ab601ed = 1.000/1.000e+00]
Orientation rejected. Popping history element from -4.281941199475302, -2.3338366816600624, -1.6969498847602418, -1.3792215367420153
LBFGS Accumulation History: 3 points
Removed measurement 2ea90765 to history. Total: 3
th(0)=-4.281941199475302;dx=-6.4030126862442055E-6
New Minimum: -4.281941199475302 > -4.773581125655492
WOLF (strong): th(1871488.617712673)=-4.773581125655492; dx=5.988925181365183E-8 evalInputDelta=0.4916399261801905
New Minimum: -4.773581125655492 > -5.616593272566111
END: th(935744.3088563365)=-5.616593272566111; dx=-2.2353581650885556E-7 evalInputDelta=1.3346520730908091
Fitness changed from -4.281941199475302 to -5.616593272566111
Iteration 5 complete. Error: -5.616593272566111 Total: 3.8713; Orientation: 0.2862; Line Search: 2.6491
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 676a9630 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.286e+04, gradient 2.497e-03, dot -0.169; [04d46c71-c5f2-44f6-87f4-bced8ab601ed = 1.000/1.000e+00]
Orientation rejected. Popping history element from -5.616593272566111, -2.3338366816600624, -1.6969498847602418, -1.3792215367420153
LBFGS Accumulation History: 3 points
Removed measurement 676a9630 to history. Total: 3
th(0)=-5.616593272566111;dx=-6.163041051581744E-6
New Minimum: -5.616593272566111 > -6.2460428858221375
WOLF (strong): th(2016000.0000000007)=-6.2460428858221375; dx=2.5594017522446056E-7 evalInputDelta=0.6294496132560266
New Minimum: -6.2460428858221375 > -7.2734668244423775
END: th(1008000.0000000003)=-7.2734668244423775; dx=-1.2771519266087277E-7 evalInputDelta=1.6568735518762665
Fitness changed from -5.616593272566111 to -7.2734668244423775
Iteration 6 complete. Error: -7.2734668244423775 Total: 3.8773; Orientation: 0.3044; Line Search: 2.6125
Adding measurement 3a9a6d98 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.703e+04, gradient 2.433e-03, dot -0.174; [04d46c71-c5f2-44f6-87f4-bced8ab601ed = 1.000/1.000e+00]
Orientation rejected. Popping history element from -7.2734668244423775, -2.3338366816600624, -1.6969498847602418, -1.3792215367420153
LBFGS Accumulation History: 3 points
Removed measurement 3a9a6d98 to history. Total: 3
th(0)=-7.2734668244423775;dx=-5.894942802451381E-6
New Minimum: -7.2734668244423775 > -7.314428576552721
WOLF (strong): th(2171670.1675521396)=-7.314428576552721; dx=5.092769223212693E-7 evalInputDelta=0.04096175211034314
New Minimum: -7.314428576552721 > -8.85317218313363
WOLF (strong): th(1085835.0837760698)=-8.85317218313363; dx=1.5347131685371505E-7 evalInputDelta=1.5797053586912524
END: th(361945.0279253566)=-8.809308359045717; dx=-2.5911566551162204E-6 evalInputDelta=1.5358415346033398
Fitness changed from -7.2734668244423775 to -8.85317218313363
Iteration 7 complete. Error: -8.85317218313363 Total: 4.9206; Orientation: 0.2740; Line Search: 3.5544
Adding measurement 35f65a37 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.990e+04, gradient 2.530e-03, dot -0.158; [04d46c71-c5f2-44f6-87f4-bced8ab601ed = 1.000/1.000e+00]
Orientation rejected. Popping history element from -8.85317218313363, -2.3338366816600624, -1.6969498847602418, -1.3792215367420153
LBFGS Accumulation History: 3 points
Removed measurement 35f65a37 to history. Total: 3
th(0)=-8.85317218313363;dx=-6.378009193473487E-6
New Minimum: -8.85317218313363 > -10.524753033079659
END: th(779786.9240469472)=-10.524753033079659; dx=-1.8074149847939182E-7 evalInputDelta=1.6715808499460287
Fitness changed from -8.85317218313363 to -10.524753033079659
Iteration 8 complete. Error: -10.524753033079659 Total: 5.7087; Orientation: 0.3809; Line Search: 4.4516
Adding measurement e91bf01 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.941e+04, gradient 2.174e-03, dot -0.193; [04d46c71-c5f2-44f6-87f4-bced8ab601ed = 1.000/1.000e+00]
Orientation rejected. Popping history element from -10.524753033079659, -2.3338366816600624, -1.6969498847602418, -1.3792215367420153
LBFGS Accumulation History: 3 points
Removed measurement e91bf01 to history. Total: 3
th(0)=-10.524753033079659;dx=-4.699840086911697E-6
New Minimum: -10.524753033079659 > -10.749161921809806
WOLF (strong): th(1680000.0000000007)=-10.749161921809806; dx=6.790582433375183E-7 evalInputDelta=0.22440888873014764
New Minimum: -10.749161921809806 > -11.890083078932355
END: th(840000.0000000003)=-11.890083078932355; dx=-1.2458118404709334E-7 evalInputDelta=1.365330045852696
Fitness changed from -10.524753033079659 to -11.890083078932355
Iteration 9 complete. Error: -11.890083078932355 Total: 3.8072; Orientation: 0.3039; Line Search: 2.6459
Adding measurement 5e377ad3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.472e+04, gradient 2.177e-03, dot -0.216; [04d46c71-c5f2-44f6-87f4-bced8ab601ed = 1.000/1.000e+00]
Orientation rejected. Popping history element from -11.890083078932355, -2.3338366816600624, -1.6969498847602418, -1.3792215367420153
LBFGS Accumulation History: 3 points
Removed measurement 5e377ad3 to history. Total: 3
th(0)=-11.890083078932355;dx=-4.721687780169561E-6
Armijo: th(1809725.139626783)=-11.325089050560564; dx=6.825155889000132E-7 evalInputDelta=-0.5649940283717907
New Minimum: -11.890083078932355 > -12.76674926275915
WOLF (strong): th(904862.5698133915)=-12.76674926275915; dx=3.2498286682433533E-7 evalInputDelta=0.8766661838267957
New Minimum: -12.76674926275915 > -12.847985421408968
END: th(301620.8566044638)=-12.847985421408968; dx=-2.0322454379292317E-6 evalInputDelta=0.9579023424766131
Fitness changed from -11.890083078932355 to -12.847985421408968
Iteration 10 complete. Error: -12.847985421408968 Total: 4.8629; Orientation: 0.4244; Line Search: 3.5975
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -12.847985421408968 (> -Infinity) after 50.404s (< 5400.000s)
Returns
-12.847985421408968