BasicOptimizer.scala:89 executed in 113.21 seconds (1.713 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 42901850744000
Reset training subject: 42904228750300
Adding measurement 540858fb to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-29.68669015918737;dx=-1.963927090893853E-6
New Minimum: -29.68669015918737 > -29.6866945779316
WOLFE (weak): th(2.154434690031884)=-29.6866945779316; dx=-1.7956194347063541E-6 evalInputDelta=4.418744229184313E-6
New Minimum: -29.6866945779316 > -29.686697523760717
WOLFE (weak): th(4.308869380063768)=-29.686697523760717; dx=-1.7952446795239104E-6 evalInputDelta=7.364573345824965E-6
New Minimum: -29.686697523760717 > -29.686713725815647
WOLFE (weak): th(12.926608140191302)=-29.686713725815647; dx=-1.7941033713538613E-6 evalInputDelta=2.3566628275517587E-5
New Minimum: -29.686713725815647 > -29.686791790138184
WOLFE (weak): th(51.70643256076521)=-29.686791790138184; dx=-1.7959645835154202E-6 evalInputDelta=1.0163095081239248E-4
New Minimum: -29.686791790138184 > -29.687196837572525
WOLFE (weak): th(258.53216280382605)=-29.687196837572525; dx=-1.7942749570870341E-6 evalInputDelta=5.066783851539469E-4
New Minimum: -29.687196837572525 > -29.68973893637829
WOLFE (weak): th(1551.1929768229563)=-29.68973893637829; dx=-1.7953652200484768E-6 evalInputDelta=0.0030487771909193384
New Minimum: -29.68973893637829 > -29.708027972761723
WOLFE (weak): th(10858.350837760694)=-29.708027972761723; dx=-1.7952579317786375E-6 evalInputDelta=0.021337813574351827
New Minimum: -29.708027972761723 > -29.85710774384491
WOLFE (weak): th(86866.80670208555)=-29.85710774384491; dx=-1.7863117182808068E-6 evalInputDelta=0.17041758465753887
New Minimum: -29.85710774384491 > -31.175568029360832
END: th(781801.26031877)=-31.175568029360832; dx=-1.679104319744553E-6 evalInputDelta=1.4888778701734608
Fitness changed from -29.68669015918737 to -31.175568029360832
Iteration 1 complete. Error: -31.175568029360832 Total: 29.7535; Orientation: 0.0619; Line Search: 22.7936
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 95364b5 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-31.175568029360832;dx=-1.6450438927152728E-6
New Minimum: -31.175568029360832 > -34.013034286668415
END: th(1684339.7559414052)=-34.013034286668415; dx=-1.4330909676415733E-6 evalInputDelta=2.8374662573075824
Fitness changed from -31.175568029360832 to -34.013034286668415
Iteration 2 complete. Error: -34.013034286668415 Total: 7.0895; Orientation: 0.0616; Line Search: 4.3835
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7516f4a3 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-34.013034286668415;dx=-1.3931324004988995E-6
New Minimum: -34.013034286668415 > -38.8528082520479
END: th(3628800.0)=-38.8528082520479; dx=-1.0545445162485454E-6 evalInputDelta=4.839773965379486
Fitness changed from -34.013034286668415 to -38.8528082520479
Iteration 3 complete. Error: -38.8528082520479 Total: 7.5337; Orientation: 0.0614; Line Search: 4.6285
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2dc74fd0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.140e+04, gradient 1.029e-03, dot -0.867; [4ad4171b-0b91-4f97-8551-cd3529002f8f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -38.8528082520479, -34.013034286668415, -31.175568029360832, -29.68669015918737
LBFGS Accumulation History: 3 points
Removed measurement 2dc74fd0 to history. Total: 3
th(0)=-38.8528082520479;dx=-1.0558239261477851E-6
New Minimum: -38.8528082520479 > -46.109230096831816
END: th(7818012.6031877)=-46.109230096831816; dx=-6.680595139836663E-7 evalInputDelta=7.256421844783915
Fitness changed from -38.8528082520479 to -46.109230096831816
Iteration 4 complete. Error: -46.109230096831816 Total: 8.1897; Orientation: 1.0745; Line Search: 4.5784
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 1c20dd05 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.106e+04, gradient 8.858e-04, dot -0.696; [4ad4171b-0b91-4f97-8551-cd3529002f8f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.109230096831816, -34.013034286668415, -31.175568029360832, -29.68669015918737
LBFGS Accumulation History: 3 points
Removed measurement 1c20dd05 to history. Total: 3
th(0)=-46.109230096831816;dx=-7.843724144596345E-7
New Minimum: -46.109230096831816 > -55.64888949631878
END: th(1.684339755941405E7)=-55.64888949631878; dx=-3.438566471396038E-7 evalInputDelta=9.539659399486965
Fitness changed from -46.109230096831816 to -55.64888949631878
Iteration 5 complete. Error: -55.64888949631878 Total: 8.4467; Orientation: 1.0444; Line Search: 4.7176
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7950e7c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.561e+04, gradient 8.507e-04, dot -0.510; [4ad4171b-0b91-4f97-8551-cd3529002f8f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -55.64888949631878, -34.013034286668415, -31.175568029360832, -29.68669015918737
LBFGS Accumulation History: 3 points
Removed measurement 7950e7c to history. Total: 3
th(0)=-55.64888949631878;dx=-7.233669259194851E-7
New Minimum: -55.64888949631878 > -63.24933645093324
END: th(3.6288E7)=-63.24933645093324; dx=-1.4251062414066927E-8 evalInputDelta=7.600446954614462
Fitness changed from -55.64888949631878 to -63.24933645093324
Iteration 6 complete. Error: -63.24933645093324 Total: 8.3005; Orientation: 1.0111; Line Search: 4.6320
Adding measurement 78bbc890 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.211e+04, gradient 1.038e-03, dot -0.260; [4ad4171b-0b91-4f97-8551-cd3529002f8f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.24933645093324, -34.013034286668415, -31.175568029360832, -29.68669015918737
LBFGS Accumulation History: 3 points
Removed measurement 78bbc890 to history. Total: 3
th(0)=-63.24933645093324;dx=-1.0768986813904491E-6
Armijo: th(7.8180126031877E7)=-57.82599214614431; dx=1.938457718625029E-7 evalInputDelta=-5.423344304788934
New Minimum: -63.24933645093324 > -69.05458973030649
WOLF (strong): th(3.90900630159385E7)=-69.05458973030649; dx=2.685275511827889E-7 evalInputDelta=5.805253279373247
New Minimum: -69.05458973030649 > -72.59604803526469
END: th(1.3030021005312832E7)=-72.59604803526469; dx=-2.6908335369849827E-7 evalInputDelta=9.346711584331445
Fitness changed from -63.24933645093324 to -72.59604803526469
Iteration 7 complete. Error: -72.59604803526469 Total: 12.5593; Orientation: 1.0526; Line Search: 9.4020
Adding measurement 77b631f4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.692e+04, gradient 6.765e-04, dot -0.436; [4ad4171b-0b91-4f97-8551-cd3529002f8f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.59604803526469, -34.013034286668415, -31.175568029360832, -29.68669015918737
LBFGS Accumulation History: 3 points
Removed measurement 77b631f4 to history. Total: 3
th(0)=-72.59604803526469;dx=-4.571837691037604E-7
New Minimum: -72.59604803526469 > -79.7413084420018
END: th(2.807232926569009E7)=-79.7413084420018; dx=-7.456749408855691E-8 evalInputDelta=7.145260406737108
Fitness changed from -72.59604803526469 to -79.7413084420018
Iteration 8 complete. Error: -79.7413084420018 Total: 8.2572; Orientation: 1.0029; Line Search: 4.8462
Adding measurement 4a7da234 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.804e+04, gradient 7.409e-04, dot -0.387; [4ad4171b-0b91-4f97-8551-cd3529002f8f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -79.7413084420018, -34.013034286668415, -31.175568029360832, -29.68669015918737
LBFGS Accumulation History: 3 points
Removed measurement 4a7da234 to history. Total: 3
th(0)=-79.7413084420018;dx=-5.487397166110067E-7
Armijo: th(6.048000000000001E7)=-78.67642209162355; dx=1.5321478991763408E-7 evalInputDelta=-1.064886350378245
New Minimum: -79.7413084420018 > -84.08727215409752
WOLF (strong): th(3.0240000000000004E7)=-84.08727215409752; dx=1.0364787497052836E-7 evalInputDelta=4.345963712095724
END: th(1.0080000000000002E7)=-83.91100055850191; dx=-2.3367691159042392E-7 evalInputDelta=4.169692116500116
Fitness changed from -79.7413084420018 to -84.08727215409752
Iteration 9 complete. Error: -84.08727215409752 Total: 12.4530; Orientation: 1.0174; Line Search: 9.2078
Adding measurement 7216158d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.200e+04, gradient 8.188e-04, dot -0.288; [4ad4171b-0b91-4f97-8551-cd3529002f8f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -84.08727215409752, -34.013034286668415, -31.175568029360832, -29.68669015918737
LBFGS Accumulation History: 3 points
Removed measurement 7216158d to history. Total: 3
th(0)=-84.08727215409752;dx=-6.695576851605207E-7
New Minimum: -84.08727215409752 > -91.0161814393236
WOLF (strong): th(2.1716701675521392E7)=-91.0161814393236; dx=4.907655465228982E-8 evalInputDelta=6.928909285226084
END: th(1.0858350837760696E7)=-89.80942278197288; dx=-2.9977600257969813E-7 evalInputDelta=5.722150627875365
Fitness changed from -84.08727215409752 to -91.0161814393236
Iteration 10 complete. Error: -91.0161814393236 Total: 10.2223; Orientation: 0.9914; Line Search: 6.8160
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -91.0161814393236 (> -Infinity) after 113.208s (< 5400.000s)
Returns
-91.0161814393236