BasicOptimizer.scala:89 executed in 128.10 seconds (1.270 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 28558006363600
Reset training subject: 28560668506600
Adding measurement 216bd6cd to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-75.5053727086301;dx=-4.888891245937462E-6
New Minimum: -75.5053727086301 > -75.50538403858441
END: th(2.154434690031884)=-75.50538403858441; dx=-3.872799461231566E-6 evalInputDelta=1.1329954304528655E-5
Fitness changed from -75.5053727086301 to -75.50538403858441
Iteration 1 complete. Error: -75.50538403858441 Total: 12.6182; Orientation: 0.0651; Line Search: 5.0429
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5944fbf0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-75.50538403858441;dx=-3.83876048167216E-6
New Minimum: -75.50538403858441 > -75.50540216650778
WOLFE (weak): th(4.641588833612779)=-75.50540216650778; dx=-3.838726542998221E-6 evalInputDelta=1.812792336863822E-5
New Minimum: -75.50540216650778 > -75.50542482640586
WOLFE (weak): th(9.283177667225559)=-75.50542482640586; dx=-3.839133575851485E-6 evalInputDelta=4.078782144745219E-5
New Minimum: -75.50542482640586 > -75.50550640198266
WOLFE (weak): th(27.849533001676676)=-75.50550640198266; dx=-3.8374402112878025E-6 evalInputDelta=1.2236339824767128E-4
New Minimum: -75.50550640198266 > -75.50587349098758
WOLFE (weak): th(111.3981320067067)=-75.50587349098758; dx=-3.838242525153829E-6 evalInputDelta=4.894524031726633E-4
New Minimum: -75.50587349098758 > -75.50783126887328
WOLFE (weak): th(556.9906600335335)=-75.50783126887328; dx=-3.836590202053733E-6 evalInputDelta=0.0024472302888653985
New Minimum: -75.50783126887328 > -75.52007302742909
WOLFE (weak): th(3341.9439602012008)=-75.52007302742909; dx=-3.836041088895596E-6 evalInputDelta=0.014688988844682171
New Minimum: -75.52007302742909 > -75.6079501583682
WOLFE (weak): th(23393.607721408407)=-75.6079501583682; dx=-3.810754507903111E-6 evalInputDelta=0.10256611978378771
New Minimum: -75.6079501583682 > -76.29437662469057
WOLFE (weak): th(187148.86177126726)=-76.29437662469057; dx=-3.5206334934495298E-6 evalInputDelta=0.7889925861061613
New Minimum: -76.29437662469057 > -80.76972406410076
END: th(1684339.7559414054)=-80.76972406410076; dx=-1.7758025462160278E-6 evalInputDelta=5.264340025516347
Fitness changed from -75.50538403858441 to -80.76972406410076
Iteration 2 complete. Error: -80.76972406410076 Total: 28.3971; Orientation: 0.0654; Line Search: 25.3423
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 5736cc4e to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-80.76972406410076;dx=-1.8444616644425173E-6
New Minimum: -80.76972406410076 > -86.68594591467735
END: th(3628800.0000000005)=-86.68594591467735; dx=-1.123888240408312E-6 evalInputDelta=5.916221850576591
Fitness changed from -80.76972406410076 to -86.68594591467735
Iteration 3 complete. Error: -86.68594591467735 Total: 7.9146; Orientation: 0.0602; Line Search: 4.9795
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 37b98741 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.612e+03, gradient 1.188e-03, dot -0.715; [674043c0-ce5d-4b21-a75e-ce11c078edc8 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.68594591467735, -80.76972406410076, -75.50538403858441, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 37b98741 to history. Total: 3
th(0)=-86.68594591467735;dx=-1.4113400921284967E-6
New Minimum: -86.68594591467735 > -93.66075241305676
END: th(7818012.603187701)=-93.66075241305676; dx=-4.0971563381424126E-7 evalInputDelta=6.974806498379408
Fitness changed from -86.68594591467735 to -93.66075241305676
Iteration 4 complete. Error: -93.66075241305676 Total: 9.1073; Orientation: 1.0990; Line Search: 5.0838
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5022aaa3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.934e+03, gradient 1.481e-03, dot -0.376; [674043c0-ce5d-4b21-a75e-ce11c078edc8 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.66075241305676, -80.76972406410076, -75.50538403858441, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 5022aaa3 to history. Total: 3
th(0)=-93.66075241305676;dx=-2.1922414381523797E-6
Armijo: th(1.6843397559414055E7)=-86.38687598816095; dx=7.818826899640733E-7 evalInputDelta=-7.273876424895803
New Minimum: -93.66075241305676 > -94.82856350987228
WOLF (strong): th(8421698.779707028)=-94.82856350987228; dx=8.613006448034086E-7 evalInputDelta=1.1678110968155266
New Minimum: -94.82856350987228 > -97.9375770609576
END: th(2807232.926569009)=-97.9375770609576; dx=-4.5110021400998926E-7 evalInputDelta=4.276824647900838
Fitness changed from -93.66075241305676 to -97.9375770609576
Iteration 5 complete. Error: -97.9375770609576 Total: 13.9109; Orientation: 1.0795; Line Search: 9.9963
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement b4b22af to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.926e+04, gradient 1.025e-03, dot -0.679; [674043c0-ce5d-4b21-a75e-ce11c078edc8 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.9375770609576, -80.76972406410076, -75.50538403858441, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement b4b22af to history. Total: 3
th(0)=-97.9375770609576;dx=-1.0503395053286898E-6
New Minimum: -97.9375770609576 > -101.93435116160505
END: th(6048000.000000001)=-101.93435116160505; dx=-2.3564578665499558E-7 evalInputDelta=3.996774100647457
Fitness changed from -97.9375770609576 to -101.93435116160505
Iteration 6 complete. Error: -101.93435116160505 Total: 9.2763; Orientation: 1.1103; Line Search: 5.2320
Adding measurement 4d310fe6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.078e+04, gradient 1.298e-03, dot -0.479; [674043c0-ce5d-4b21-a75e-ce11c078edc8 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -101.93435116160505, -80.76972406410076, -75.50538403858441, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 4d310fe6 to history. Total: 3
th(0)=-101.93435116160505;dx=-1.6841120109673434E-6
Armijo: th(1.3030021005312836E7)=-98.38586606474512; dx=7.555941054656068E-7 evalInputDelta=-3.5484850968599346
New Minimum: -101.93435116160505 > -103.98275464934922
WOLF (strong): th(6515010.502656418)=-103.98275464934922; dx=5.839296009093809E-7 evalInputDelta=2.0484034877441673
New Minimum: -103.98275464934922 > -104.78996399379962
END: th(2171670.167552139)=-104.78996399379962; dx=-6.007395265500253E-7 evalInputDelta=2.8556128321945664
Fitness changed from -101.93435116160505 to -104.78996399379962
Iteration 7 complete. Error: -104.78996399379962 Total: 13.9765; Orientation: 1.1749; Line Search: 10.4076
Adding measurement 44c3fef4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.903e+04, gradient 8.555e-04, dot -0.798; [674043c0-ce5d-4b21-a75e-ce11c078edc8 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.78996399379962, -80.76972406410076, -75.50538403858441, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 44c3fef4 to history. Total: 3
th(0)=-104.78996399379962;dx=-7.30425193983152E-7
New Minimum: -104.78996399379962 > -108.0703817744138
END: th(4678721.544281682)=-108.0703817744138; dx=-5.349833491905654E-7 evalInputDelta=3.2804177806141865
Fitness changed from -104.78996399379962 to -108.0703817744138
Iteration 8 complete. Error: -108.0703817744138 Total: 8.8565; Orientation: 1.1642; Line Search: 5.2592
Adding measurement 726986d2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.299e+04, gradient 8.779e-04, dot -0.754; [674043c0-ce5d-4b21-a75e-ce11c078edc8 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -108.0703817744138, -80.76972406410076, -75.50538403858441, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 726986d2 to history. Total: 3
th(0)=-108.0703817744138;dx=-7.69870544420704E-7
New Minimum: -108.0703817744138 > -112.59095845018788
END: th(1.0080000000000002E7)=-112.59095845018788; dx=-1.896808694117166E-7 evalInputDelta=4.52057667577408
Fitness changed from -108.0703817744138 to -112.59095845018788
Iteration 9 complete. Error: -112.59095845018788 Total: 8.8715; Orientation: 1.1185; Line Search: 5.3697
Adding measurement 7462f6a0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.135e+04, gradient 1.294e-03, dot -0.415; [674043c0-ce5d-4b21-a75e-ce11c078edc8 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -112.59095845018788, -80.76972406410076, -75.50538403858441, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 7462f6a0 to history. Total: 3
th(0)=-112.59095845018788;dx=-1.6741577843881772E-6
Armijo: th(2.1716701675521392E7)=-98.93720283133517; dx=8.375418272646347E-7 evalInputDelta=-13.653755618852713
Armijo: th(1.0858350837760696E7)=-110.93291987452382; dx=9.525807049907448E-7 evalInputDelta=-1.6580385756640652
New Minimum: -112.59095845018788 > -116.46286280069268
END: th(3619450.2792535652)=-116.46286280069268; dx=-1.4705183759866537E-7 evalInputDelta=3.871904350504792
Fitness changed from -112.59095845018788 to -116.46286280069268
Iteration 10 complete. Error: -116.46286280069268 Total: 14.7072; Orientation: 1.4887; Line Search: 10.6331
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -116.46286280069268 (> -Infinity) after 128.101s (< 5400.000s)
Returns
-116.46286280069268