BasicOptimizer.scala:89 executed in 152.04 seconds (2.181 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 458971319987200
Reset training subject: 458974198035300
Adding measurement 12c2f9e0 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-102.73799174985652;dx=-1.4889520076528734E-5
New Minimum: -102.73799174985652 > -102.73801338358484
END: th(2.154434690031884)=-102.73801338358484; dx=-1.1892137182769793E-5 evalInputDelta=2.1633728323422474E-5
Fitness changed from -102.73799174985652 to -102.73801338358484
Iteration 1 complete. Error: -102.73801338358484 Total: 14.4192; Orientation: 0.1131; Line Search: 5.6904
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4f125fb to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-102.73801338358484;dx=-1.1925170962369138E-5
New Minimum: -102.73801338358484 > -102.73807828474253
WOLFE (weak): th(4.641588833612779)=-102.73807828474253; dx=-1.1891850685289721E-5 evalInputDelta=6.490115768542637E-5
New Minimum: -102.73807828474253 > -102.73813236900926
WOLFE (weak): th(9.283177667225559)=-102.73813236900926; dx=-1.1901437651772221E-5 evalInputDelta=1.1898542442168036E-4
New Minimum: -102.73813236900926 > -102.73836493103181
WOLFE (weak): th(27.849533001676676)=-102.73836493103181; dx=-1.1855558630840009E-5 evalInputDelta=3.5154744696797025E-4
New Minimum: -102.73836493103181 > -102.73940874943973
WOLFE (weak): th(111.3981320067067)=-102.73940874943973; dx=-1.1882362799766985E-5 evalInputDelta=0.0013953658548899739
New Minimum: -102.73940874943973 > -102.7449846152921
WOLFE (weak): th(556.9906600335335)=-102.7449846152921; dx=-1.1879427530880248E-5 evalInputDelta=0.006971231707254333
New Minimum: -102.7449846152921 > -102.77980665012099
WOLFE (weak): th(3341.9439602012008)=-102.77980665012099; dx=-1.186773967339727E-5 evalInputDelta=0.041793266536146234
New Minimum: -102.77980665012099 > -103.029962153157
WOLFE (weak): th(23393.607721408407)=-103.029962153157; dx=-1.1820472595635693E-5 evalInputDelta=0.29194876957215854
New Minimum: -103.029962153157 > -105.03255870085579
WOLFE (weak): th(187148.86177126726)=-105.03255870085579; dx=-1.1401746629749681E-5 evalInputDelta=2.294545317270945
New Minimum: -105.03255870085579 > -119.70783942455633
END: th(1684339.7559414054)=-119.70783942455633; dx=-7.333810544072203E-6 evalInputDelta=16.969826040971483
Fitness changed from -102.73801338358484 to -119.70783942455633
Iteration 2 complete. Error: -119.70783942455633 Total: 32.7608; Orientation: 0.1075; Line Search: 29.1232
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 26b12ba3 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-119.70783942455633;dx=-7.669642577336065E-6
New Minimum: -119.70783942455633 > -138.8939653738028
END: th(3628800.0000000005)=-138.8939653738028; dx=-3.2722187755972393E-6 evalInputDelta=19.186125949246488
Fitness changed from -119.70783942455633 to -138.8939653738028
Iteration 3 complete. Error: -138.8939653738028 Total: 9.3776; Orientation: 0.0972; Line Search: 5.6746
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 73251a8b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.003e+04, gradient 2.245e-03, dot -0.529; [5d981c10-8bce-4db4-a551-6e402de8af9c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -138.8939653738028, -119.70783942455633, -102.73801338358484, -102.73799174985652
LBFGS Accumulation History: 3 points
Removed measurement 73251a8b to history. Total: 3
th(0)=-138.8939653738028;dx=-5.035567884176711E-6
New Minimum: -138.8939653738028 > -157.05991718640084
END: th(7818012.603187701)=-157.05991718640084; dx=-7.664210076187532E-7 evalInputDelta=18.165951812598024
Fitness changed from -138.8939653738028 to -157.05991718640084
Iteration 4 complete. Error: -157.05991718640084 Total: 11.2030; Orientation: 1.9911; Line Search: 5.7906
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4b97d259 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.045e+04, gradient 2.471e-03, dot -0.286; [5d981c10-8bce-4db4-a551-6e402de8af9c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -157.05991718640084, -119.70783942455633, -102.73801338358484, -102.73799174985652
LBFGS Accumulation History: 3 points
Removed measurement 4b97d259 to history. Total: 3
th(0)=-157.05991718640084;dx=-6.105039969053313E-6
Armijo: th(1.6843397559414055E7)=-153.81569447791827; dx=1.556183874195883E-6 evalInputDelta=-3.2442227084825674
New Minimum: -157.05991718640084 > -168.87984087801607
WOLF (strong): th(8421698.779707028)=-168.87984087801607; dx=1.0840104438561394E-6 evalInputDelta=11.81992369161523
New Minimum: -168.87984087801607 > -169.19172220525664
END: th(2807232.926569009)=-169.19172220525664; dx=-2.2881039803040617E-6 evalInputDelta=12.1318050188558
Fitness changed from -157.05991718640084 to -169.19172220525664
Iteration 5 complete. Error: -169.19172220525664 Total: 17.2212; Orientation: 1.8944; Line Search: 11.6750
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 43c473a5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.985e+04, gradient 1.756e-03, dot -0.556; [5d981c10-8bce-4db4-a551-6e402de8af9c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -169.19172220525664, -119.70783942455633, -102.73801338358484, -102.73799174985652
LBFGS Accumulation History: 3 points
Removed measurement 43c473a5 to history. Total: 3
th(0)=-169.19172220525664;dx=-3.079056646489047E-6
New Minimum: -169.19172220525664 > -180.64171881372155
END: th(6048000.000000001)=-180.64171881372155; dx=-1.0420970174451067E-6 evalInputDelta=11.449996608464915
Fitness changed from -169.19172220525664 to -180.64171881372155
Iteration 6 complete. Error: -180.64171881372155 Total: 11.8665; Orientation: 1.8730; Line Search: 6.0757
Adding measurement 3a49eccf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.436e+04, gradient 1.897e-03, dot -0.471; [5d981c10-8bce-4db4-a551-6e402de8af9c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -180.64171881372155, -119.70783942455633, -102.73801338358484, -102.73799174985652
LBFGS Accumulation History: 3 points
Removed measurement 3a49eccf to history. Total: 3
th(0)=-180.64171881372155;dx=-3.5970246529146047E-6
New Minimum: -180.64171881372155 > -185.25264348449807
WOLF (strong): th(1.3030021005312836E7)=-185.25264348449807; dx=6.866895824202389E-7 evalInputDelta=4.610924670776512
New Minimum: -185.25264348449807 > -189.30028276307917
WOLF (strong): th(6515010.502656418)=-189.30028276307917; dx=9.70932237187899E-9 evalInputDelta=8.658563949357614
END: th(2171670.167552139)=-186.61901980228907; dx=-1.8015756031945456E-6 evalInputDelta=5.977300988567521
Fitness changed from -180.64171881372155 to -189.30028276307917
Iteration 7 complete. Error: -189.30028276307917 Total: 16.9150; Orientation: 1.9824; Line Search: 12.1014
Adding measurement 762853d7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.675e+04, gradient 2.083e-03, dot -0.380; [5d981c10-8bce-4db4-a551-6e402de8af9c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -189.30028276307917, -119.70783942455633, -102.73801338358484, -102.73799174985652
LBFGS Accumulation History: 3 points
Removed measurement 762853d7 to history. Total: 3
th(0)=-189.30028276307917;dx=-4.323408750649538E-6
New Minimum: -189.30028276307917 > -199.77958697103472
END: th(4678721.544281682)=-199.77958697103472; dx=-1.984237362974434E-7 evalInputDelta=10.47930420795555
Fitness changed from -189.30028276307917 to -199.77958697103472
Iteration 8 complete. Error: -199.77958697103472 Total: 10.4512; Orientation: 1.8480; Line Search: 5.7549
Adding measurement 1aed95f9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.461e+04, gradient 1.702e-03, dot -0.493; [5d981c10-8bce-4db4-a551-6e402de8af9c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -199.77958697103472, -119.70783942455633, -102.73801338358484, -102.73799174985652
LBFGS Accumulation History: 3 points
Removed measurement 1aed95f9 to history. Total: 3
th(0)=-199.77958697103472;dx=-2.8947588296064534E-6
New Minimum: -199.77958697103472 > -205.29081268135394
WOLF (strong): th(1.0080000000000002E7)=-205.29081268135394; dx=5.933763880635975E-7 evalInputDelta=5.5112257103192235
New Minimum: -205.29081268135394 > -207.1867207625345
END: th(5040000.000000001)=-207.1867207625345; dx=-3.309253483515008E-7 evalInputDelta=7.407133791499774
Fitness changed from -199.77958697103472 to -207.1867207625345
Iteration 9 complete. Error: -207.1867207625345 Total: 13.1638; Orientation: 1.8699; Line Search: 8.5224
Adding measurement 6fb49ce2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.860e+04, gradient 1.670e-03, dot -0.489; [5d981c10-8bce-4db4-a551-6e402de8af9c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -207.1867207625345, -119.70783942455633, -102.73801338358484, -102.73799174985652
LBFGS Accumulation History: 3 points
Removed measurement 6fb49ce2 to history. Total: 3
th(0)=-207.1867207625345;dx=-2.7888625056393328E-6
New Minimum: -207.1867207625345 > -210.78490688616938
WOLF (strong): th(1.0858350837760696E7)=-210.78490688616938; dx=7.212595133410474E-7 evalInputDelta=3.598186123634889
New Minimum: -210.78490688616938 > -213.9425616372117
END: th(5429175.418880348)=-213.9425616372117; dx=-5.94022139553849E-8 evalInputDelta=6.7558408746772045
Fitness changed from -207.1867207625345 to -213.9425616372117
Iteration 10 complete. Error: -213.9425616372117 Total: 14.0339; Orientation: 1.8239; Line Search: 9.1132
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -213.9425616372117 (> -Infinity) after 152.043s (< 5400.000s)
Returns
-213.9425616372117