BasicOptimizer.scala:89 executed in 217.12 seconds (3.200 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 684690211651000
Reset training subject: 684694820339700
Adding measurement 6379dd72 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-983.9681143207843;dx=-0.006170329263290369
New Minimum: -983.9681143207843 > -983.9816436295954
WOLFE (weak): th(2.154434690031884)=-983.9816436295954; dx=-0.0057234498362653645 evalInputDelta=0.013529308811143892
New Minimum: -983.9816436295954 > -983.995172752387
WOLFE (weak): th(4.308869380063768)=-983.995172752387; dx=-0.00572271198270255 evalInputDelta=0.027058431602767996
New Minimum: -983.995172752387 > -984.0492873835132
WOLFE (weak): th(12.926608140191302)=-984.0492873835132; dx=-0.005723494081034325 evalInputDelta=0.08117306272890801
New Minimum: -984.0492873835132 > -984.2927664064183
WOLFE (weak): th(51.70643256076521)=-984.2927664064183; dx=-0.005722288958611239 evalInputDelta=0.3246520856340567
New Minimum: -984.2927664064183 > -985.5899248673355
WOLFE (weak): th(258.53216280382605)=-985.5899248673355; dx=-0.0057134014072272084 evalInputDelta=1.6218105465512735
New Minimum: -985.5899248673355 > -993.6536116776308
WOLFE (weak): th(1551.1929768229563)=-993.6536116776308; dx=-0.005655326446459328 evalInputDelta=9.685497356846554
New Minimum: -993.6536116776308 > -1048.865220130785
END: th(10858.350837760694)=-1048.865220130785; dx=-0.005134264505492543 evalInputDelta=64.89710581000077
Fitness changed from -983.9681143207843 to -1048.865220130785
Iteration 1 complete. Error: -1048.865220130785 Total: 50.8154; Orientation: 0.0976; Line Search: 37.2849
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 515fc40f to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1048.865220130785;dx=-0.004863617005200312
New Minimum: -1048.865220130785 > -1162.0382954102674
END: th(23393.607721408407)=-1162.0382954102674; dx=-0.003927351253024279 evalInputDelta=113.17307527948242
Fitness changed from -1048.865220130785 to -1162.0382954102674
Iteration 2 complete. Error: -1162.0382954102674 Total: 14.6853; Orientation: 0.0999; Line Search: 8.9790
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 49b4520e to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1162.0382954102674;dx=-0.0037035957223324136
New Minimum: -1162.0382954102674 > -1334.4178037631243
END: th(50400.00000000001)=-1334.4178037631243; dx=-0.0025366158231548514 evalInputDelta=172.37950835285687
Fitness changed from -1162.0382954102674 to -1334.4178037631243
Iteration 3 complete. Error: -1334.4178037631243 Total: 14.6845; Orientation: 0.0940; Line Search: 8.9949
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 59852a6b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.328e+04, gradient 5.153e-02, dot -0.840; [208d17f0-3592-433c-a007-5407947a4372 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1334.4178037631243, -1162.0382954102674, -1048.865220130785, -983.9681143207843
LBFGS Accumulation History: 3 points
Removed measurement 59852a6b to history. Total: 3
th(0)=-1334.4178037631243;dx=-0.0026527284115075824
New Minimum: -1334.4178037631243 > -1559.1353372943606
END: th(108583.50837760697)=-1559.1353372943606; dx=-0.0013605606492442524 evalInputDelta=224.7175335312363
Fitness changed from -1334.4178037631243 to -1559.1353372943606
Iteration 4 complete. Error: -1559.1353372943606 Total: 16.1145; Orientation: 1.7278; Line Search: 8.9173
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 20f33597 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.293e+04, gradient 5.120e-02, dot -0.611; [208d17f0-3592-433c-a007-5407947a4372 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1559.1353372943606, -1162.0382954102674, -1048.865220130785, -983.9681143207843
LBFGS Accumulation History: 3 points
Removed measurement 20f33597 to history. Total: 3
th(0)=-1559.1353372943606;dx=-0.002620830610923789
New Minimum: -1559.1353372943606 > -1782.2547517119992
END: th(233936.07721408413)=-1782.2547517119992; dx=-3.847796865796975E-4 evalInputDelta=223.1194144176386
Fitness changed from -1559.1353372943606 to -1782.2547517119992
Iteration 5 complete. Error: -1782.2547517119992 Total: 16.1901; Orientation: 1.7647; Line Search: 8.9467
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 741422b6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.297e+04, gradient 5.596e-02, dot -0.354; [208d17f0-3592-433c-a007-5407947a4372 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1782.2547517119992, -1162.0382954102674, -1048.865220130785, -983.9681143207843
LBFGS Accumulation History: 3 points
Removed measurement 741422b6 to history. Total: 3
th(0)=-1782.2547517119992;dx=-0.003125332124581524
New Minimum: -1782.2547517119992 > -1878.2998961827157
WOLF (strong): th(504000.0000000002)=-1878.2998961827157; dx=3.2870808549570555E-4 evalInputDelta=96.04514447071642
New Minimum: -1878.2998961827157 > -1978.3014810690509
WOLF (strong): th(252000.0000000001)=-1978.3014810690509; dx=1.8645447262417245E-4 evalInputDelta=196.04672935705162
END: th(84000.00000000003)=-1955.7168762374579; dx=-9.21066125136868E-4 evalInputDelta=173.46212452545865
Fitness changed from -1782.2547517119992 to -1978.3014810690509
Iteration 6 complete. Error: -1978.3014810690509 Total: 24.9881; Orientation: 1.6197; Line Search: 18.0740
Adding measurement 35d28318 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.449e+04, gradient 5.855e-02, dot -0.285; [208d17f0-3592-433c-a007-5407947a4372 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1978.3014810690509, -1162.0382954102674, -1048.865220130785, -983.9681143207843
LBFGS Accumulation History: 3 points
Removed measurement 35d28318 to history. Total: 3
th(0)=-1978.3014810690509;dx=-0.0034250958475078586
New Minimum: -1978.3014810690509 > -2234.160021126508
WOLF (strong): th(180972.5139626783)=-2234.160021126508; dx=1.7971632728821613E-4 evalInputDelta=255.85854005745728
END: th(90486.25698133915)=-2202.065621183892; dx=-0.0011195458247381532 evalInputDelta=223.76414011484098
Fitness changed from -1978.3014810690509 to -2234.160021126508
Iteration 7 complete. Error: -2234.160021126508 Total: 19.5488; Orientation: 1.6198; Line Search: 13.4563
Adding measurement 97bcef1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.246e+04, gradient 5.508e-02, dot -0.319; [208d17f0-3592-433c-a007-5407947a4372 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2234.160021126508, -1162.0382954102674, -1048.865220130785, -983.9681143207843
LBFGS Accumulation History: 3 points
Removed measurement 97bcef1 to history. Total: 3
th(0)=-2234.160021126508;dx=-0.0030314459943831095
New Minimum: -2234.160021126508 > -2405.086484931467
WOLF (strong): th(194946.7310117368)=-2405.086484931467; dx=5.021783627283681E-4 evalInputDelta=170.92646380495898
New Minimum: -2405.086484931467 > -2414.949481873275
END: th(97473.3655058684)=-2414.949481873275; dx=-6.028793714963519E-4 evalInputDelta=180.78946074676696
Fitness changed from -2234.160021126508 to -2414.949481873275
Iteration 8 complete. Error: -2414.949481873275 Total: 19.8703; Orientation: 1.6088; Line Search: 13.6197
Adding measurement 378440d2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.334e+04, gradient 4.373e-02, dot -0.445; [208d17f0-3592-433c-a007-5407947a4372 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2414.949481873275, -1162.0382954102674, -1048.865220130785, -983.9681143207843
LBFGS Accumulation History: 3 points
Removed measurement 378440d2 to history. Total: 3
th(0)=-2414.949481873275;dx=-0.001907456410512589
New Minimum: -2414.949481873275 > -2554.1124681579704
END: th(210000.0000000001)=-2554.1124681579704; dx=-3.891021553938989E-5 evalInputDelta=139.1629862846953
Fitness changed from -2414.949481873275 to -2554.1124681579704
Iteration 9 complete. Error: -2554.1124681579704 Total: 15.3942; Orientation: 1.5958; Line Search: 9.2269
Adding measurement 7a4429c7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.585e+04, gradient 5.589e-02, dot -0.325; [208d17f0-3592-433c-a007-5407947a4372 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2554.1124681579704, -1162.0382954102674, -1048.865220130785, -983.9681143207843
LBFGS Accumulation History: 3 points
Removed measurement 7a4429c7 to history. Total: 3
th(0)=-2554.1124681579704;dx=-0.0031203661625556255
Armijo: th(452431.2849066958)=-2413.4282670094008; dx=7.407722691689703E-4 evalInputDelta=-140.68420114856963
New Minimum: -2554.1124681579704 > -2632.6152396428915
WOLF (strong): th(226215.6424533479)=-2632.6152396428915; dx=7.350759134784301E-4 evalInputDelta=78.50277148492114
New Minimum: -2632.6152396428915 > -2699.498657158399
END: th(75405.21415111596)=-2699.498657158399; dx=-5.747347740557892E-4 evalInputDelta=145.38618900042866
Fitness changed from -2554.1124681579704 to -2699.498657158399
Iteration 10 complete. Error: -2699.498657158399 Total: 23.9968; Orientation: 1.6093; Line Search: 18.1107
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2699.498657158399 (> -Infinity) after 217.119s (< 5400.000s)
Returns
-2699.498657158399