BasicOptimizer.scala:89 executed in 239.99 seconds (2.575 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 5058895621830
Reset training subject: 5064254278389
Adding measurement 6e6d5f71 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-14.365770936012268;dx=-2.2419370777974512E-6
New Minimum: -14.365770936012268 > -14.365777164697647
WOLFE (weak): th(2.154434690031884)=-14.365777164697647; dx=-2.1379993833045923E-6 evalInputDelta=6.22868537902832E-6
New Minimum: -14.365777164697647 > -14.365782648324966
WOLFE (weak): th(4.308869380063768)=-14.365782648324966; dx=-2.137630979529971E-6 evalInputDelta=1.1712312698364258E-5
New Minimum: -14.365782648324966 > -14.365804746747017
WOLFE (weak): th(12.926608140191302)=-14.365804746747017; dx=-2.137619211938873E-6 evalInputDelta=3.381073474884033E-5
New Minimum: -14.365804746747017 > -14.365905433893204
WOLFE (weak): th(51.70643256076521)=-14.365905433893204; dx=-2.1375871346013025E-6 evalInputDelta=1.3449788093566895E-4
New Minimum: -14.365905433893204 > -14.36644259095192
WOLFE (weak): th(258.53216280382605)=-14.36644259095192; dx=-2.136673219527885E-6 evalInputDelta=6.716549396514893E-4
New Minimum: -14.36644259095192 > -14.369792968034744
WOLFE (weak): th(1551.1929768229563)=-14.369792968034744; dx=-2.1312854919168367E-6 evalInputDelta=0.004022032022476196
New Minimum: -14.369792968034744 > -14.393677443265915
WOLFE (weak): th(10858.350837760694)=-14.393677443265915; dx=-2.0935994459544576E-6 evalInputDelta=0.02790650725364685
New Minimum: -14.393677443265915 > -14.571131855249405
END: th(86866.80670208555)=-14.571131855249405; dx=-1.7401055340156191E-6 evalInputDelta=0.20536091923713684
Fitness changed from -14.365770936012268 to -14.571131855249405
Iteration 1 complete. Error: -14.571131855249405 Total: 61.8574; Orientation: 0.0304; Line Search: 46.4107
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 592db51c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-14.571131855249405;dx=-1.598668887632822E-6
New Minimum: -14.571131855249405 > -14.886260986328125
END: th(187148.86177126726)=-14.886260986328125; dx=-1.2025113273633022E-6 evalInputDelta=0.3151291310787201
Fitness changed from -14.571131855249405 to -14.886260986328125
Iteration 2 complete. Error: -14.886260986328125 Total: 15.2233; Orientation: 0.0298; Line Search: 9.9705
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7360cb0e to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-14.886260986328125;dx=-1.1924801531774315E-6
New Minimum: -14.886260986328125 > -15.333436846733093
END: th(403200.00000000006)=-15.333436846733093; dx=-7.295846913163202E-7 evalInputDelta=0.44717586040496826
Fitness changed from -14.886260986328125 to -15.333436846733093
Iteration 3 complete. Error: -15.333436846733093 Total: 15.5520; Orientation: 0.0299; Line Search: 9.7575
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7552c2c5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.583e+03, gradient 1.066e-03, dot -0.768; [dfcef351-d688-4fcf-ab73-1fd24d71d2f3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -15.333436846733093, -14.886260986328125, -14.571131855249405, -14.365770936012268
LBFGS Accumulation History: 3 points
Removed measurement 7552c2c5 to history. Total: 3
th(0)=-15.333436846733093;dx=-1.1360326730334653E-6
New Minimum: -15.333436846733093 > -15.86421087384224
END: th(868668.0670208557)=-15.86421087384224; dx=-3.454514149073536E-7 evalInputDelta=0.5307740271091461
Fitness changed from -15.333436846733093 to -15.86421087384224
Iteration 4 complete. Error: -15.86421087384224 Total: 16.0256; Orientation: 0.6087; Line Search: 10.2377
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 686b47a2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.264e+03, gradient 1.069e-03, dot -0.564; [dfcef351-d688-4fcf-ab73-1fd24d71d2f3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -15.86421087384224, -14.886260986328125, -14.571131855249405, -14.365770936012268
LBFGS Accumulation History: 3 points
Removed measurement 686b47a2 to history. Total: 3
th(0)=-15.86421087384224;dx=-1.142206470677299E-6
New Minimum: -15.86421087384224 > -16.252267003059387
WOLF (strong): th(1871488.617712673)=-16.252267003059387; dx=1.1455741481688425E-8 evalInputDelta=0.3880561292171478
New Minimum: -16.252267003059387 > -16.29132130742073
END: th(935744.3088563365)=-16.29132130742073; dx=-1.9066226805508943E-8 evalInputDelta=0.4271104335784912
Fitness changed from -15.86421087384224 to -16.29132130742073
Iteration 5 complete. Error: -16.29132130742073 Total: 20.8465; Orientation: 0.6031; Line Search: 15.0835
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2a5b1c6f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.750e+03, gradient 1.086e-03, dot -0.446; [dfcef351-d688-4fcf-ab73-1fd24d71d2f3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.29132130742073, -14.886260986328125, -14.571131855249405, -14.365770936012268
LBFGS Accumulation History: 3 points
Removed measurement 2a5b1c6f to history. Total: 3
th(0)=-16.29132130742073;dx=-1.1792090067675456E-6
New Minimum: -16.29132130742073 > -16.40528655052185
WOLF (strong): th(2016000.0000000007)=-16.40528655052185; dx=1.9507775912450105E-7 evalInputDelta=0.11396524310112
New Minimum: -16.40528655052185 > -16.714546531438828
WOLF (strong): th(1008000.0000000003)=-16.714546531438828; dx=1.7792247242240542E-7 evalInputDelta=0.4232252240180969
END: th(336000.0000000001)=-16.642764568328857; dx=-5.459372640302562E-7 evalInputDelta=0.35144326090812683
Fitness changed from -16.29132130742073 to -16.714546531438828
Iteration 6 complete. Error: -16.714546531438828 Total: 26.5064; Orientation: 0.6176; Line Search: 20.0542
Adding measurement 76db8d08 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.829e+03, gradient 1.018e-03, dot -0.427; [dfcef351-d688-4fcf-ab73-1fd24d71d2f3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.714546531438828, -14.886260986328125, -14.571131855249405, -14.365770936012268
LBFGS Accumulation History: 3 points
Removed measurement 76db8d08 to history. Total: 3
th(0)=-16.714546531438828;dx=-1.0352418773998362E-6
New Minimum: -16.714546531438828 > -17.14379420876503
END: th(723890.0558507132)=-17.14379420876503; dx=-2.8834045853593647E-8 evalInputDelta=0.4292476773262024
Fitness changed from -16.714546531438828 to -17.14379420876503
Iteration 7 complete. Error: -17.14379420876503 Total: 16.1984; Orientation: 0.6135; Line Search: 10.5780
Adding measurement 549252e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.273e+03, gradient 7.279e-04, dot -0.563; [dfcef351-d688-4fcf-ab73-1fd24d71d2f3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -17.14379420876503, -14.886260986328125, -14.571131855249405, -14.365770936012268
LBFGS Accumulation History: 3 points
Removed measurement 549252e to history. Total: 3
th(0)=-17.14379420876503;dx=-5.293734463896536E-7
New Minimum: -17.14379420876503 > -17.377345234155655
WOLF (strong): th(1559573.8480938943)=-17.377345234155655; dx=9.664387476505647E-8 evalInputDelta=0.233551025390625
New Minimum: -17.377345234155655 > -17.419590801000595
END: th(779786.9240469472)=-17.419590801000595; dx=-8.376981488995468E-8 evalInputDelta=0.2757965922355652
Fitness changed from -17.14379420876503 to -17.419590801000595
Iteration 8 complete. Error: -17.419590801000595 Total: 21.3867; Orientation: 0.6011; Line Search: 15.6015
Adding measurement 4e67875e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.461e+03, gradient 6.561e-04, dot -0.603; [dfcef351-d688-4fcf-ab73-1fd24d71d2f3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -17.419590801000595, -14.886260986328125, -14.571131855249405, -14.365770936012268
LBFGS Accumulation History: 3 points
Removed measurement 4e67875e to history. Total: 3
th(0)=-17.419590801000595;dx=-4.3010193021518547E-7
New Minimum: -17.419590801000595 > -17.589418947696686
WOLF (strong): th(1680000.0000000007)=-17.589418947696686; dx=5.985472773996239E-8 evalInputDelta=0.1698281466960907
New Minimum: -17.589418947696686 > -17.630722016096115
END: th(840000.0000000003)=-17.630722016096115; dx=-3.8192746306131486E-8 evalInputDelta=0.21113121509552002
Fitness changed from -17.419590801000595 to -17.630722016096115
Iteration 9 complete. Error: -17.630722016096115 Total: 20.6593; Orientation: 0.6175; Line Search: 15.1446
Adding measurement 45341ffa to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.607e+03, gradient 6.551e-04, dot -0.570; [dfcef351-d688-4fcf-ab73-1fd24d71d2f3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -17.630722016096115, -14.886260986328125, -14.571131855249405, -14.365770936012268
LBFGS Accumulation History: 3 points
Removed measurement 45341ffa to history. Total: 3
th(0)=-17.630722016096115;dx=-4.2851726046720764E-7
New Minimum: -17.630722016096115 > -17.729647547006607
WOLF (strong): th(1809725.139626783)=-17.729647547006607; dx=8.761818672511338E-8 evalInputDelta=0.09892553091049194
New Minimum: -17.729647547006607 > -17.82692179083824
WOLF (strong): th(904862.5698133915)=-17.82692179083824; dx=2.0713281315006804E-8 evalInputDelta=0.19619977474212646
END: th(301620.8566044638)=-17.758466333150864; dx=-2.719692120736073E-7 evalInputDelta=0.12774431705474854
Fitness changed from -17.630722016096115 to -17.82692179083824
Iteration 10 complete. Error: -17.82692179083824 Total: 25.4569; Orientation: 0.5923; Line Search: 20.0609
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -17.82692179083824 (> -Infinity) after 239.991s (< 5400.000s)
Returns
-17.82692179083824