BasicOptimizer.scala:89 executed in 109.87 seconds (1.425 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 43320148519400
Reset training subject: 43322544655500
Adding measurement 8a85f4c to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-50.85333759182327;dx=-1.691763214597432E-6
New Minimum: -50.85333759182327 > -50.853342750890505
END: th(2.154434690031884)=-50.853342750890505; dx=-1.282573730157894E-6 evalInputDelta=5.159067235638304E-6
Fitness changed from -50.85333759182327 to -50.853342750890505
Iteration 1 complete. Error: -50.853342750890505 Total: 11.5339; Orientation: 0.0624; Line Search: 4.4726
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2d62b516 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-50.853342750890505;dx=-1.269568067163448E-6
New Minimum: -50.853342750890505 > -50.853349629646004
WOLFE (weak): th(4.641588833612779)=-50.853349629646004; dx=-1.2664683279060701E-6 evalInputDelta=6.878755499428735E-6
New Minimum: -50.853349629646004 > -50.85335478871202
WOLFE (weak): th(9.283177667225559)=-50.85335478871202; dx=-1.2648292579142963E-6 evalInputDelta=1.2037821512933533E-5
New Minimum: -50.85335478871202 > -50.853380584034234
WOLFE (weak): th(27.849533001676676)=-50.853380584034234; dx=-1.2631552980644095E-6 evalInputDelta=3.7833143728960295E-5
New Minimum: -50.853380584034234 > -50.853492363612624
WOLFE (weak): th(111.3981320067067)=-50.853492363612624; dx=-1.2626404201222386E-6 evalInputDelta=1.4961272211877485E-4
New Minimum: -50.853492363612624 > -50.85410456740717
WOLFE (weak): th(556.9906600335335)=-50.85410456740717; dx=-1.261451497808479E-6 evalInputDelta=7.618165166647373E-4
New Minimum: -50.85410456740717 > -50.85791863742125
WOLFE (weak): th(3341.9439602012008)=-50.85791863742125; dx=-1.2612034661985733E-6 evalInputDelta=0.0045758865307448104
New Minimum: -50.85791863742125 > -50.88534641067201
WOLFE (weak): th(23393.607721408407)=-50.88534641067201; dx=-1.2615920198419673E-6 evalInputDelta=0.03200365978150188
New Minimum: -50.88534641067201 > -51.10789717285114
WOLFE (weak): th(187148.86177126726)=-51.10789717285114; dx=-1.2447932842666838E-6 evalInputDelta=0.25455442196063416
New Minimum: -51.10789717285114 > -53.00780089720525
END: th(1684339.7559414054)=-53.00780089720525; dx=-1.1022813496829515E-6 evalInputDelta=2.154458146314745
Fitness changed from -50.853342750890505 to -53.00780089720525
Iteration 2 complete. Error: -53.00780089720525 Total: 25.2844; Orientation: 0.0617; Line Search: 22.6997
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 345ffcaf to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-53.00780089720525;dx=-1.106968997103881E-6
New Minimum: -53.00780089720525 > -56.64667525701495
END: th(3628800.0000000005)=-56.64667525701495; dx=-8.14509979731336E-7 evalInputDelta=3.638874359809698
Fitness changed from -53.00780089720525 to -56.64667525701495
Iteration 3 complete. Error: -56.64667525701495 Total: 7.1361; Orientation: 0.0628; Line Search: 4.4446
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 50eb4338 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.518e+04, gradient 8.798e-04, dot -0.885; [6a13e336-1717-4860-9510-ba0db0b94ec9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -56.64667525701495, -53.00780089720525, -50.853342750890505, -50.85333759182327
LBFGS Accumulation History: 3 points
Removed measurement 50eb4338 to history. Total: 3
th(0)=-56.64667525701495;dx=-7.730421766178664E-7
New Minimum: -56.64667525701495 > -62.01364758475203
END: th(7818012.603187701)=-62.01364758475203; dx=-5.251381000885948E-7 evalInputDelta=5.366972327737081
Fitness changed from -56.64667525701495 to -62.01364758475203
Iteration 4 complete. Error: -62.01364758475203 Total: 8.2524; Orientation: 1.0694; Line Search: 4.5696
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement bc32ad6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.358e+04, gradient 7.406e-04, dot -0.764; [6a13e336-1717-4860-9510-ba0db0b94ec9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -62.01364758475203, -53.00780089720525, -50.853342750890505, -50.85333759182327
LBFGS Accumulation History: 3 points
Removed measurement bc32ad6 to history. Total: 3
th(0)=-62.01364758475203;dx=-5.475246039923239E-7
New Minimum: -62.01364758475203 > -69.44359869931112
END: th(1.6843397559414055E7)=-69.44359869931112; dx=-3.1311122691273007E-7 evalInputDelta=7.4299511145590955
Fitness changed from -62.01364758475203 to -69.44359869931112
Iteration 5 complete. Error: -69.44359869931112 Total: 8.1007; Orientation: 1.0580; Line Search: 4.4506
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 384bc35f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.826e+04, gradient 6.825e-04, dot -0.611; [6a13e336-1717-4860-9510-ba0db0b94ec9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.44359869931112, -53.00780089720525, -50.853342750890505, -50.85333759182327
LBFGS Accumulation History: 3 points
Removed measurement 384bc35f to history. Total: 3
th(0)=-69.44359869931112;dx=-4.645032779198294E-7
New Minimum: -69.44359869931112 > -77.38644741400371
END: th(3.628800000000001E7)=-77.38644741400371; dx=-8.077713916275482E-8 evalInputDelta=7.9428487146925875
Fitness changed from -69.44359869931112 to -77.38644741400371
Iteration 6 complete. Error: -77.38644741400371 Total: 8.3577; Orientation: 0.9984; Line Search: 4.4621
Adding measurement e4e9dad to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.922e+04, gradient 8.510e-04, dot -0.283; [6a13e336-1717-4860-9510-ba0db0b94ec9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -77.38644741400371, -53.00780089720525, -50.853342750890505, -50.85333759182327
LBFGS Accumulation History: 3 points
Removed measurement e4e9dad to history. Total: 3
th(0)=-77.38644741400371;dx=-7.236873196390142E-7
Armijo: th(7.818012603187701E7)=-70.65155084754419; dx=1.5830160946496502E-7 evalInputDelta=-6.7348965664595255
New Minimum: -77.38644741400371 > -79.59639980995482
WOLF (strong): th(3.9090063015938506E7)=-79.59639980995482; dx=2.0675602269471724E-7 evalInputDelta=2.209952395951106
New Minimum: -79.59639980995482 > -83.24221619900226
END: th(1.3030021005312836E7)=-83.24221619900226; dx=-1.4382851271591504E-7 evalInputDelta=5.855768784998546
Fitness changed from -77.38644741400371 to -83.24221619900226
Iteration 7 complete. Error: -83.24221619900226 Total: 12.3436; Orientation: 0.9955; Line Search: 8.9559
Adding measurement 3aa9ca3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.241e+04, gradient 5.982e-04, dot -0.519; [6a13e336-1717-4860-9510-ba0db0b94ec9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -83.24221619900226, -53.00780089720525, -50.853342750890505, -50.85333759182327
LBFGS Accumulation History: 3 points
Removed measurement 3aa9ca3 to history. Total: 3
th(0)=-83.24221619900226;dx=-3.5712639258927474E-7
New Minimum: -83.24221619900226 > -87.93239500848084
END: th(2.8072329265690096E7)=-87.93239500848084; dx=-2.980840669021365E-8 evalInputDelta=4.6901788094785815
Fitness changed from -83.24221619900226 to -87.93239500848084
Iteration 8 complete. Error: -87.93239500848084 Total: 8.0569; Orientation: 0.9835; Line Search: 4.6214
Adding measurement 20f44a9d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.494e+04, gradient 7.505e-04, dot -0.352; [6a13e336-1717-4860-9510-ba0db0b94ec9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -87.93239500848084, -53.00780089720525, -50.853342750890505, -50.85333759182327
LBFGS Accumulation History: 3 points
Removed measurement 20f44a9d to history. Total: 3
th(0)=-87.93239500848084;dx=-5.621873284849836E-7
Armijo: th(6.048000000000002E7)=-83.08698603766767; dx=1.6703400491762454E-7 evalInputDelta=-4.845408970813168
New Minimum: -87.93239500848084 > -89.98772638579676
WOLF (strong): th(3.024000000000001E7)=-89.98772638579676; dx=1.8261987395359027E-7 evalInputDelta=2.055331377315923
New Minimum: -89.98772638579676 > -91.83835556654287
END: th(1.0080000000000004E7)=-91.83835556654287; dx=-1.6842238384920372E-7 evalInputDelta=3.9059605580620342
Fitness changed from -87.93239500848084 to -91.83835556654287
Iteration 9 complete. Error: -91.83835556654287 Total: 12.6220; Orientation: 1.1492; Line Search: 9.2817
Adding measurement 135babeb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.636e+04, gradient 4.899e-04, dot -0.608; [6a13e336-1717-4860-9510-ba0db0b94ec9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.83835556654287, -53.00780089720525, -50.853342750890505, -50.85333759182327
LBFGS Accumulation History: 3 points
Removed measurement 135babeb to history. Total: 3
th(0)=-91.83835556654287;dx=-2.396789295480169E-7
New Minimum: -91.83835556654287 > -95.52150368783751
END: th(2.1716701675521396E7)=-95.52150368783751; dx=-1.1558018556039146E-7 evalInputDelta=3.6831481212946358
Fitness changed from -91.83835556654287 to -95.52150368783751
Iteration 10 complete. Error: -95.52150368783751 Total: 7.6652; Orientation: 1.0279; Line Search: 4.5153
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -95.52150368783751 (> -Infinity) after 109.872s (< 5400.000s)
Returns
-95.52150368783751