BasicOptimizer.scala:89 executed in 92.97 seconds (1.093 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 282087584277000
Reset training subject: 282089425657000
Adding measurement 23e453c0 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-56.56866577333026;dx=-5.4757198203439905E-6
New Minimum: -56.56866577333026 > -56.56867239961229
END: th(2.154434690031884)=-56.56867239961229; dx=-3.4803863999539277E-6 evalInputDelta=6.62628202974247E-6
Fitness changed from -56.56866577333026 to -56.56867239961229
Iteration 1 complete. Error: -56.56867239961229 Total: 9.2586; Orientation: 0.0596; Line Search: 3.8875
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6e04432e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-56.56867239961229;dx=-3.4803893735340154E-6
New Minimum: -56.56867239961229 > -56.568688965313974
WOLFE (weak): th(4.641588833612779)=-56.568688965313974; dx=-3.480402075504699E-6 evalInputDelta=1.6565701685067324E-5
New Minimum: -56.568688965313974 > -56.5687055310108
WOLFE (weak): th(9.283177667225559)=-56.5687055310108; dx=-3.480398103125854E-6 evalInputDelta=3.3131398510022336E-5
New Minimum: -56.5687055310108 > -56.56876848061451
WOLFE (weak): th(27.849533001676676)=-56.56876848061451; dx=-3.480396668592838E-6 evalInputDelta=9.608100221925042E-5
New Minimum: -56.56876848061451 > -56.569063348878245
WOLFE (weak): th(111.3981320067067)=-56.569063348878245; dx=-3.48042400458372E-6 evalInputDelta=3.9094926595595325E-4
New Minimum: -56.569063348878245 > -56.57061055379013
WOLFE (weak): th(556.9906600335335)=-56.57061055379013; dx=-3.4801805105922352E-6 evalInputDelta=0.0019381541778429323
New Minimum: -56.57061055379013 > -56.58030364126917
WOLFE (weak): th(3341.9439602012008)=-56.58030364126917; dx=-3.479701493393766E-6 evalInputDelta=0.011631241656878899
New Minimum: -56.58030364126917 > -56.650001240601135
WOLFE (weak): th(23393.607721408407)=-56.650001240601135; dx=-3.4723642792258775E-6 evalInputDelta=0.08132884098884574
New Minimum: -56.650001240601135 > -57.21316401753847
WOLFE (weak): th(187148.86177126726)=-57.21316401753847; dx=-3.4075677504256234E-6 evalInputDelta=0.6444916179261782
New Minimum: -57.21316401753847 > -61.80994485502555
END: th(1684339.7559414054)=-61.80994485502555; dx=-2.7162558099140945E-6 evalInputDelta=5.2412724554132595
Fitness changed from -56.56867239961229 to -61.80994485502555
Iteration 2 complete. Error: -61.80994485502555 Total: 21.0673; Orientation: 0.0625; Line Search: 18.9034
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 1349e448 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-61.80994485502555;dx=-2.4244735608758923E-6
New Minimum: -61.80994485502555 > -68.91262657636047
END: th(3628800.0000000005)=-68.91262657636047; dx=-1.4902608394200236E-6 evalInputDelta=7.102681721334918
Fitness changed from -61.80994485502555 to -68.91262657636047
Iteration 3 complete. Error: -68.91262657636047 Total: 5.8137; Orientation: 0.0672; Line Search: 3.6933
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 74ad3c3a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.136e+03, gradient 1.196e-03, dot -0.766; [0f05e704-1384-48ee-9c17-d198a150630b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.91262657636047, -61.80994485502555, -56.56867239961229, -56.56866577333026
LBFGS Accumulation History: 3 points
Removed measurement 74ad3c3a to history. Total: 3
th(0)=-68.91262657636047;dx=-1.43141666684581E-6
New Minimum: -68.91262657636047 > -76.94109276127068
END: th(7818012.603187701)=-76.94109276127068; dx=-6.700856834716684E-7 evalInputDelta=8.028466184910215
Fitness changed from -68.91262657636047 to -76.94109276127068
Iteration 4 complete. Error: -76.94109276127068 Total: 6.7665; Orientation: 1.0601; Line Search: 3.6091
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement f95dab4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.778e+03, gradient 1.022e-03, dot -0.544; [0f05e704-1384-48ee-9c17-d198a150630b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -76.94109276127068, -61.80994485502555, -56.56867239961229, -56.56866577333026
LBFGS Accumulation History: 3 points
Removed measurement f95dab4 to history. Total: 3
th(0)=-76.94109276127068;dx=-1.0443136668295997E-6
New Minimum: -76.94109276127068 > -83.73618966369456
END: th(1.6843397559414055E7)=-83.73618966369456; dx=-5.1065426132620846E-8 evalInputDelta=6.795096902423879
Fitness changed from -76.94109276127068 to -83.73618966369456
Iteration 5 complete. Error: -83.73618966369456 Total: 6.9656; Orientation: 1.1257; Line Search: 3.7456
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 22117fc2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.403e+03, gradient 1.283e-03, dot -0.207; [0f05e704-1384-48ee-9c17-d198a150630b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -83.73618966369456, -61.80994485502555, -56.56867239961229, -56.56866577333026
LBFGS Accumulation History: 3 points
Removed measurement 22117fc2 to history. Total: 3
th(0)=-83.73618966369456;dx=-1.6449835002757348E-6
Armijo: th(3.628800000000001E7)=-77.05681521643676; dx=4.002666576963101E-7 evalInputDelta=-6.6793744472578
New Minimum: -83.73618966369456 > -86.05707091361626
WOLF (strong): th(1.8144000000000004E7)=-86.05707091361626; dx=5.663406576850166E-7 evalInputDelta=2.3208812499216975
New Minimum: -86.05707091361626 > -89.88898618945413
END: th(6048000.000000001)=-89.88898618945413; dx=-3.4444843602294065E-7 evalInputDelta=6.15279652575957
Fitness changed from -83.73618966369456 to -89.88898618945413
Iteration 6 complete. Error: -89.88898618945413 Total: 10.7078; Orientation: 1.0895; Line Search: 7.5133
Adding measurement 1f1fa3ba to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.577e+04, gradient 8.368e-04, dot -0.505; [0f05e704-1384-48ee-9c17-d198a150630b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -89.88898618945413, -61.80994485502555, -56.56867239961229, -56.56866577333026
LBFGS Accumulation History: 3 points
Removed measurement 1f1fa3ba to history. Total: 3
th(0)=-89.88898618945413;dx=-7.0023084740258E-7
New Minimum: -89.88898618945413 > -94.17581264662994
END: th(1.3030021005312836E7)=-94.17581264662994; dx=-6.346976155145883E-8 evalInputDelta=4.286826457175806
Fitness changed from -89.88898618945413 to -94.17581264662994
Iteration 7 complete. Error: -94.17581264662994 Total: 6.6445; Orientation: 1.0462; Line Search: 3.8217
Adding measurement 34c14faf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.738e+04, gradient 1.009e-03, dot -0.358; [0f05e704-1384-48ee-9c17-d198a150630b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.17581264662994, -61.80994485502555, -56.56867239961229, -56.56866577333026
LBFGS Accumulation History: 3 points
Removed measurement 34c14faf to history. Total: 3
th(0)=-94.17581264662994;dx=-1.018824291205453E-6
Armijo: th(2.8072329265690096E7)=-91.69716133980481; dx=3.3525431758800903E-7 evalInputDelta=-2.478651306825128
New Minimum: -94.17581264662994 > -96.69283356932733
WOLF (strong): th(1.4036164632845048E7)=-96.69283356932733; dx=3.230815707812301E-7 evalInputDelta=2.517020922697398
New Minimum: -96.69283356932733 > -97.48978530405134
END: th(4678721.544281683)=-97.48978530405134; dx=-3.6706624210665065E-7 evalInputDelta=3.3139726574214023
Fitness changed from -94.17581264662994 to -97.48978530405134
Iteration 8 complete. Error: -97.48978530405134 Total: 10.3324; Orientation: 1.0031; Line Search: 7.5627
Adding measurement 27c7c45b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.300e+04, gradient 6.667e-04, dot -0.620; [0f05e704-1384-48ee-9c17-d198a150630b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.48978530405134, -61.80994485502555, -56.56867239961229, -56.56866577333026
LBFGS Accumulation History: 3 points
Removed measurement 27c7c45b to history. Total: 3
th(0)=-97.48978530405134;dx=-4.444820091875191E-7
New Minimum: -97.48978530405134 > -100.74121943362718
END: th(1.0080000000000004E7)=-100.74121943362718; dx=-2.21187625956093E-7 evalInputDelta=3.2514341295758413
Fitness changed from -97.48978530405134 to -100.74121943362718
Iteration 9 complete. Error: -100.74121943362718 Total: 6.6498; Orientation: 1.1125; Line Search: 3.6927
Adding measurement 508486f5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.490e+04, gradient 7.100e-04, dot -0.542; [0f05e704-1384-48ee-9c17-d198a150630b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -100.74121943362718, -61.80994485502555, -56.56867239961229, -56.56866577333026
LBFGS Accumulation History: 3 points
Removed measurement 508486f5 to history. Total: 3
th(0)=-100.74121943362718;dx=-5.041123181316782E-7
New Minimum: -100.74121943362718 > -103.38345737912927
WOLF (strong): th(2.1716701675521396E7)=-103.38345737912927; dx=4.7775583125934754E-8 evalInputDelta=2.642237945502089
New Minimum: -103.38345737912927 > -103.41349214548325
END: th(1.0858350837760698E7)=-103.41349214548325; dx=-6.79623085341352E-8 evalInputDelta=2.672272711856067
Fitness changed from -100.74121943362718 to -103.41349214548325
Iteration 10 complete. Error: -103.41349214548325 Total: 8.4499; Orientation: 1.0650; Line Search: 5.5909
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -103.41349214548325 (> -Infinity) after 92.965s (< 5400.000s)
Returns
-103.41349214548325