BasicOptimizer.scala:89 executed in 298.39 seconds (3.496 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 573366300667500
Reset training subject: 573372292495100
Adding measurement 6f40d809 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-38.95151156003504;dx=-2.0477106367078052E-6
New Minimum: -38.95151156003504 > -38.951515438048666
END: th(2.154434690031884)=-38.951515438048666; dx=-1.803064882976092E-6 evalInputDelta=3.8780136293325995E-6
Fitness changed from -38.95151156003504 to -38.951515438048666
Iteration 1 complete. Error: -38.951515438048666 Total: 29.7878; Orientation: 0.1491; Line Search: 12.1164
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 26f365d0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-38.951515438048666;dx=-1.8035169049755531E-6
New Minimum: -38.951515438048666 > -38.951523194074774
WOLFE (weak): th(4.641588833612779)=-38.951523194074774; dx=-1.8016573208267874E-6 evalInputDelta=7.756026107585967E-6
New Minimum: -38.951523194074774 > -38.951534828111036
WOLFE (weak): th(9.283177667225559)=-38.951534828111036; dx=-1.8013958692219933E-6 evalInputDelta=1.9390062369950556E-5
New Minimum: -38.951534828111036 > -38.95157166920295
WOLFE (weak): th(27.849533001676676)=-38.95157166920295; dx=-1.8009621413210344E-6 evalInputDelta=5.623115428221581E-5
New Minimum: -38.95157166920295 > -38.951736484187485
WOLFE (weak): th(111.3981320067067)=-38.951736484187485; dx=-1.8002464363531607E-6 evalInputDelta=2.2104613881879231E-4
New Minimum: -38.951736484187485 > -38.952614839343404
WOLFE (weak): th(556.9906600335335)=-38.952614839343404; dx=-1.7990435169721341E-6 evalInputDelta=0.001099401294737845
New Minimum: -38.952614839343404 > -38.95811138043907
WOLFE (weak): th(3341.9439602012008)=-38.95811138043907; dx=-1.7992118233108724E-6 evalInputDelta=0.00659594239040473
New Minimum: -38.95811138043907 > -38.99766360683175
WOLFE (weak): th(23393.607721408407)=-38.99766360683175; dx=-1.7972654197621786E-6 evalInputDelta=0.04614816878308403
New Minimum: -38.99766360683175 > -39.318540749008704
WOLFE (weak): th(187148.86177126726)=-39.318540749008704; dx=-1.7754421733460125E-6 evalInputDelta=0.3670253109600381
New Minimum: -39.318540749008704 > -42.047486437733035
END: th(1684339.7559414054)=-42.047486437733035; dx=-1.5401969498395875E-6 evalInputDelta=3.0959709996843685
Fitness changed from -38.951515438048666 to -42.047486437733035
Iteration 2 complete. Error: -42.047486437733035 Total: 68.1144; Orientation: 0.1424; Line Search: 60.7875
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 67055d3a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-42.047486437733035;dx=-1.475067304445949E-6
New Minimum: -42.047486437733035 > -46.88830406073243
END: th(3628800.0000000005)=-46.88830406073243; dx=-9.901521795663175E-7 evalInputDelta=4.8408176229993956
Fitness changed from -42.047486437733035 to -46.88830406073243
Iteration 3 complete. Error: -46.88830406073243 Total: 19.7679; Orientation: 0.1417; Line Search: 12.2395
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5ecfedb4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.112e+04, gradient 9.788e-04, dot -0.809; [bb29e150-0324-4b75-b72d-2b76ec4a2f51 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.88830406073243, -42.047486437733035, -38.951515438048666, -38.95151156003504
LBFGS Accumulation History: 3 points
Removed measurement 5ecfedb4 to history. Total: 3
th(0)=-46.88830406073243;dx=-9.566364972862197E-7
New Minimum: -46.88830406073243 > -53.033390786357636
END: th(7818012.603187701)=-53.033390786357636; dx=-5.109774827565429E-7 evalInputDelta=6.145086725625205
Fitness changed from -46.88830406073243 to -53.033390786357636
Iteration 4 complete. Error: -53.033390786357636 Total: 21.4916; Orientation: 2.5272; Line Search: 11.9901
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 79aad7b7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.008e+04, gradient 8.563e-04, dot -0.588; [bb29e150-0324-4b75-b72d-2b76ec4a2f51 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.033390786357636, -42.047486437733035, -38.951515438048666, -38.95151156003504
LBFGS Accumulation History: 3 points
Removed measurement 79aad7b7 to history. Total: 3
th(0)=-53.033390786357636;dx=-7.317566284880277E-7
New Minimum: -53.033390786357636 > -59.213837676738045
END: th(1.6843397559414055E7)=-59.213837676738045; dx=-1.3345058057317773E-7 evalInputDelta=6.180446890380409
Fitness changed from -53.033390786357636 to -59.213837676738045
Iteration 5 complete. Error: -59.213837676738045 Total: 21.8608; Orientation: 2.4551; Line Search: 12.3823
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 5969f559 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.201e+04, gradient 1.029e-03, dot -0.324; [bb29e150-0324-4b75-b72d-2b76ec4a2f51 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.213837676738045, -42.047486437733035, -38.951515438048666, -38.95151156003504
LBFGS Accumulation History: 3 points
Removed measurement 5969f559 to history. Total: 3
th(0)=-59.213837676738045;dx=-1.0574021126353817E-6
Armijo: th(3.628800000000001E7)=-56.174919329250564; dx=2.537409813101367E-7 evalInputDelta=-3.0389183474874812
New Minimum: -59.213837676738045 > -62.5198469688266
WOLF (strong): th(1.8144000000000004E7)=-62.5198469688266; dx=2.9898740920844356E-7 evalInputDelta=3.3060092920885538
New Minimum: -62.5198469688266 > -64.00711469830091
END: th(6048000.000000001)=-64.00711469830091; dx=-3.5714042038918106E-7 evalInputDelta=4.793277021562865
Fitness changed from -59.213837676738045 to -64.00711469830091
Iteration 6 complete. Error: -64.00711469830091 Total: 34.1107; Orientation: 2.4279; Line Search: 24.5251
Adding measurement 5d20acea to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.046e+04, gradient 7.236e-04, dot -0.600; [bb29e150-0324-4b75-b72d-2b76ec4a2f51 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.00711469830091, -42.047486437733035, -38.951515438048666, -38.95151156003504
LBFGS Accumulation History: 3 points
Removed measurement 5d20acea to history. Total: 3
th(0)=-64.00711469830091;dx=-5.228486900033209E-7
New Minimum: -64.00711469830091 > -68.32409925053095
END: th(1.3030021005312836E7)=-68.32409925053095; dx=-1.547824442857697E-7 evalInputDelta=4.316984552230039
Fitness changed from -64.00711469830091 to -68.32409925053095
Iteration 7 complete. Error: -68.32409925053095 Total: 20.4070; Orientation: 2.4718; Line Search: 11.9722
Adding measurement 6a08a7b7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.638e+04, gradient 8.348e-04, dot -0.480; [bb29e150-0324-4b75-b72d-2b76ec4a2f51 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.32409925053095, -42.047486437733035, -38.951515438048666, -38.95151156003504
LBFGS Accumulation History: 3 points
Removed measurement 6a08a7b7 to history. Total: 3
th(0)=-68.32409925053095;dx=-6.958240496881921E-7
New Minimum: -68.32409925053095 > -68.74886321564131
WOLF (strong): th(2.8072329265690096E7)=-68.74886321564131; dx=1.7673067544160077E-7 evalInputDelta=0.4247639651103583
New Minimum: -68.74886321564131 > -71.43692534476071
WOLF (strong): th(1.4036164632845048E7)=-71.43692534476071; dx=9.431224639053266E-8 evalInputDelta=3.11282609422976
END: th(4678721.544281683)=-70.95793587876538; dx=-3.257121622158465E-7 evalInputDelta=2.633836628234434
Fitness changed from -68.32409925053095 to -71.43692534476071
Iteration 8 complete. Error: -71.43692534476071 Total: 32.4873; Orientation: 2.4655; Line Search: 24.2376
Adding measurement 2adfd35f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.719e+04, gradient 9.595e-04, dot -0.358; [bb29e150-0324-4b75-b72d-2b76ec4a2f51 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -71.43692534476071, -42.047486437733035, -38.951515438048666, -38.95151156003504
LBFGS Accumulation History: 3 points
Removed measurement 2adfd35f to history. Total: 3
th(0)=-71.43692534476071;dx=-9.18497366228064E-7
New Minimum: -71.43692534476071 > -76.40873711849406
WOLF (strong): th(1.0080000000000004E7)=-76.40873711849406; dx=4.522764656249268E-8 evalInputDelta=4.97181177373335
END: th(5040000.000000002)=-75.36604905538223; dx=-4.6980416975582345E-7 evalInputDelta=3.929123710621525
Fitness changed from -71.43692534476071 to -76.40873711849406
Iteration 9 complete. Error: -76.40873711849406 Total: 28.0323; Orientation: 2.7030; Line Search: 19.2882
Adding measurement 28acf206 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.938e+04, gradient 7.529e-04, dot -0.508; [bb29e150-0324-4b75-b72d-2b76ec4a2f51 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -76.40873711849406, -42.047486437733035, -38.951515438048666, -38.95151156003504
LBFGS Accumulation History: 3 points
Removed measurement 28acf206 to history. Total: 3
th(0)=-76.40873711849406;dx=-5.66219807572825E-7
New Minimum: -76.40873711849406 > -79.60720238145578
END: th(1.0858350837760698E7)=-79.60720238145578; dx=-2.2689624858171853E-8 evalInputDelta=3.1984652629617187
Fitness changed from -76.40873711849406 to -79.60720238145578
Iteration 10 complete. Error: -79.60720238145578 Total: 21.2256; Orientation: 2.4403; Line Search: 12.9886
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -79.60720238145578 (> -Infinity) after 298.390s (< 5400.000s)
Returns
-79.60720238145578