BasicOptimizer.scala:89 executed in 132.68 seconds (1.687 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 33151867122199
Reset training subject: 33154569408800
Adding measurement 77279509 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-53.39639336806859;dx=-4.399730285801962E-6
New Minimum: -53.39639336806859 > -53.39640458288368
END: th(2.154434690031884)=-53.39640458288368; dx=-3.2402610591477645E-6 evalInputDelta=1.1214815096138864E-5
Fitness changed from -53.39639336806859 to -53.39640458288368
Iteration 1 complete. Error: -53.39640458288368 Total: 12.9948; Orientation: 0.0616; Line Search: 5.0432
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4759c7da to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-53.39640458288368;dx=-3.2160347002239075E-6
New Minimum: -53.39640458288368 > -53.39642060404402
WOLFE (weak): th(4.641588833612779)=-53.39642060404402; dx=-3.2132874598653303E-6 evalInputDelta=1.6021160334389606E-5
New Minimum: -53.39642060404402 > -53.396438227314825
WOLFE (weak): th(9.283177667225559)=-53.396438227314825; dx=-3.21360989209551E-6 evalInputDelta=3.364443114151072E-5
New Minimum: -53.396438227314825 > -53.396507118226744
WOLFE (weak): th(27.849533001676676)=-53.396507118226744; dx=-3.211404241025685E-6 evalInputDelta=1.0253534306059464E-4
New Minimum: -53.396507118226744 > -53.39681952938625
WOLFE (weak): th(111.3981320067067)=-53.39681952938625; dx=-3.209703944851526E-6 evalInputDelta=4.14946502566238E-4
New Minimum: -53.39681952938625 > -53.39848088520603
WOLFE (weak): th(556.9906600335335)=-53.39848088520603; dx=-3.209390198096769E-6 evalInputDelta=0.0020763023223437926
New Minimum: -53.39848088520603 > -53.40885798256951
WOLFE (weak): th(3341.9439602012008)=-53.40885798256951; dx=-3.2083937154466073E-6 evalInputDelta=0.012453399685824706
New Minimum: -53.40885798256951 > -53.48350629007467
WOLFE (weak): th(23393.607721408407)=-53.48350629007467; dx=-3.203260773414724E-6 evalInputDelta=0.08710170719098898
New Minimum: -53.48350629007467 > -54.08646781139138
WOLFE (weak): th(187148.86177126726)=-54.08646781139138; dx=-3.1384358371157498E-6 evalInputDelta=0.6900632285076966
New Minimum: -54.08646781139138 > -58.926290682360836
END: th(1684339.7559414054)=-58.926290682360836; dx=-2.3830005671527623E-6 evalInputDelta=5.529886099477153
Fitness changed from -53.39640458288368 to -58.926290682360836
Iteration 2 complete. Error: -58.926290682360836 Total: 29.3705; Orientation: 0.0624; Line Search: 26.2347
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 67fafaae to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-58.926290682360836;dx=-2.3667314704904835E-6
New Minimum: -58.926290682360836 > -66.47952246857149
END: th(3628800.0000000005)=-66.47952246857149; dx=-1.3164307574867707E-6 evalInputDelta=7.553231786210652
Fitness changed from -58.926290682360836 to -66.47952246857149
Iteration 3 complete. Error: -66.47952246857149 Total: 8.2523; Orientation: 0.0620; Line Search: 5.0987
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4157613d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.805e+03, gradient 1.242e-03, dot -0.662; [a3173f46-33ed-4856-bb5e-ea2c4df3526d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -66.47952246857149, -58.926290682360836, -53.39640458288368, -53.39639336806859
LBFGS Accumulation History: 3 points
Removed measurement 4157613d to history. Total: 3
th(0)=-66.47952246857149;dx=-1.5419414490699377E-6
New Minimum: -66.47952246857149 > -75.2899457950718
END: th(7818012.603187701)=-75.2899457950718; dx=-5.293355552633773E-7 evalInputDelta=8.810423326500313
Fitness changed from -66.47952246857149 to -75.2899457950718
Iteration 4 complete. Error: -75.2899457950718 Total: 9.7249; Orientation: 1.1512; Line Search: 5.4759
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 524fc662 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.175e+04, gradient 1.331e-03, dot -0.417; [a3173f46-33ed-4856-bb5e-ea2c4df3526d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.2899457950718, -58.926290682360836, -53.39640458288368, -53.39639336806859
LBFGS Accumulation History: 3 points
Removed measurement 524fc662 to history. Total: 3
th(0)=-75.2899457950718;dx=-1.7714506947059363E-6
New Minimum: -75.2899457950718 > -75.53573315054368
WOLF (strong): th(1.6843397559414055E7)=-75.53573315054368; dx=3.9962255180452155E-7 evalInputDelta=0.2457873554718759
New Minimum: -75.53573315054368 > -79.52542919347606
WOLF (strong): th(8421698.779707028)=-79.52542919347606; dx=2.8061771189735167E-7 evalInputDelta=4.235483398404256
END: th(2807232.926569009)=-79.27845148706022; dx=-6.888408942485582E-7 evalInputDelta=3.988505691988422
Fitness changed from -75.2899457950718 to -79.52542919347606
Iteration 5 complete. Error: -79.52542919347606 Total: 14.5092; Orientation: 1.0995; Line Search: 10.2747
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 59ee294 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.447e+03, gradient 1.604e-03, dot -0.227; [a3173f46-33ed-4856-bb5e-ea2c4df3526d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -79.52542919347606, -58.926290682360836, -53.39640458288368, -53.39639336806859
LBFGS Accumulation History: 3 points
Removed measurement 59ee294 to history. Total: 3
th(0)=-79.52542919347606;dx=-2.568864707882789E-6
New Minimum: -79.52542919347606 > -86.53461044344675
WOLF (strong): th(6048000.000000001)=-86.53461044344675; dx=5.411837317577454E-7 evalInputDelta=7.009181249970695
END: th(3024000.0000000005)=-86.078999716965; dx=-1.0307463319925318E-6 evalInputDelta=6.553570523488943
Fitness changed from -79.52542919347606 to -86.53461044344675
Iteration 6 complete. Error: -86.53461044344675 Total: 11.9867; Orientation: 1.0565; Line Search: 7.9515
Adding measurement 4b491e7e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.880e+04, gradient 1.382e-03, dot -0.341; [a3173f46-33ed-4856-bb5e-ea2c4df3526d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.53461044344675, -58.926290682360836, -53.39640458288368, -53.39639336806859
LBFGS Accumulation History: 3 points
Removed measurement 4b491e7e to history. Total: 3
th(0)=-86.53461044344675;dx=-1.909155762405986E-6
New Minimum: -86.53461044344675 > -90.50547371672423
WOLF (strong): th(6515010.502656418)=-90.50547371672423; dx=6.340665226614793E-7 evalInputDelta=3.970863273277473
New Minimum: -90.50547371672423 > -91.18630056086481
END: th(3257505.251328209)=-91.18630056086481; dx=-4.876277978781033E-7 evalInputDelta=4.651690117418056
Fitness changed from -86.53461044344675 to -91.18630056086481
Iteration 7 complete. Error: -91.18630056086481 Total: 11.2931; Orientation: 1.0265; Line Search: 7.7006
Adding measurement 7ded172d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.824e+04, gradient 8.818e-04, dot -0.646; [a3173f46-33ed-4856-bb5e-ea2c4df3526d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.18630056086481, -58.926290682360836, -53.39640458288368, -53.39639336806859
LBFGS Accumulation History: 3 points
Removed measurement 7ded172d to history. Total: 3
th(0)=-91.18630056086481;dx=-7.764218250032623E-7
New Minimum: -91.18630056086481 > -95.3728630179924
END: th(7018082.316422524)=-95.3728630179924; dx=-3.2694195641313846E-7 evalInputDelta=4.186562457127593
Fitness changed from -91.18630056086481 to -95.3728630179924
Iteration 8 complete. Error: -95.3728630179924 Total: 8.7499; Orientation: 0.9947; Line Search: 5.1262
Adding measurement 76125233 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.094e+04, gradient 1.032e-03, dot -0.507; [a3173f46-33ed-4856-bb5e-ea2c4df3526d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -95.3728630179924, -58.926290682360836, -53.39640458288368, -53.39639336806859
LBFGS Accumulation History: 3 points
Removed measurement 76125233 to history. Total: 3
th(0)=-95.3728630179924;dx=-1.063567718895957E-6
Armijo: th(1.5120000000000006E7)=-94.79696581665854; dx=3.511160848522177E-7 evalInputDelta=-0.5758972013338592
New Minimum: -95.3728630179924 > -97.7390557632364
WOLF (strong): th(7560000.000000003)=-97.7390557632364; dx=1.9152481528153084E-7 evalInputDelta=2.3661927452439926
END: th(2520000.000000001)=-97.55073509241426; dx=-4.553599931278947E-7 evalInputDelta=2.177872074421856
Fitness changed from -95.3728630179924 to -97.7390557632364
Iteration 9 complete. Error: -97.7390557632364 Total: 13.9534; Orientation: 0.9962; Line Search: 10.3237
Adding measurement 20a5a1dd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.783e+04, gradient 1.320e-03, dot -0.332; [a3173f46-33ed-4856-bb5e-ea2c4df3526d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.7390557632364, -58.926290682360836, -53.39640458288368, -53.39639336806859
LBFGS Accumulation History: 3 points
Removed measurement 20a5a1dd to history. Total: 3
th(0)=-97.7390557632364;dx=-1.7410208724449683E-6
New Minimum: -97.7390557632364 > -101.86152958810052
WOLF (strong): th(5429175.418880349)=-101.86152958810052; dx=4.3460182315738463E-7 evalInputDelta=4.12247382486413
END: th(2714587.7094401745)=-101.68360723311548; dx=-6.982912303392916E-7 evalInputDelta=3.9445514698790873
Fitness changed from -97.7390557632364 to -101.86152958810052
Iteration 10 complete. Error: -101.86152958810052 Total: 11.4176; Orientation: 0.9911; Line Search: 7.6984
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -101.86152958810052 (> -Infinity) after 132.683s (< 5400.000s)
Returns
-101.86152958810052