BasicOptimizer.scala:89 executed in 130.20 seconds (1.678 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 30548528852700
Reset training subject: 30551123639300
Adding measurement 6e440be0 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-82.79109356015563;dx=-5.114832913389982E-6
New Minimum: -82.79109356015563 > -82.79109769331744
END: th(2.154434690031884)=-82.79109769331744; dx=-3.4758449610742126E-6 evalInputDelta=4.133161809249941E-6
Fitness changed from -82.79109356015563 to -82.79109769331744
Iteration 1 complete. Error: -82.79109769331744 Total: 12.5446; Orientation: 0.0612; Line Search: 4.9035
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7701a061 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-82.79109769331744;dx=-3.446500204550776E-6
New Minimum: -82.79109769331744 > -82.79111835912342
WOLFE (weak): th(4.641588833612779)=-82.79111835912342; dx=-3.4450132609462047E-6 evalInputDelta=2.0665805976705087E-5
New Minimum: -82.79111835912342 > -82.79113902492423
WOLFE (weak): th(9.283177667225559)=-82.79113902492423; dx=-3.443750500141578E-6 evalInputDelta=4.133160679486991E-5
New Minimum: -82.79113902492423 > -82.79120928860841
WOLFE (weak): th(27.849533001676676)=-82.79120928860841; dx=-3.4413400844477777E-6 evalInputDelta=1.1159529097426457E-4
New Minimum: -82.79120928860841 > -82.79153994043925
WOLFE (weak): th(111.3981320067067)=-82.79153994043925; dx=-3.4387835900371246E-6 evalInputDelta=4.4224712181062387E-4
New Minimum: -82.79153994043925 > -82.79329237309653
WOLFE (weak): th(556.9906600335335)=-82.79329237309653; dx=-3.438681789597212E-6 evalInputDelta=0.0021946797790945993
New Minimum: -82.79329237309653 > -82.80424836944141
WOLFE (weak): th(3341.9439602012008)=-82.80424836944141; dx=-3.4371827645548236E-6 evalInputDelta=0.013150676123970584
New Minimum: -82.80424836944141 > -82.88310035136482
WOLFE (weak): th(23393.607721408407)=-82.88310035136482; dx=-3.4338518559422244E-6 evalInputDelta=0.0920026580473774
New Minimum: -82.88310035136482 > -83.52183146906158
WOLFE (weak): th(187148.86177126726)=-83.52183146906158; dx=-3.3788414739771395E-6 evalInputDelta=0.7307337757441417
New Minimum: -83.52183146906158 > -88.83722924539657
END: th(1684339.7559414054)=-88.83722924539657; dx=-2.794723025288563E-6 evalInputDelta=6.046131552079132
Fitness changed from -82.79109769331744 to -88.83722924539657
Iteration 2 complete. Error: -88.83722924539657 Total: 28.4503; Orientation: 0.0615; Line Search: 25.0637
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7a1b13ab to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-88.83722924539657;dx=-2.7597557063514063E-6
New Minimum: -88.83722924539657 > -97.7355406491785
END: th(3628800.0000000005)=-97.7355406491785; dx=-1.6426291156524475E-6 evalInputDelta=8.898311403781932
Fitness changed from -88.83722924539657 to -97.7355406491785
Iteration 3 complete. Error: -97.7355406491785 Total: 8.0869; Orientation: 0.0612; Line Search: 5.0755
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4c07093f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.295e+04, gradient 1.306e-03, dot -0.729; [913be418-2c0a-444c-8854-53d2002692e1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.7355406491785, -88.83722924539657, -82.79109769331744, -82.79109356015563
LBFGS Accumulation History: 3 points
Removed measurement 4c07093f to history. Total: 3
th(0)=-97.7355406491785;dx=-1.7059879570775557E-6
New Minimum: -97.7355406491785 > -108.49050647680846
END: th(7818012.603187701)=-108.49050647680846; dx=-7.658542499333447E-7 evalInputDelta=10.75496582762996
Fitness changed from -97.7355406491785 to -108.49050647680846
Iteration 4 complete. Error: -108.49050647680846 Total: 8.9712; Orientation: 1.0392; Line Search: 4.9686
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 28cd236b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.414e+04, gradient 1.220e-03, dot -0.505; [913be418-2c0a-444c-8854-53d2002692e1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -108.49050647680846, -88.83722924539657, -82.79109769331744, -82.79109356015563
LBFGS Accumulation History: 3 points
Removed measurement 28cd236b to history. Total: 3
th(0)=-108.49050647680846;dx=-1.4878418306178109E-6
New Minimum: -108.49050647680846 > -114.03409349191269
WOLF (strong): th(1.6843397559414055E7)=-114.03409349191269; dx=2.2572000891348593E-7 evalInputDelta=5.543587015104222
New Minimum: -114.03409349191269 > -114.8802891046585
END: th(8421698.779707028)=-114.8802891046585; dx=-1.463608640540416E-7 evalInputDelta=6.389782627850039
Fitness changed from -108.49050647680846 to -114.8802891046585
Iteration 5 complete. Error: -114.8802891046585 Total: 11.5879; Orientation: 1.0406; Line Search: 7.5215
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 68d5f315 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.410e+04, gradient 1.393e-03, dot -0.363; [913be418-2c0a-444c-8854-53d2002692e1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -114.8802891046585, -88.83722924539657, -82.79109769331744, -82.79109356015563
LBFGS Accumulation History: 3 points
Removed measurement 68d5f315 to history. Total: 3
th(0)=-114.8802891046585;dx=-1.9398392044884144E-6
Armijo: th(1.8144000000000004E7)=-111.05795655602496; dx=7.789088336742052E-7 evalInputDelta=-3.8223325486335398
New Minimum: -114.8802891046585 > -119.27580749030346
WOLF (strong): th(9072000.000000002)=-119.27580749030346; dx=6.137148635476136E-7 evalInputDelta=4.395518385644962
New Minimum: -119.27580749030346 > -119.80530199769444
END: th(3024000.0000000005)=-119.80530199769444; dx=-8.812762748653683E-7 evalInputDelta=4.925012893035941
Fitness changed from -114.8802891046585 to -119.80530199769444
Iteration 6 complete. Error: -119.80530199769444 Total: 14.0753; Orientation: 1.0545; Line Search: 10.1867
Adding measurement 193f396a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.304e+04, gradient 9.424e-04, dot -0.658; [913be418-2c0a-444c-8854-53d2002692e1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -119.80530199769444, -88.83722924539657, -82.79109769331744, -82.79109356015563
LBFGS Accumulation History: 3 points
Removed measurement 193f396a to history. Total: 3
th(0)=-119.80530199769444;dx=-8.866476230386347E-7
New Minimum: -119.80530199769444 > -124.64834145556608
END: th(6515010.502656418)=-124.64834145556608; dx=-4.6894175362953624E-7 evalInputDelta=4.84303945787164
Fitness changed from -119.80530199769444 to -124.64834145556608
Iteration 7 complete. Error: -124.64834145556608 Total: 8.5561; Orientation: 1.0900; Line Search: 5.0429
Adding measurement 4d655ab7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.599e+04, gradient 9.568e-04, dot -0.589; [913be418-2c0a-444c-8854-53d2002692e1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -124.64834145556608, -88.83722924539657, -82.79109769331744, -82.79109356015563
LBFGS Accumulation History: 3 points
Removed measurement 4d655ab7 to history. Total: 3
th(0)=-124.64834145556608;dx=-9.143789286637766E-7
New Minimum: -124.64834145556608 > -129.19384577902207
WOLF (strong): th(1.4036164632845048E7)=-129.19384577902207; dx=1.0177292665361168E-8 evalInputDelta=4.545504323455987
END: th(7018082.316422524)=-128.63205390527492; dx=-2.180743159947604E-7 evalInputDelta=3.9837124497088325
Fitness changed from -124.64834145556608 to -129.19384577902207
Iteration 8 complete. Error: -129.19384577902207 Total: 11.3050; Orientation: 0.9897; Line Search: 7.7361
Adding measurement 6c93a917 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.964e+04, gradient 1.367e-03, dot -0.271; [913be418-2c0a-444c-8854-53d2002692e1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -129.19384577902207, -88.83722924539657, -82.79109769331744, -82.79109356015563
LBFGS Accumulation History: 3 points
Removed measurement 6c93a917 to history. Total: 3
th(0)=-129.19384577902207;dx=-1.866197359195599E-6
Armijo: th(1.5120000000000006E7)=-126.79267001925747; dx=1.1268782649204026E-6 evalInputDelta=-2.401175759764598
New Minimum: -129.19384577902207 > -135.16722267596433
WOLF (strong): th(7560000.000000003)=-135.16722267596433; dx=4.565423169587212E-7 evalInputDelta=5.973376896942256
END: th(2520000.000000001)=-133.55832582476026; dx=-1.1668583898730902E-6 evalInputDelta=4.3644800457381905
Fitness changed from -129.19384577902207 to -135.16722267596433
Iteration 9 complete. Error: -135.16722267596433 Total: 13.8764; Orientation: 1.0118; Line Search: 10.5249
Adding measurement 2c8efc77 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.547e+04, gradient 1.241e-03, dot -0.316; [913be418-2c0a-444c-8854-53d2002692e1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -135.16722267596433, -88.83722924539657, -82.79109769331744, -82.79109356015563
LBFGS Accumulation History: 3 points
Removed measurement 2c8efc77 to history. Total: 3
th(0)=-135.16722267596433;dx=-1.538126279590662E-6
New Minimum: -135.16722267596433 > -139.49123215934068
WOLF (strong): th(5429175.418880349)=-139.49123215934068; dx=1.369163719399629E-7 evalInputDelta=4.324009483376358
END: th(2714587.7094401745)=-138.70713505481137; dx=-7.177075120618862E-7 evalInputDelta=3.539912378847049
Fitness changed from -135.16722267596433 to -139.49123215934068
Iteration 10 complete. Error: -139.49123215934068 Total: 12.3311; Orientation: 1.1079; Line Search: 8.0797
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -139.49123215934068 (> -Infinity) after 130.202s (< 5400.000s)
Returns
-139.49123215934068