BasicOptimizer.scala:89 executed in 316.12 seconds (7.352 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 585212024889900
Reset training subject: 585218088120200
Adding measurement fd90fd9 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-39.5756929751451;dx=-2.05662986523127E-6
New Minimum: -39.5756929751451 > -39.57569679199534
END: th(2.154434690031884)=-39.57569679199534; dx=-1.7987644775771852E-6 evalInputDelta=3.8168502385360625E-6
Fitness changed from -39.5756929751451 to -39.57569679199534
Iteration 1 complete. Error: -39.57569679199534 Total: 30.5146; Orientation: 0.1440; Line Search: 12.4359
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5bee939c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-39.57569679199534;dx=-1.7984403734928595E-6
New Minimum: -39.57569679199534 > -39.57570633411932
WOLFE (weak): th(4.641588833612779)=-39.57570633411932; dx=-1.7970025014437527E-6 evalInputDelta=9.542123976302719E-6
New Minimum: -39.57570633411932 > -39.57571587624099
WOLFE (weak): th(9.283177667225559)=-39.57571587624099; dx=-1.7958042963660412E-6 evalInputDelta=1.9084245650446974E-5
New Minimum: -39.57571587624099 > -39.575754044704695
WOLFE (weak): th(27.849533001676676)=-39.575754044704695; dx=-1.7959659255968222E-6 evalInputDelta=5.7252709353861064E-5
New Minimum: -39.575754044704695 > -39.57591816867916
WOLFE (weak): th(111.3981320067067)=-39.57591816867916; dx=-1.7949815524938085E-6 evalInputDelta=2.213766838181641E-4
New Minimum: -39.57591816867916 > -39.57679221279997
WOLFE (weak): th(556.9906600335335)=-39.57679221279997; dx=-1.7947682207138947E-6 evalInputDelta=0.0010954208046314307
New Minimum: -39.57679221279997 > -39.58225932155231
WOLFE (weak): th(3341.9439602012008)=-39.58225932155231; dx=-1.7940028502013394E-6 evalInputDelta=0.0065625295569660125
New Minimum: -39.58225932155231 > -39.62159261076718
WOLFE (weak): th(23393.607721408407)=-39.62159261076718; dx=-1.7918925958087194E-6 evalInputDelta=0.04589581877183946
New Minimum: -39.62159261076718 > -39.94068515793798
WOLFE (weak): th(187148.86177126726)=-39.94068515793798; dx=-1.770311373903369E-6 evalInputDelta=0.3649883659426365
New Minimum: -39.94068515793798 > -42.652781485136494
END: th(1684339.7559414054)=-42.652781485136494; dx=-1.5344667347456633E-6 evalInputDelta=3.0770846931411526
Fitness changed from -39.57569679199534 to -42.652781485136494
Iteration 2 complete. Error: -42.652781485136494 Total: 84.6266; Orientation: 0.1413; Line Search: 77.3447
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 21c0ca4a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-42.652781485136494;dx=-1.4689066339136947E-6
New Minimum: -42.652781485136494 > -47.45048730965909
END: th(3628800.0000000005)=-47.45048730965909; dx=-9.836904432542634E-7 evalInputDelta=4.797705824522595
Fitness changed from -42.652781485136494 to -47.45048730965909
Iteration 3 complete. Error: -47.45048730965909 Total: 19.4696; Orientation: 0.1370; Line Search: 11.9476
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 635e3ab1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.097e+04, gradient 9.723e-04, dot -0.811; [4a5f1b8a-1716-4fcf-aef0-69aa9bc1c796 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -47.45048730965909, -42.652781485136494, -39.57569679199534, -39.5756929751451
LBFGS Accumulation History: 3 points
Removed measurement 635e3ab1 to history. Total: 3
th(0)=-47.45048730965909;dx=-9.446347277890436E-7
New Minimum: -47.45048730965909 > -53.51309784662189
END: th(7818012.603187701)=-53.51309784662189; dx=-5.037649086202061E-7 evalInputDelta=6.062610536962801
Fitness changed from -47.45048730965909 to -53.51309784662189
Iteration 4 complete. Error: -53.51309784662189 Total: 21.8705; Orientation: 2.4967; Line Search: 12.1599
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 1963aae4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.729e+03, gradient 8.483e-04, dot -0.588; [4a5f1b8a-1716-4fcf-aef0-69aa9bc1c796 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.51309784662189, -42.652781485136494, -39.57569679199534, -39.5756929751451
LBFGS Accumulation History: 3 points
Removed measurement 1963aae4 to history. Total: 3
th(0)=-53.51309784662189;dx=-7.185243448546514E-7
New Minimum: -53.51309784662189 > -59.61695461580954
END: th(1.6843397559414055E7)=-59.61695461580954; dx=-1.3273402372878644E-7 evalInputDelta=6.103856769187651
Fitness changed from -53.51309784662189 to -59.61695461580954
Iteration 5 complete. Error: -59.61695461580954 Total: 22.1296; Orientation: 2.4360; Line Search: 12.4319
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4179fc39 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.174e+04, gradient 1.016e-03, dot -0.326; [4a5f1b8a-1716-4fcf-aef0-69aa9bc1c796 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -59.61695461580954, -42.652781485136494, -39.57569679199534, -39.5756929751451
LBFGS Accumulation History: 3 points
Removed measurement 4179fc39 to history. Total: 3
th(0)=-59.61695461580954;dx=-1.0291852901883537E-6
Armijo: th(3.628800000000001E7)=-56.75329878849568; dx=2.4782649435433586E-7 evalInputDelta=-2.8636558273138633
New Minimum: -59.61695461580954 > -62.89406165874272
WOLF (strong): th(1.8144000000000004E7)=-62.89406165874272; dx=2.8981121637821873E-7 evalInputDelta=3.2771070429331814
New Minimum: -62.89406165874272 > -64.26514285115738
END: th(6048000.000000001)=-64.26514285115738; dx=-3.4821567758278283E-7 evalInputDelta=4.648188235347838
Fitness changed from -59.61695461580954 to -64.26514285115738
Iteration 6 complete. Error: -64.26514285115738 Total: 34.4476; Orientation: 2.4763; Line Search: 24.8407
Adding measurement 35546bd8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.977e+04, gradient 7.160e-04, dot -0.601; [4a5f1b8a-1716-4fcf-aef0-69aa9bc1c796 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.26514285115738, -42.652781485136494, -39.57569679199534, -39.5756929751451
LBFGS Accumulation History: 3 points
Removed measurement 35546bd8 to history. Total: 3
th(0)=-64.26514285115738;dx=-5.117543675054066E-7
New Minimum: -64.26514285115738 > -68.51531140435746
END: th(1.3030021005312836E7)=-68.51531140435746; dx=-1.5245138951232097E-7 evalInputDelta=4.2501685532000835
Fitness changed from -64.26514285115738 to -68.51531140435746
Iteration 7 complete. Error: -68.51531140435746 Total: 20.9974; Orientation: 2.4215; Line Search: 12.7233
Adding measurement 6af3381c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.538e+04, gradient 8.222e-04, dot -0.483; [4a5f1b8a-1716-4fcf-aef0-69aa9bc1c796 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.51531140435746, -42.652781485136494, -39.57569679199534, -39.5756929751451
LBFGS Accumulation History: 3 points
Removed measurement 6af3381c to history. Total: 3
th(0)=-68.51531140435746;dx=-6.75751253299164E-7
New Minimum: -68.51531140435746 > -69.02074454750505
WOLF (strong): th(2.8072329265690096E7)=-69.02074454750505; dx=1.7166672844530416E-7 evalInputDelta=0.5054331431475845
New Minimum: -69.02074454750505 > -71.57786679720283
WOLF (strong): th(1.4036164632845048E7)=-71.57786679720283; dx=8.738320702610332E-8 evalInputDelta=3.0625553928453684
END: th(4678721.544281683)=-71.0668696947366; dx=-3.1984782499382E-7 evalInputDelta=2.551558290379134
Fitness changed from -68.51531140435746 to -71.57786679720283
Iteration 8 complete. Error: -71.57786679720283 Total: 32.8010; Orientation: 2.4355; Line Search: 24.5845
Adding measurement 427b9ab6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.655e+04, gradient 9.453e-04, dot -0.363; [4a5f1b8a-1716-4fcf-aef0-69aa9bc1c796 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -71.57786679720283, -42.652781485136494, -39.57569679199534, -39.5756929751451
LBFGS Accumulation History: 3 points
Removed measurement 427b9ab6 to history. Total: 3
th(0)=-71.57786679720283;dx=-8.92563541167817E-7
New Minimum: -71.57786679720283 > -76.40518647498949
WOLF (strong): th(1.0080000000000004E7)=-76.40518647498949; dx=4.393523438797943E-8 evalInputDelta=4.827319677786662
END: th(5040000.000000002)=-75.38427776193419; dx=-4.58443498490682E-7 evalInputDelta=3.8064109647313558
Fitness changed from -71.57786679720283 to -76.40518647498949
Iteration 9 complete. Error: -76.40518647498949 Total: 27.4279; Orientation: 2.4128; Line Search: 19.0077
Adding measurement 4f90204b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.780e+04, gradient 7.414e-04, dot -0.511; [4a5f1b8a-1716-4fcf-aef0-69aa9bc1c796 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -76.40518647498949, -42.652781485136494, -39.57569679199534, -39.5756929751451
LBFGS Accumulation History: 3 points
Removed measurement 4f90204b to history. Total: 3
th(0)=-76.40518647498949;dx=-5.492093361586123E-7
New Minimum: -76.40518647498949 > -79.4958210300411
END: th(1.0858350837760698E7)=-79.4958210300411; dx=-2.3695815792668738E-8 evalInputDelta=3.090634555051608
Fitness changed from -76.40518647498949 to -79.4958210300411
Iteration 10 complete. Error: -79.4958210300411 Total: 20.7717; Orientation: 2.4557; Line Search: 12.0243
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -79.4958210300411 (> -Infinity) after 316.120s (< 5400.000s)
Returns
-79.4958210300411