BasicOptimizer.scala:89 executed in 154.60 seconds (3.008 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 465519193043500
Reset training subject: 465522263423000
Adding measurement 6a4c40 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-101.54183854440286;dx=-1.5157399566225629E-5
New Minimum: -101.54183854440286 > -101.54186590511655
END: th(2.154434690031884)=-101.54186590511655; dx=-1.2362270038462462E-5 evalInputDelta=2.7360713687585303E-5
Fitness changed from -101.54183854440286 to -101.54186590511655
Iteration 1 complete. Error: -101.54186590511655 Total: 14.7354; Orientation: 0.1043; Line Search: 5.8145
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 32bb2f86 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-101.54186590511655;dx=-1.23780849286699E-5
New Minimum: -101.54186590511655 > -101.54192062652182
WOLFE (weak): th(4.641588833612779)=-101.54192062652182; dx=-1.2363339273771917E-5 evalInputDelta=5.472140526308067E-5
New Minimum: -101.54192062652182 > -101.54198629216921
WOLFE (weak): th(9.283177667225559)=-101.54198629216921; dx=-1.2332046000580787E-5 evalInputDelta=1.2038705266093075E-4
New Minimum: -101.54198629216921 > -101.54222706584635
WOLFE (weak): th(27.849533001676676)=-101.54222706584635; dx=-1.2341368781795851E-5 evalInputDelta=3.611607297955288E-4
New Minimum: -101.54222706584635 > -101.54330506826413
WOLFE (weak): th(111.3981320067067)=-101.54330506826413; dx=-1.2342016056903984E-5 evalInputDelta=0.0014391631475803024
New Minimum: -101.54330506826413 > -101.5490724604028
WOLFE (weak): th(556.9906600335335)=-101.5490724604028; dx=-1.2327598071585006E-5 evalInputDelta=0.007206555286245475
New Minimum: -101.5490724604028 > -101.58511944747397
WOLFE (weak): th(3341.9439602012008)=-101.58511944747397; dx=-1.2333949847932792E-5 evalInputDelta=0.043253542357419406
New Minimum: -101.58511944747397 > -101.84404215431124
WOLFE (weak): th(23393.607721408407)=-101.84404215431124; dx=-1.225618185927094E-5 evalInputDelta=0.30217624919468733
New Minimum: -101.84404215431124 > -103.91552805414474
WOLFE (weak): th(187148.86177126726)=-103.91552805414474; dx=-1.1834014397543019E-5 evalInputDelta=2.373662149028192
New Minimum: -103.91552805414474 > -119.06744761207422
END: th(1684339.7559414054)=-119.06744761207422; dx=-7.570821772923117E-6 evalInputDelta=17.525581706957666
Fitness changed from -101.54186590511655 to -119.06744761207422
Iteration 2 complete. Error: -119.06744761207422 Total: 32.9362; Orientation: 0.1062; Line Search: 29.3108
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 44e21290 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-119.06744761207422;dx=-7.719698677368393E-6
New Minimum: -119.06744761207422 > -138.37671595141825
END: th(3628800.0000000005)=-138.37671595141825; dx=-3.2262300522564527E-6 evalInputDelta=19.30926833934403
Fitness changed from -119.06744761207422 to -138.37671595141825
Iteration 3 complete. Error: -138.37671595141825 Total: 9.6538; Orientation: 0.1023; Line Search: 5.9005
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2f9808f3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.124e+03, gradient 2.241e-03, dot -0.519; [1f298ecb-5e35-4bc0-b829-b55357b947a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -138.37671595141825, -119.06744761207422, -101.54186590511655, -101.54183854440286
LBFGS Accumulation History: 3 points
Removed measurement 2f9808f3 to history. Total: 3
th(0)=-138.37671595141825;dx=-5.003700793869044E-6
New Minimum: -138.37671595141825 > -155.6798165306969
END: th(7818012.603187701)=-155.6798165306969; dx=-6.14339382066614E-7 evalInputDelta=17.303100579278663
Fitness changed from -138.37671595141825 to -155.6798165306969
Iteration 4 complete. Error: -155.6798165306969 Total: 11.2255; Orientation: 1.8968; Line Search: 5.9015
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 75bb5be2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.181e+03, gradient 2.493e-03, dot -0.268; [1f298ecb-5e35-4bc0-b829-b55357b947a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -155.6798165306969, -119.06744761207422, -101.54186590511655, -101.54183854440286
LBFGS Accumulation History: 3 points
Removed measurement 75bb5be2 to history. Total: 3
th(0)=-155.6798165306969;dx=-6.201691332792193E-6
Armijo: th(1.6843397559414055E7)=-148.86301718987514; dx=1.811553521724649E-6 evalInputDelta=-6.816799340821774
New Minimum: -155.6798165306969 > -166.3280748971082
WOLF (strong): th(8421698.779707028)=-166.3280748971082; dx=1.3796559531509733E-6 evalInputDelta=10.648258366411284
New Minimum: -166.3280748971082 > -167.84868392289303
END: th(2807232.926569009)=-167.84868392289303; dx=-2.222996362949263E-6 evalInputDelta=12.16886739219612
Fitness changed from -155.6798165306969 to -167.84868392289303
Iteration 5 complete. Error: -167.84868392289303 Total: 17.1690; Orientation: 1.9466; Line Search: 11.8530
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 422cf4f6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.815e+04, gradient 1.751e-03, dot -0.541; [1f298ecb-5e35-4bc0-b829-b55357b947a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -167.84868392289303, -119.06744761207422, -101.54186590511655, -101.54183854440286
LBFGS Accumulation History: 3 points
Removed measurement 422cf4f6 to history. Total: 3
th(0)=-167.84868392289303;dx=-3.05621764656663E-6
New Minimum: -167.84868392289303 > -178.7688355300618
END: th(6048000.000000001)=-178.7688355300618; dx=-9.058346427839831E-7 evalInputDelta=10.920151607168776
Fitness changed from -167.84868392289303 to -178.7688355300618
Iteration 6 complete. Error: -178.7688355300618 Total: 11.3944; Orientation: 1.7636; Line Search: 6.0272
Adding measurement 54987d45 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.204e+04, gradient 1.914e-03, dot -0.451; [1f298ecb-5e35-4bc0-b829-b55357b947a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -178.7688355300618, -119.06744761207422, -101.54186590511655, -101.54183854440286
LBFGS Accumulation History: 3 points
Removed measurement 54987d45 to history. Total: 3
th(0)=-178.7688355300618;dx=-3.6555541335717775E-6
New Minimum: -178.7688355300618 > -180.97464595127778
WOLF (strong): th(1.3030021005312836E7)=-180.97464595127778; dx=9.351191889405249E-7 evalInputDelta=2.205810421215972
New Minimum: -180.97464595127778 > -186.6337814875251
WOLF (strong): th(6515010.502656418)=-186.6337814875251; dx=2.3543358221102278E-7 evalInputDelta=7.864945957463306
END: th(2171670.167552139)=-184.72735320872076; dx=-1.7230314019447214E-6 evalInputDelta=5.95851767865895
Fitness changed from -178.7688355300618 to -186.6337814875251
Iteration 7 complete. Error: -186.6337814875251 Total: 16.6449; Orientation: 1.8777; Line Search: 11.9135
Adding measurement 4e63a977 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.397e+04, gradient 2.132e-03, dot -0.355; [1f298ecb-5e35-4bc0-b829-b55357b947a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -186.6337814875251, -119.06744761207422, -101.54186590511655, -101.54183854440286
LBFGS Accumulation History: 3 points
Removed measurement 4e63a977 to history. Total: 3
th(0)=-186.6337814875251;dx=-4.5464839852835776E-6
New Minimum: -186.6337814875251 > -197.02896966693555
WOLF (strong): th(4678721.544281682)=-197.02896966693555; dx=1.8074146331864915E-8 evalInputDelta=10.39518817941044
END: th(2339360.772140841)=-194.811414084975; dx=-2.146610642995969E-6 evalInputDelta=8.1776325974499
Fitness changed from -186.6337814875251 to -197.02896966693555
Iteration 8 complete. Error: -197.02896966693555 Total: 13.4375; Orientation: 1.9423; Line Search: 8.6612
Adding measurement 38e33497 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.118e+04, gradient 1.727e-03, dot -0.469; [1f298ecb-5e35-4bc0-b829-b55357b947a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -197.02896966693555, -119.06744761207422, -101.54186590511655, -101.54183854440286
LBFGS Accumulation History: 3 points
Removed measurement 38e33497 to history. Total: 3
th(0)=-197.02896966693555;dx=-2.9725661496583573E-6
New Minimum: -197.02896966693555 > -204.12996983982828
END: th(5040000.000000001)=-204.12996983982828; dx=-1.4279147634925943E-7 evalInputDelta=7.101000172892725
Fitness changed from -197.02896966693555 to -204.12996983982828
Iteration 9 complete. Error: -204.12996983982828 Total: 10.6306; Orientation: 1.7371; Line Search: 5.8197
Adding measurement 3dc32bfe to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.488e+04, gradient 1.703e-03, dot -0.462; [1f298ecb-5e35-4bc0-b829-b55357b947a9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -204.12996983982828, -119.06744761207422, -101.54186590511655, -101.54183854440286
LBFGS Accumulation History: 3 points
Removed measurement 3dc32bfe to history. Total: 3
th(0)=-204.12996983982828;dx=-2.8930318449386014E-6
New Minimum: -204.12996983982828 > -205.77531691908126
WOLF (strong): th(1.0858350837760696E7)=-205.77531691908126; dx=1.012367305222925E-6 evalInputDelta=1.6453470792529856
New Minimum: -205.77531691908126 > -210.48265561882866
WOLF (strong): th(5429175.418880348)=-210.48265561882866; dx=1.5383894540211552E-7 evalInputDelta=6.352685779000382
END: th(1809725.1396267826)=-208.3688286578412; dx=-1.6660285565595826E-6 evalInputDelta=4.238858818012915
Fitness changed from -204.12996983982828 to -210.48265561882866
Iteration 10 complete. Error: -210.48265561882866 Total: 16.0345; Orientation: 1.8441; Line Search: 11.3353
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -210.48265561882866 (> -Infinity) after 154.604s (< 5400.000s)
Returns
-210.48265561882866