BasicOptimizer.scala:89 executed in 134.99 seconds (1.662 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 110879172418600
Reset training subject: 110881956436700
Adding measurement 53999a43 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-28.42388200935733;dx=-1.3726255325134554E-6
New Minimum: -28.42388200935733 > -28.423883496920045
END: th(2.154434690031884)=-28.423883496920045; dx=-1.0642904360723618E-6 evalInputDelta=1.4875627130095381E-6
Fitness changed from -28.42388200935733 to -28.423883496920045
Iteration 1 complete. Error: -28.423883496920045 Total: 13.4449; Orientation: 0.0678; Line Search: 5.3849
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6ae0e62e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-28.423883496920045;dx=-1.0639243370014473E-6
New Minimum: -28.423883496920045 > -28.42388944717013
WOLFE (weak): th(4.641588833612779)=-28.42388944717013; dx=-1.063191399205488E-6 evalInputDelta=5.950250084651998E-6
New Minimum: -28.42388944717013 > -28.423893909856872
WOLFE (weak): th(9.283177667225559)=-28.423893909856872; dx=-1.0626721908244925E-6 evalInputDelta=1.0412936827464137E-5
New Minimum: -28.423893909856872 > -28.423916223280084
WOLFE (weak): th(27.849533001676676)=-28.423916223280084; dx=-1.061655572578253E-6 evalInputDelta=3.2726360039703195E-5
New Minimum: -28.423916223280084 > -28.424012914578245
WOLFE (weak): th(111.3981320067067)=-28.424012914578245; dx=-1.0612144880428232E-6 evalInputDelta=1.294176582007367E-4
New Minimum: -28.424012914578245 > -28.424530579318624
WOLFE (weak): th(556.9906600335335)=-28.424530579318624; dx=-1.0610122113464386E-6 evalInputDelta=6.470823985793572E-4
New Minimum: -28.424530579318624 > -28.427761308295974
WOLFE (weak): th(3341.9439602012008)=-28.427761308295974; dx=-1.061191786178803E-6 evalInputDelta=0.003877811375929241
New Minimum: -28.427761308295974 > -28.451006674262526
WOLFE (weak): th(23393.607721408407)=-28.451006674262526; dx=-1.0591174643218047E-6 evalInputDelta=0.027123177342481597
New Minimum: -28.451006674262526 > -28.63941595584149
WOLFE (weak): th(187148.86177126726)=-28.63941595584149; dx=-1.0450851210911938E-6 evalInputDelta=0.21553245892144446
New Minimum: -28.63941595584149 > -30.226533106269514
END: th(1684339.7559414054)=-30.226533106269514; dx=-8.891212995980575E-7 evalInputDelta=1.8026496093494693
Fitness changed from -28.423883496920045 to -30.226533106269514
Iteration 2 complete. Error: -30.226533106269514 Total: 30.3465; Orientation: 0.0667; Line Search: 27.2243
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3f1dd64 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-30.226533106269514;dx=-8.947760214067923E-7
New Minimum: -30.226533106269514 > -33.06881320551694
END: th(3628800.0000000005)=-33.06881320551694; dx=-5.896367359391398E-7 evalInputDelta=2.842280099247425
Fitness changed from -30.226533106269514 to -33.06881320551694
Iteration 3 complete. Error: -33.06881320551694 Total: 8.6850; Orientation: 0.0658; Line Search: 5.5535
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 55b5a88c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.028e+04, gradient 7.784e-04, dot -0.787; [27e706a0-5e49-457e-8976-bc0872e3390a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -33.06881320551694, -30.226533106269514, -28.423883496920045, -28.42388200935733
LBFGS Accumulation History: 3 points
Removed measurement 55b5a88c to history. Total: 3
th(0)=-33.06881320551694;dx=-6.047731290639661E-7
New Minimum: -33.06881320551694 > -36.94291370360348
END: th(7818012.603187701)=-36.94291370360348; dx=-3.295869104996732E-7 evalInputDelta=3.8741004980865412
Fitness changed from -33.06881320551694 to -36.94291370360348
Iteration 4 complete. Error: -36.94291370360348 Total: 9.6971; Orientation: 1.2299; Line Search: 5.4457
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5b66366d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.089e+04, gradient 6.923e-04, dot -0.605; [27e706a0-5e49-457e-8976-bc0872e3390a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -36.94291370360348, -30.226533106269514, -28.423883496920045, -28.42388200935733
LBFGS Accumulation History: 3 points
Removed measurement 5b66366d to history. Total: 3
th(0)=-36.94291370360348;dx=-4.781051198415126E-7
New Minimum: -36.94291370360348 > -41.126363057635984
END: th(1.6843397559414055E7)=-41.126363057635984; dx=-1.1283316624671948E-7 evalInputDelta=4.183449354032504
Fitness changed from -36.94291370360348 to -41.126363057635984
Iteration 5 complete. Error: -41.126363057635984 Total: 9.8085; Orientation: 1.1305; Line Search: 5.5243
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2b02cd3a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.046e+04, gradient 7.520e-04, dot -0.340; [27e706a0-5e49-457e-8976-bc0872e3390a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -41.126363057635984, -30.226533106269514, -28.423883496920045, -28.42388200935733
LBFGS Accumulation History: 3 points
Removed measurement 2b02cd3a to history. Total: 3
th(0)=-41.126363057635984;dx=-5.653672221251506E-7
New Minimum: -41.126363057635984 > -42.97002527987862
WOLF (strong): th(3.628800000000001E7)=-42.97002527987862; dx=5.6828962819114755E-8 evalInputDelta=1.843662222242635
New Minimum: -42.97002527987862 > -44.238966873127026
WOLF (strong): th(1.8144000000000004E7)=-44.238966873127026; dx=3.723875709064393E-8 evalInputDelta=3.112603815491042
END: th(6048000.000000001)=-43.74137553547317; dx=-2.2607938464510438E-7 evalInputDelta=2.6150124778371833
Fitness changed from -41.126363057635984 to -44.238966873127026
Iteration 6 complete. Error: -44.238966873127026 Total: 15.2297; Orientation: 1.1451; Line Search: 10.9878
Adding measurement 293bd566 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.341e+04, gradient 7.788e-04, dot -0.271; [27e706a0-5e49-457e-8976-bc0872e3390a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -44.238966873127026, -30.226533106269514, -28.423883496920045, -28.42388200935733
LBFGS Accumulation History: 3 points
Removed measurement 293bd566 to history. Total: 3
th(0)=-44.238966873127026;dx=-6.059765017380594E-7
New Minimum: -44.238966873127026 > -48.295244458146705
WOLF (strong): th(1.3030021005312836E7)=-48.295244458146705; dx=9.915730848210896E-9 evalInputDelta=4.056277585019679
END: th(6515010.502656418)=-47.470171482174976; dx=-2.849502920452034E-7 evalInputDelta=3.23120460904795
Fitness changed from -44.238966873127026 to -48.295244458146705
Iteration 7 complete. Error: -48.295244458146705 Total: 11.6836; Orientation: 1.1053; Line Search: 7.9792
Adding measurement 5c3246d1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.971e+04, gradient 6.480e-04, dot -0.377; [27e706a0-5e49-457e-8976-bc0872e3390a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.295244458146705, -30.226533106269514, -28.423883496920045, -28.42388200935733
LBFGS Accumulation History: 3 points
Removed measurement 5c3246d1 to history. Total: 3
th(0)=-48.295244458146705;dx=-4.193037455888237E-7
New Minimum: -48.295244458146705 > -50.74611272329371
WOLF (strong): th(1.4036164632845048E7)=-50.74611272329371; dx=3.599105748008297E-8 evalInputDelta=2.450868265147008
END: th(7018082.316422524)=-50.4817020380442; dx=-1.5040363287795708E-7 evalInputDelta=2.1864575798974926
Fitness changed from -48.295244458146705 to -50.74611272329371
Iteration 8 complete. Error: -50.74611272329371 Total: 11.9110; Orientation: 1.0762; Line Search: 8.1037
Adding measurement 3d64ebca to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.391e+04, gradient 6.560e-04, dot -0.367; [27e706a0-5e49-457e-8976-bc0872e3390a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -50.74611272329371, -30.226533106269514, -28.423883496920045, -28.42388200935733
LBFGS Accumulation History: 3 points
Removed measurement 3d64ebca to history. Total: 3
th(0)=-50.74611272329371;dx=-4.300149121713586E-7
New Minimum: -50.74611272329371 > -52.77981611728773
WOLF (strong): th(1.5120000000000006E7)=-52.77981611728773; dx=9.44215371537733E-8 evalInputDelta=2.033703393994017
New Minimum: -52.77981611728773 > -52.993568990451955
END: th(7560000.000000003)=-52.993568990451955; dx=-1.053311487268249E-7 evalInputDelta=2.247456267158242
Fitness changed from -50.74611272329371 to -52.993568990451955
Iteration 9 complete. Error: -52.993568990451955 Total: 13.1002; Orientation: 1.2015; Line Search: 9.3035
Adding measurement 21709ab9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.052e+04, gradient 4.653e-04, dot -0.571; [27e706a0-5e49-457e-8976-bc0872e3390a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -52.993568990451955, -30.226533106269514, -28.423883496920045, -28.42388200935733
LBFGS Accumulation History: 3 points
Removed measurement 21709ab9 to history. Total: 3
th(0)=-52.993568990451955;dx=-2.1631389947248638E-7
New Minimum: -52.993568990451955 > -55.00164633589784
END: th(1.6287526256641047E7)=-55.00164633589784; dx=-5.2954667197558454E-8 evalInputDelta=2.0080773454458836
Fitness changed from -52.993568990451955 to -55.00164633589784
Iteration 10 complete. Error: -55.00164633589784 Total: 10.5957; Orientation: 1.1819; Line Search: 5.7009
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -55.00164633589784 (> -Infinity) after 134.993s (< 5400.000s)
Returns
-55.00164633589784