Code from BasicOptimizer.scala:75 executed in 3797.65 seconds (41.623 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1183302540462100
Reset training subject: 1183357065053700
Adding measurement 24e273fd to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=0.9796779429968391;dx=-2.5569680919161877E-7
New Minimum: 0.9796779429968391 > 0.9796777747622792
WOLFE (weak): th(2.154434690031884)=0.9796777747622792; dx=-2.5273252191371075E-7 evalInputDelta=1.6823455983860924E-7
New Minimum: 0.9796777747622792 > 0.9796776313656499
WOLFE (weak): th(4.308869380063768)=0.9796776313656499; dx=-2.5273464727482766E-7 evalInputDelta=3.116311891870893E-7
New Minimum: 0.9796776313656499 > 0.9796768438278771
WOLFE (weak): th(12.926608140191302)=0.9796768438278771; dx=-2.527345421629932E-7 evalInputDelta=1.0991689619599398E-6
New Minimum: 0.9796768438278771 > 0.9796733402292509
WOLFE (weak): th(51.70643256076521)=0.9796733402292509; dx=-2.527337467874943E-7 evalInputDelta=4.602767588179901E-6
New Minimum: 0.9796733402292509 > 0.9796557470570944
WOLFE (weak): th(258.53216280382605)=0.9796557470570944; dx=-2.52733471498675E-7 evalInputDelta=2.219593974472911E-5
New Minimum: 0.9796557470570944 > 0.9795444530711996
WOLFE (weak): th(1551.1929768229563)=0.9795444530711996; dx=-2.527014577656639E-7 evalInputDelta=1.3348992563944062E-4
New Minimum: 0.9795444530711996 > 0.9787436785406276
WOLFE (weak): th(10858.350837760694)=0.9787436785406276; dx=-2.52551298185331E-7 evalInputDelta=9.342644562114755E-4
New Minimum: 0.9787436785406276 > 0.9722407562129844
WOLFE (weak): th(86866.80670208555)=0.9722407562129844; dx=-2.512373176594529E-7 evalInputDelta=0.007437186783854632
New Minimum: 0.9722407562129844 > 0.9161593122661362
WOLFE (weak): th(781801.26031877)=0.9161593122661362; dx=-2.373176190227369E-7 evalInputDelta=0.06351863073070285
New Minimum: 0.9161593122661362 > 0.6204909896271718
END: th(7818012.6031877)=0.6204909896271718; dx=-1.29240829617087E-7 evalInputDelta=0.35918695336966733
Fitness changed from 0.9796779429968391 to 0.6204909896271718
Ite
...skipping 11222 bytes...
-4d1b-86ec-b8a1e4f4044d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.04497328914003239, -0.08871229268564557, -0.12144274038613648, -0.14439062668579775
LBFGS Accumulation History: 3 points
Removed measurement 3c4161d1 to history. Total: 4
th(0)=-0.14439062668579775;dx=-2.109256023911859E-8
Armijo: th(5.482876809705099E7)=0.0684146322701611; dx=1.3774108100404764E-9 evalInputDelta=-0.21280525895595886
New Minimum: -0.14439062668579775 > -0.15365849704202783
END: th(2.7414384048525494E7)=-0.15365849704202783; dx=-5.99645729353567E-9 evalInputDelta=0.009267870356230085
Fitness changed from -0.14439062668579775 to -0.15365849704202783
Iteration 14 complete. Error: -0.15365849704202783 Total: 220.8495; Orientation: 1.4833; Line Search: 164.5307
Adding measurement 44debb87 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.508e+03, gradient 1.578e-04, dot -0.640; [002efe53-9880-4d1b-86ec-b8a1e4f4044d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.08871229268564557, -0.12144274038613648, -0.14439062668579775, -0.15365849704202783
LBFGS Accumulation History: 3 points
Removed measurement 7cf4b9d7 to history. Total: 4
th(0)=-0.15365849704202783;dx=-2.489091899280587E-8
Armijo: th(5.9062500000000045E7)=0.23088482729965928; dx=1.0766026743776552E-8 evalInputDelta=-0.38454332434168714
Armijo: th(2.9531250000000022E7)=-0.12967358626649864; dx=5.285189433946054E-10 evalInputDelta=-0.023984910775529195
New Minimum: -0.15365849704202783 > -0.2026371960739302
END: th(9843750.000000007)=-0.2026371960739302; dx=-1.4242126420886122E-8 evalInputDelta=0.048978699031902356
Fitness changed from -0.15365849704202783 to -0.2026371960739302
Iteration 15 complete. Error: -0.2026371960739302 Total: 271.6059; Orientation: 1.4659; Line Search: 216.6204
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 15: -0.2026371960739302 (> -Infinity) after 3797.643s (< 3600.000s)
-0.2026371960739302