BasicOptimizer.scala:89 executed in 151.39 seconds (2.878 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 462228291633300
Reset training subject: 462231238227000
Adding measurement 257485fe to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-104.18705963485777;dx=-1.542090038626561E-5
New Minimum: -104.18705963485777 > -104.18708630090633
END: th(2.154434690031884)=-104.18708630090633; dx=-1.2206278897416774E-5 evalInputDelta=2.6666048555057387E-5
Fitness changed from -104.18705963485777 to -104.18708630090633
Iteration 1 complete. Error: -104.18708630090633 Total: 14.1349; Orientation: 0.1046; Line Search: 5.7171
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 29b4b234 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-104.18708630090633;dx=-1.2215924818250798E-5
New Minimum: -104.18708630090633 > -104.18715029939501
WOLFE (weak): th(4.641588833612779)=-104.18715029939501; dx=-1.219981457426146E-5 evalInputDelta=6.399848868454683E-5
New Minimum: -104.18715029939501 > -104.18720896464177
WOLFE (weak): th(9.283177667225559)=-104.18720896464177; dx=-1.2192404731645594E-5 evalInputDelta=1.2266373543923237E-4
New Minimum: -104.18720896464177 > -104.18744362529847
WOLFE (weak): th(27.849533001676676)=-104.18744362529847; dx=-1.2181870612350157E-5 evalInputDelta=3.5732439214086753E-4
New Minimum: -104.18744362529847 > -104.18852092425777
WOLFE (weak): th(111.3981320067067)=-104.18852092425777; dx=-1.213482934135417E-5 evalInputDelta=0.001434623351443065
New Minimum: -104.18852092425777 > -104.19422722307786
WOLFE (weak): th(556.9906600335335)=-104.19422722307786; dx=-1.2177727385110622E-5 evalInputDelta=0.007140922171529951
New Minimum: -104.19422722307786 > -104.22991383339874
WOLFE (weak): th(3341.9439602012008)=-104.22991383339874; dx=-1.2171159454768373E-5 evalInputDelta=0.042827532492410114
New Minimum: -104.22991383339874 > -104.48621790036734
WOLFE (weak): th(23393.607721408407)=-104.48621790036734; dx=-1.211883177019042E-5 evalInputDelta=0.2991315994610062
New Minimum: -104.48621790036734 > -106.53624313996254
WOLFE (weak): th(187148.86177126726)=-106.53624313996254; dx=-1.1670608707922817E-5 evalInputDelta=2.3491568390562065
New Minimum: -106.53624313996254 > -121.56329267493703
END: th(1684339.7559414054)=-121.56329267493703; dx=-7.447504337417352E-6 evalInputDelta=17.3762063740307
Fitness changed from -104.18708630090633 to -121.56329267493703
Iteration 2 complete. Error: -121.56329267493703 Total: 32.0100; Orientation: 0.0925; Line Search: 28.3564
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 1f768adc to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-121.56329267493703;dx=-7.668738502600164E-6
New Minimum: -121.56329267493703 > -140.67233608320007
END: th(3628800.0000000005)=-140.67233608320007; dx=-3.170018714974091E-6 evalInputDelta=19.109043408263034
Fitness changed from -121.56329267493703 to -140.67233608320007
Iteration 3 complete. Error: -140.67233608320007 Total: 8.8936; Orientation: 0.0917; Line Search: 5.4685
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 23b19f2d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.273e+03, gradient 2.226e-03, dot -0.515; [05a6b7d0-76aa-4ebe-ab1e-111aad7076cd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -140.67233608320007, -121.56329267493703, -104.18708630090633, -104.18705963485777
LBFGS Accumulation History: 3 points
Removed measurement 23b19f2d to history. Total: 3
th(0)=-140.67233608320007;dx=-4.928574060812201E-6
New Minimum: -140.67233608320007 > -157.88709861173712
END: th(7818012.603187701)=-157.88709861173712; dx=-6.189119503932625E-7 evalInputDelta=17.21476252853705
Fitness changed from -140.67233608320007 to -157.88709861173712
Iteration 4 complete. Error: -157.88709861173712 Total: 11.2338; Orientation: 1.8278; Line Search: 5.7814
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5837c3dc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.305e+03, gradient 2.473e-03, dot -0.270; [05a6b7d0-76aa-4ebe-ab1e-111aad7076cd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -157.88709861173712, -121.56329267493703, -104.18708630090633, -104.18705963485777
LBFGS Accumulation History: 3 points
Removed measurement 5837c3dc to history. Total: 3
th(0)=-157.88709861173712;dx=-6.116692881924074E-6
Armijo: th(1.6843397559414055E7)=-151.98224290756855; dx=1.7282968521515251E-6 evalInputDelta=-5.904855704168568
New Minimum: -157.88709861173712 > -168.5245579165719
WOLF (strong): th(8421698.779707028)=-168.5245579165719; dx=1.3369219270762373E-6 evalInputDelta=10.637459304834778
New Minimum: -168.5245579165719 > -169.88543045917478
END: th(2807232.926569009)=-169.88543045917478; dx=-2.167540938860804E-6 evalInputDelta=11.998331847437669
Fitness changed from -157.88709861173712 to -169.88543045917478
Iteration 5 complete. Error: -169.88543045917478 Total: 16.9080; Orientation: 1.8194; Line Search: 11.6837
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1ee55cb5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.817e+04, gradient 1.734e-03, dot -0.543; [05a6b7d0-76aa-4ebe-ab1e-111aad7076cd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -169.88543045917478, -121.56329267493703, -104.18708630090633, -104.18705963485777
LBFGS Accumulation History: 3 points
Removed measurement 1ee55cb5 to history. Total: 3
th(0)=-169.88543045917478;dx=-2.9979081463384187E-6
New Minimum: -169.88543045917478 > -180.64441335790022
END: th(6048000.000000001)=-180.64441335790022; dx=-8.908650679178663E-7 evalInputDelta=10.758982898725435
Fitness changed from -169.88543045917478 to -180.64441335790022
Iteration 6 complete. Error: -180.64441335790022 Total: 11.0164; Orientation: 1.7837; Line Search: 5.9584
Adding measurement 28986060 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.191e+04, gradient 1.892e-03, dot -0.452; [05a6b7d0-76aa-4ebe-ab1e-111aad7076cd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -180.64441335790022, -121.56329267493703, -104.18708630090633, -104.18705963485777
LBFGS Accumulation History: 3 points
Removed measurement 28986060 to history. Total: 3
th(0)=-180.64441335790022;dx=-3.5808797532596677E-6
New Minimum: -180.64441335790022 > -183.1728104365663
WOLF (strong): th(1.3030021005312836E7)=-183.1728104365663; dx=8.953750635750974E-7 evalInputDelta=2.5283970786660745
New Minimum: -183.1728104365663 > -188.47976953990482
WOLF (strong): th(6515010.502656418)=-188.47976953990482; dx=2.1418949329399405E-7 evalInputDelta=7.8353561820046025
END: th(2171670.167552139)=-186.49611723628064; dx=-1.6958979705753151E-6 evalInputDelta=5.85170387838042
Fitness changed from -180.64441335790022 to -188.47976953990482
Iteration 7 complete. Error: -188.47976953990482 Total: 16.2154; Orientation: 1.7219; Line Search: 11.7779
Adding measurement 39e83141 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.380e+04, gradient 2.100e-03, dot -0.357; [05a6b7d0-76aa-4ebe-ab1e-111aad7076cd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -188.47976953990482, -121.56329267493703, -104.18708630090633, -104.18705963485777
LBFGS Accumulation History: 3 points
Removed measurement 39e83141 to history. Total: 3
th(0)=-188.47976953990482;dx=-4.395489047944366E-6
New Minimum: -188.47976953990482 > -198.70786110642314
END: th(4678721.544281682)=-198.70786110642314; dx=-1.3045020592437341E-8 evalInputDelta=10.228091566518316
Fitness changed from -188.47976953990482 to -198.70786110642314
Iteration 8 complete. Error: -198.70786110642314 Total: 10.5841; Orientation: 1.7181; Line Search: 5.7983
Adding measurement 6b81e957 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.081e+04, gradient 1.694e-03, dot -0.473; [05a6b7d0-76aa-4ebe-ab1e-111aad7076cd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -198.70786110642314, -121.56329267493703, -104.18708630090633, -104.18705963485777
LBFGS Accumulation History: 3 points
Removed measurement 6b81e957 to history. Total: 3
th(0)=-198.70786110642314;dx=-2.8683717734281213E-6
New Minimum: -198.70786110642314 > -203.01085169019882
WOLF (strong): th(1.0080000000000002E7)=-203.01085169019882; dx=7.918165569648918E-7 evalInputDelta=4.302990583775681
New Minimum: -203.01085169019882 > -205.7367100572835
END: th(5040000.000000001)=-205.7367100572835; dx=-1.8677829057400636E-7 evalInputDelta=7.02884895086035
Fitness changed from -198.70786110642314 to -205.7367100572835
Iteration 9 complete. Error: -205.7367100572835 Total: 13.1105; Orientation: 1.7898; Line Search: 8.6341
Adding measurement 5f4142b0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.461e+04, gradient 1.658e-03, dot -0.472; [05a6b7d0-76aa-4ebe-ab1e-111aad7076cd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -205.7367100572835, -121.56329267493703, -104.18708630090633, -104.18705963485777
LBFGS Accumulation History: 3 points
Removed measurement 5f4142b0 to history. Total: 3
th(0)=-205.7367100572835;dx=-2.7480313942566916E-6
New Minimum: -205.7367100572835 > -208.24389491186201
WOLF (strong): th(1.0858350837760696E7)=-208.24389491186201; dx=8.794346705172962E-7 evalInputDelta=2.507184854578526
New Minimum: -208.24389491186201 > -212.10479596259594
WOLF (strong): th(5429175.418880348)=-212.10479596259594; dx=6.414356650235624E-8 evalInputDelta=6.368085905312455
END: th(1809725.1396267826)=-209.8048649240147; dx=-1.6257363545487085E-6 evalInputDelta=4.06815486673122
Fitness changed from -205.7367100572835 to -212.10479596259594
Iteration 10 complete. Error: -212.10479596259594 Total: 16.5488; Orientation: 1.8324; Line Search: 12.0248
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -212.10479596259594 (> -Infinity) after 151.394s (< 5400.000s)
Returns
-212.10479596259594