Code from BasicOptimizer.scala:75 executed in 5422.05 seconds (82.399 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1509580176832300
Reset training subject: 1509659928519200
Adding measurement 47e02a89 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=3.9188938632221464;dx=-2.3563811282249984E-6
New Minimum: 3.9188938632221464 > 3.91889377864277
WOLFE (weak): th(2.154434690031884)=3.91889377864277; dx=-2.3559548627675905E-6 evalInputDelta=8.457937639150259E-8
New Minimum: 3.91889377864277 > 3.9188933164125856
WOLFE (weak): th(4.308869380063768)=3.9188933164125856; dx=-2.3559481610827567E-6 evalInputDelta=5.468095607419343E-7
New Minimum: 3.9188933164125856 > 3.918890379184088
WOLFE (weak): th(12.926608140191302)=3.918890379184088; dx=-2.3559272830789474E-6 evalInputDelta=3.4840380584988395E-6
New Minimum: 3.918890379184088 > 3.918877713955338
WOLFE (weak): th(51.70643256076521)=3.918877713955338; dx=-2.3559250241215872E-6 evalInputDelta=1.6149266808263008E-5
New Minimum: 3.918877713955338 > 3.9188126449105156
WOLFE (weak): th(258.53216280382605)=3.9188126449105156; dx=-2.355664953384303E-6 evalInputDelta=8.121831163077076E-5
New Minimum: 3.9188126449105156 > 3.918407699536109
WOLFE (weak): th(1551.1929768229563)=3.918407699536109; dx=-2.353333683294134E-6 evalInputDelta=4.861636860375995E-4
New Minimum: 3.918407699536109 > 3.915499916222482
WOLFE (weak): th(10858.350837760694)=3.915499916222482; dx=-2.3387738576106454E-6 evalInputDelta=0.0033939469996644434
New Minimum: 3.915499916222482 > 3.892493245873967
WOLFE (weak): th(86866.80670208555)=3.892493245873967; dx=-2.2173074324855496E-6 evalInputDelta=0.026400617348179445
New Minimum: 3.892493245873967 > 3.748773920409992
END: th(781801.26031877)=3.748773920409992; dx=-9.874622635251747E-7 evalInputDelta=0.17011994281215426
Fitness changed from 3.9188938632221464 to 3.748773920409992
Iteration 1 complete. Error: 3.748773920409992 Total: 1035.6375; Orientation: 0.1938; Line Search: 797.8486
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>=2.8924916784604267;dx=-1.553544844101929E-6
Armijo: th(1624556.0917644731)=2.925879263303622; dx=8.775680961158763E-7 evalInputDelta=-0.033387584843195484
New Minimum: 2.8924916784604267 > 2.844218810513031
WOLF (strong): th(812278.0458822366)=2.844218810513031; dx=3.413300226965225E-7 evalInputDelta=0.048272867947395603
END: th(270759.34862741217)=2.85216161731319; dx=-7.039080739962523E-7 evalInputDelta=0.040330061147236584
Fitness changed from 2.8924916784604267 to 2.844218810513031
Iteration 14 complete. Error: 2.844218810513031 Total: 401.6545; Orientation: 5.7689; Line Search: 319.2662
Adding measurement 70290678 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.328e+04, gradient 7.811e-04, dot -0.658; [466b6f6c-33dd-47af-a08b-ae040e41b90d = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.0158920005986176, 2.939063364667472, 2.8924916784604267, 2.844218810513031
LBFGS Accumulation History: 3 points
Removed measurement b41ceac to history. Total: 4
th(0)=2.844218810513031;dx=-6.101197431111364E-7
New Minimum: 2.844218810513031 > 2.809755891717432
END: th(583333.3333333335)=2.809755891717432; dx=-3.153164845790541E-7 evalInputDelta=0.03446291879559915
Fitness changed from 2.844218810513031 to 2.809755891717432
Iteration 15 complete. Error: 2.809755891717432 Total: 245.1931; Orientation: 5.8040; Line Search: 159.5709
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 15: 2.809755891717432 (> -Infinity) after 5422.045s (< 5400.000s)
2.809755891717432