Code from BasicOptimizer.scala:75 executed in 10924.92 seconds (112.385 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 6754809246346
Reset training subject: 6880087179245
Adding measurement 4ba706f6 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=12.271450012922287;dx=-1.82861592133015E-7
New Minimum: 12.271450012922287 > 12.271449990570545
WOLFE (weak): th(2.154434690031884)=12.271449990570545; dx=-1.6947553030398932E-7 evalInputDelta=2.2351741790771484E-8
New Minimum: 12.271449990570545 > 12.271449618041515
WOLFE (weak): th(4.308869380063768)=12.271449618041515; dx=-1.6947555554209855E-7 evalInputDelta=3.948807716369629E-7
New Minimum: 12.271449618041515 > 12.271448522806168
WOLFE (weak): th(12.926608140191302)=12.271448522806168; dx=-1.6947583115430423E-7 evalInputDelta=1.4901161193847656E-6
New Minimum: 12.271448522806168 > 12.271442264318466
WOLFE (weak): th(51.70643256076521)=12.271442264318466; dx=-1.6947602848650187E-7 evalInputDelta=7.748603820800781E-6
New Minimum: 12.271442264318466 > 12.271411262452602
WOLFE (weak): th(258.53216280382605)=12.271411262452602; dx=-1.694755559287015E-7 evalInputDelta=3.875046968460083E-5
New Minimum: 12.271411262452602 > 12.271217793226242
WOLFE (weak): th(1551.1929768229563)=12.271217793226242; dx=-1.694702776028355E-7 evalInputDelta=2.3221969604492188E-4
New Minimum: 12.271217793226242 > 12.269826345145702
WOLFE (weak): th(10858.350837760694)=12.269826345145702; dx=-1.6943419998148507E-7 evalInputDelta=0.0016236677765846252
New Minimum: 12.269826345145702 > 12.25847890228033
WOLFE (weak): th(86866.80670208555)=12.25847890228033; dx=-1.6910984396427853E-7 evalInputDelta=0.01297111064195633
New Minimum: 12.25847890228033 > 12.156056188046932
WOLFE (weak): th(781801.26031877)=12.156056188046932; dx=-1.652705862150579E-7 evalInputDelta=0.11539382487535477
New Minimum: 12.156056188046932 > 11.31770447269082
END: th(7818012.6031877)=11.31770447269082; dx=-1.1799556615522844E-7 evalInputDelta=0.9537455402314663
Fitness changed from 12.271450012922287 to 11.31770447269082
Iteration 1 complete. Error: 11.31770
...skipping 15089 bytes...
: 503.5913; Orientation: 9.7711; Line Search: 372.6393
Adding measurement 27233fe2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.120e+03, gradient 1.326e-04, dot -0.727; [7fcceffe-4a42-45ab-8732-f7c411b700fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from 6.719937730580568, 6.643201969563961, 6.591187667101622, 6.508549623191357
LBFGS Accumulation History: 3 points
Removed measurement 793aab8d to history. Total: 4
th(0)=6.508549623191357;dx=-1.757271316831009E-8
Armijo: th(3.1418839229631666E7)=6.520840361714363; dx=-3.0146507493716525E-9 evalInputDelta=-0.01229073852300644
New Minimum: 6.508549623191357 > 6.467990159988403
END: th(1.5709419614815833E7)=6.467990159988403; dx=-6.531352660754721E-9 evalInputDelta=0.04055946320295334
Fitness changed from 6.508549623191357 to 6.467990159988403
Iteration 19 complete. Error: 6.467990159988403 Total: 503.2226; Orientation: 9.9999; Line Search: 370.7677
Adding measurement 47050a2f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.681e+03, gradient 1.329e-04, dot -0.735; [7fcceffe-4a42-45ab-8732-f7c411b700fd = 1.000/1.000e+00]
Orientation rejected. Popping history element from 6.643201969563961, 6.591187667101622, 6.508549623191357, 6.467990159988403
LBFGS Accumulation History: 3 points
Removed measurement 790f1c0c to history. Total: 4
th(0)=6.467990159988403;dx=-1.7660645555690007E-8
Armijo: th(3.384491857842655E7)=6.482996143400669; dx=8.287940742443997E-10 evalInputDelta=-0.015005983412265778
New Minimum: 6.467990159988403 > 6.407784394919872
END: th(1.6922459289213274E7)=6.407784394919872; dx=-5.8829176739012455E-9 evalInputDelta=0.060205765068531036
Fitness changed from 6.467990159988403 to 6.407784394919872
Iteration 20 complete. Error: 6.407784394919872 Total: 493.4876; Orientation: 9.7139; Line Search: 362.8991
<a id="p-17"></a>Iteration 20
<a id="p-16"></a>
Final threshold in iteration 20: 6.407784394919872 (> -Infinity) after 10924.918s (< 10800.000s)
6.407784394919872