Code from BasicOptimizer.scala:75 executed in 3243.64 seconds (21.492 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 895750759352500
Reset training subject: 895777226875300
Adding measurement 1029cf9 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=8.08339899033308;dx=-3.324981445940626E-6
New Minimum: 8.08339899033308 > 8.083392664790154
WOLFE (weak): th(2.154434690031884)=8.083392664790154; dx=-3.324973733540599E-6 evalInputDelta=6.32554292678833E-6
New Minimum: 8.083392664790154 > 8.083386242389679
WOLFE (weak): th(4.308869380063768)=8.083386242389679; dx=-3.3249718699740407E-6 evalInputDelta=1.274794340133667E-5
New Minimum: 8.083386242389679 > 8.083360768854618
WOLFE (weak): th(12.926608140191302)=8.083360768854618; dx=-3.3249179364635485E-6 evalInputDelta=3.822147846221924E-5
New Minimum: 8.083360768854618 > 8.083246879279613
WOLFE (weak): th(51.70643256076521)=8.083246879279613; dx=-3.324704142447688E-6 evalInputDelta=1.5211105346679688E-4
New Minimum: 8.083246879279613 > 8.082639284431934
WOLFE (weak): th(258.53216280382605)=8.082639284431934; dx=-3.3239114074223345E-6 evalInputDelta=7.597059011459351E-4
New Minimum: 8.082639284431934 > 8.078844875097275
WOLFE (weak): th(1551.1929768229563)=8.078844875097275; dx=-3.319702629327371E-6 evalInputDelta=0.0045541152358055115
New Minimum: 8.078844875097275 > 8.050979062914848
WOLFE (weak): th(10858.350837760694)=8.050979062914848; dx=-3.2927858333212514E-6 evalInputDelta=0.032419927418231964
New Minimum: 8.050979062914848 > 7.836634814739227
WOLFE (weak): th(86866.80670208555)=7.836634814739227; dx=-3.048406681424494E-6 evalInputDelta=0.246764175593853
New Minimum: 7.836634814739227 > 6.440380714833736
END: th(781801.26031877)=6.440380714833736; dx=-1.7477504159433957E-6 evalInputDelta=1.6430182754993439
Fitness changed from 8.08339899033308 to 6.440380714833736
Iteration 1 complete. Error: 6.440380714833736 Total: 342.6988; Orientation: 0.0517; Line Search: 265.3576
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>=-2.5112963020801544;dx=-1.7289436031859582E-9
New Minimum: -2.5112963020801544 > -2.524589516222477
END: th(1.7627561759597164E7)=-2.524589516222477; dx=-1.116434352066889E-9 evalInputDelta=0.01329321414232254
Fitness changed from -2.5112963020801544 to -2.524589516222477
Iteration 29 complete. Error: -2.524589516222477 Total: 80.9454; Orientation: 1.3881; Line Search: 53.0816
Adding measurement 4b56b517 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.065e+03, gradient 4.035e-05, dot -0.840; [5f2fb7a0-7fed-44e8-ade6-1601b23bf887 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.4820514917373657, -2.4970943704247475, -2.5112963020801544, -2.524589516222477
LBFGS Accumulation History: 3 points
Removed measurement 14ca88bc to history. Total: 4
th(0)=-2.524589516222477;dx=-1.628109076795304E-9
New Minimum: -2.524589516222477 > -2.540705591440201
END: th(3.7977430555555604E7)=-2.540705591440201; dx=-7.504431258537563E-10 evalInputDelta=0.016116075217723846
Fitness changed from -2.524589516222477 to -2.540705591440201
Iteration 30 complete. Error: -2.540705591440201 Total: 77.5070; Orientation: 1.4233; Line Search: 50.8385
<a id="p-21"></a>Iteration 30
<a id="p-20"></a>
Final threshold in iteration 31: -2.540705591440201 (> -Infinity) after 3243.639s (< 3600.000s)
-2.540705591440201