Code from BasicOptimizer.scala:75 executed in 1554.55 seconds (12.248 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 935849805363400
Reset training subject: 935872108955200
Adding measurement e9b4d1c to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=3.8756728302687407;dx=-1.809283974475219E-5
New Minimum: 3.8756728302687407 > 3.8756410032510757
WOLFE (weak): th(2.154434690031884)=3.8756410032510757; dx=-1.8096134896006933E-5 evalInputDelta=3.182701766490936E-5
New Minimum: 3.8756410032510757 > 3.875608941540122
WOLFE (weak): th(4.308869380063768)=3.875608941540122; dx=-1.8096025555157458E-5 evalInputDelta=6.388872861862183E-5
New Minimum: 3.875608941540122 > 3.875481877475977
WOLFE (weak): th(12.926608140191302)=3.875481877475977; dx=-1.8080083612868246E-5 evalInputDelta=1.9095279276371002E-4
New Minimum: 3.875481877475977 > 3.874910172075033
WOLFE (weak): th(51.70643256076521)=3.874910172075033; dx=-1.8090959274543627E-5 evalInputDelta=7.626581937074661E-4
New Minimum: 3.874910172075033 > 3.8716269321739674
END: th(258.53216280382605)=3.8716269321739674; dx=-3.2758073138691335E-6 evalInputDelta=0.0040458980947732925
Fitness changed from 3.8756728302687407 to 3.8716269321739674
Iteration 1 complete. Error: 3.8716269321739674 Total: 203.0972; Orientation: 0.0039; Line Search: 135.4554
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6b39ce4b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=3.8716269321739674;dx=-0.0012913748856858284
Armijo: th(556.9906600335335)=3.8761056661605835; dx=-8.482466281517193E-6 evalInputDelta=-0.004478733986616135
Armijo: th(278.49533001676673)=3.871670790016651; dx=-2.413123349797845E-6 evalInputDelta=-4.3857842683792114E-5
Armijo: th(92.83177667225557)=3.872138876467943; dx=-2.161047771654649E-4 evalInputDelta=-5.119442939758301E-4
Armijo: th(23.207944168063893)=3.871634155511856; dx=-3.656450565949111E-6 evalInputDelta=-7.223337888717651E-6
New Minimum: 3.8716269321739674 > 3.8712345715612173
END:
...skipping 10866 bytes...
1795.3622416932371)=3.678654495626688; dx=-1.0066930774860592E-5 evalInputDelta=0.01374870166182518
Fitness changed from 3.692403197288513 to 3.678654495626688
Iteration 13 complete. Error: 3.678654495626688 Total: 68.0863; Orientation: 0.1060; Line Search: 45.4575
Adding measurement 12aab86e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.570e+01, gradient 3.049e-03, dot -0.852; [73d7dc14-3dcc-4a19-b45e-0d558f1c85a1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.6968729589134455, 3.69516440294683, 3.692403197288513, 3.678654495626688
LBFGS Accumulation History: 3 points
Removed measurement 805228 to history. Total: 4
th(0)=3.678654495626688;dx=-9.293527017422006E-6
New Minimum: 3.678654495626688 > 3.6595658026635647
END: th(3867.9906946773176)=3.6595658026635647; dx=-7.394863562298044E-6 evalInputDelta=0.01908869296312332
Fitness changed from 3.678654495626688 to 3.6595658026635647
Iteration 14 complete. Error: 3.6595658026635647 Total: 67.5943; Orientation: 0.1066; Line Search: 45.0303
Adding measurement 26a58c69 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.067e+01, gradient 2.630e-03, dot -0.993; [73d7dc14-3dcc-4a19-b45e-0d558f1c85a1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.69516440294683, 3.692403197288513, 3.678654495626688, 3.6595658026635647
LBFGS Accumulation History: 3 points
Removed measurement 1e426346 to history. Total: 4
th(0)=3.6595658026635647;dx=-6.917701695225105E-6
New Minimum: 3.6595658026635647 > 3.630563858896494
END: th(8333.333333333338)=3.630563858896494; dx=-2.212336966688959E-6 evalInputDelta=0.02900194376707077
Fitness changed from 3.6595658026635647 to 3.630563858896494
Iteration 15 complete. Error: 3.630563858896494 Total: 67.6458; Orientation: 0.1093; Line Search: 45.0561
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: 3.630563858896494 (> -Infinity) after 1554.554s (< 1800.000s)
3.630563858896494