Code from BasicOptimizer.scala:75 executed in 775.30 seconds (6.231 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 955377236683300
Reset training subject: 955411122747300
Adding measurement d4af791 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=6.422117002308369;dx=-1.6348596569468478E-4
New Minimum: 6.422117002308369 > 6.422088108956814
WOLFE (weak): th(2.154434690031884)=6.422088108956814; dx=-1.6342863709178235E-4 evalInputDelta=2.8893351554870605E-5
New Minimum: 6.422088108956814 > 6.4220592230558395
WOLFE (weak): th(4.308869380063768)=6.4220592230558395; dx=-1.633862913447557E-4 evalInputDelta=5.777925252914429E-5
New Minimum: 6.4220592230558395 > 6.421943664550781
WOLFE (weak): th(12.926608140191302)=6.421943664550781; dx=-1.631890615482207E-4 evalInputDelta=1.7333775758743286E-4
New Minimum: 6.421943664550781 > 6.421420395374298
WOLFE (weak): th(51.70643256076521)=6.421420395374298; dx=-1.6277174160345852E-4 evalInputDelta=6.966069340705872E-4
New Minimum: 6.421420395374298 > 6.418648689985275
WOLFE (weak): th(258.53216280382605)=6.418648689985275; dx=-1.6177005001276397E-4 evalInputDelta=0.0034683123230934143
New Minimum: 6.418648689985275 > 6.397552765905857
WOLFE (weak): th(1551.1929768229563)=6.397552765905857; dx=-1.5633521442574603E-4 evalInputDelta=0.024564236402511597
New Minimum: 6.397552765905857 > 6.145088665187359
END: th(10858.350837760694)=6.145088665187359; dx=-9.604007200480337E-5 evalInputDelta=0.2770283371210098
Fitness changed from 6.422117002308369 to 6.145088665187359
Iteration 1 complete. Error: 6.145088665187359 Total: 371.4986; Orientation: 0.0075; Line Search: 270.4718
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5c33dee0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=6.145088665187359;dx=-1.2518907290164156E-4
New Minimum: 6.145088665187359 > 5.973409071564674
END: th(23393.607721408407)=5.973409071564674; dx=-5.8307809586758726E-5 evalInputDelta=0.17167959362268448
Fitness changed fro
...skipping 657 bytes...
049 Total: 100.5915; Orientation: 0.0079; Line Search: 66.9606
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 386395f8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.653e+02, gradient 9.579e-03, dot -0.714; [6930a038-9a29-4e5e-9b31-7c566d4e04ac = 1.000/1.000e+00]
Orientation rejected. Popping history element from 6.422117002308369, 6.145088665187359, 5.973409071564674, 5.716076798737049
LBFGS Accumulation History: 3 points
Removed measurement d4af791 to history. Total: 4
th(0)=5.716076798737049;dx=-9.176675218936207E-5
New Minimum: 5.716076798737049 > 5.640158664435148
END: th(108583.50837760697)=5.640158664435148; dx=-1.2566283536179163E-5 evalInputDelta=0.07591813430190086
Fitness changed from 5.716076798737049 to 5.640158664435148
Iteration 4 complete. Error: 5.640158664435148 Total: 100.5655; Orientation: 0.2268; Line Search: 67.0363
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 290f45b3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.168e+02, gradient 7.439e-03, dot -0.776; [6930a038-9a29-4e5e-9b31-7c566d4e04ac = 1.000/1.000e+00]
Orientation rejected. Popping history element from 6.145088665187359, 5.973409071564674, 5.716076798737049, 5.640158664435148
LBFGS Accumulation History: 3 points
Removed measurement 5c33dee0 to history. Total: 4
th(0)=5.640158664435148;dx=-5.533916828772069E-5
New Minimum: 5.640158664435148 > 5.177161760628223
END: th(233936.07721408413)=5.177161760628223; dx=-3.5040462747149955E-6 evalInputDelta=0.4629969038069248
Fitness changed from 5.640158664435148 to 5.177161760628223
Iteration 5 complete. Error: 5.177161760628223 Total: 101.0631; Orientation: 0.2198; Line Search: 67.3655
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Final threshold in iteration 5: 5.177161760628223 (> -Infinity) after 775.295s (< 720.000s)
5.177161760628223