Code from BasicOptimizer.scala:75 executed in 2483.75 seconds (21.138 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1377669389359400
Reset training subject: 1377700145736400
Adding measurement 5c79c5ec to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=8.641171421855688;dx=-2.7616502552478203E-4
New Minimum: 8.641171421855688 > 8.641017325222492
END: th(2.154434690031884)=8.641017325222492; dx=-1.1624485139019572E-4 evalInputDelta=1.5409663319587708E-4
Fitness changed from 8.641171421855688 to 8.641017325222492
Iteration 1 complete. Error: 8.641017325222492 Total: 153.0826; Orientation: 0.0276; Line Search: 61.2863
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 68df8c6 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=8.641017325222492;dx=-5.8325410840805205E-5
New Minimum: 8.641017325222492 > 8.640938624739647
END: th(4.641588833612779)=8.640938624739647; dx=-1.5070796010327138E-5 evalInputDelta=7.87004828453064E-5
Fitness changed from 8.641017325222492 to 8.640938624739647
Iteration 2 complete. Error: 8.640938624739647 Total: 91.7187; Orientation: 0.0274; Line Search: 61.0578
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4470106b to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=8.640938624739647;dx=-2.705539231937969E-5
New Minimum: 8.640938624739647 > 8.640814058482647
END: th(10.000000000000002)=8.640814058482647; dx=-1.9412156445820647E-5 evalInputDelta=1.2456625699996948E-4
Fitness changed from 8.640938624739647 to 8.640814058482647
Iteration 3 complete. Error: 8.640814058482647 Total: 91.6605; Orientation: 0.0274; Line Search: 61.0294
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1d556461 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.286e-01, gradient 5.831e-03, dot -0.792; [51df5979-3325-4197-8fbd-d0a8f83a8d26 = 1.000/1.000e+00]
Orie
...skipping 14264 bytes...
2083.333333333335)=5.74535908550024; dx=-1.4176005762990477E-6 evalInputDelta=0.0018058829009532928
Fitness changed from 5.747164968401194 to 5.744672480970621
Iteration 18 complete. Error: 5.744672480970621 Total: 213.9839; Orientation: 0.8018; Line Search: 182.6163
Adding measurement 27dc81be to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.130e+02, gradient 3.199e-03, dot -0.333; [51df5979-3325-4197-8fbd-d0a8f83a8d26 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 6.1636610850691795, 5.909230437129736, 5.747164968401194, 5.744672480970621
LBFGS Accumulation History: 3 points
Removed measurement 615c4ea4 to history. Total: 4
th(0)=5.744672480970621;dx=-1.0234030373358124E-5
New Minimum: 5.744672480970621 > 5.739224907010794
END: th(4488.405604233095)=5.739224907010794; dx=-2.5284017945588204E-6 evalInputDelta=0.005447573959827423
Fitness changed from 5.744672480970621 to 5.739224907010794
Iteration 19 complete. Error: 5.739224907010794 Total: 92.5155; Orientation: 0.7928; Line Search: 61.1086
Adding measurement 7846913f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.756e+02, gradient 1.987e-03, dot -0.420; [51df5979-3325-4197-8fbd-d0a8f83a8d26 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 5.909230437129736, 5.747164968401194, 5.744672480970621, 5.739224907010794
LBFGS Accumulation History: 3 points
Removed measurement 1468e880 to history. Total: 4
th(0)=5.739224907010794;dx=-3.94779601973658E-6
New Minimum: 5.739224907010794 > 5.727726895362139
END: th(9669.976736693297)=5.727726895362139; dx=-3.276075275874188E-6 evalInputDelta=0.011498011648654938
Fitness changed from 5.739224907010794 to 5.727726895362139
Iteration 20 complete. Error: 5.727726895362139 Total: 91.6433; Orientation: 0.7885; Line Search: 60.7580
<a id="p-17"></a>Iteration 20
<a id="p-16"></a>
Final threshold in iteration 21: 5.727726895362139 (> -Infinity) after 2483.748s (< 3600.000s)
5.727726895362139