Code from BasicOptimizer.scala:75 executed in 11400.45 seconds (212.789 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 713778720827800
Reset training subject: 714100228033300
Adding measurement 533cd9aa to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-8.297001473605633;dx=-8.228917937310192E-7
New Minimum: -8.297001473605633 > -8.297001548111439
WOLFE (weak): th(2.154434690031884)=-8.297001548111439; dx=-8.055975616644868E-7 evalInputDelta=7.450580596923828E-8
New Minimum: -8.297001548111439 > -8.297001875936985
WOLFE (weak): th(4.308869380063768)=-8.297001875936985; dx=-8.055973976606113E-7 evalInputDelta=4.023313522338867E-7
New Minimum: -8.297001875936985 > -8.297004155814648
WOLFE (weak): th(12.926608140191302)=-8.297004155814648; dx=-8.055962829339543E-7 evalInputDelta=2.682209014892578E-6
New Minimum: -8.297004155814648 > -8.297014132142067
WOLFE (weak): th(51.70643256076521)=-8.297014132142067; dx=-8.055930105052303E-7 evalInputDelta=1.2658536434173584E-5
New Minimum: -8.297014132142067 > -8.297064777463675
WOLFE (weak): th(258.53216280382605)=-8.297064777463675; dx=-8.05578488884847E-7 evalInputDelta=6.33038580417633E-5
New Minimum: -8.297064777463675 > -8.297381367534399
WOLFE (weak): th(1551.1929768229563)=-8.297381367534399; dx=-8.054972944558549E-7 evalInputDelta=3.798939287662506E-4
New Minimum: -8.297381367534399 > -8.299659579992294
WOLFE (weak): th(10858.350837760694)=-8.299659579992294; dx=-8.051020001241113E-7 evalInputDelta=0.0026581063866615295
New Minimum: -8.299659579992294 > -8.318201057612896
WOLFE (weak): th(86866.80670208555)=-8.318201057612896; dx=-8.0136068571243E-7 evalInputDelta=0.021199584007263184
New Minimum: -8.318201057612896 > -8.481738556176424
WOLFE (weak): th(781801.26031877)=-8.481738556176424; dx=-7.641738635730178E-7 evalInputDelta=0.18473708257079124
New Minimum: -8.481738556176424 > -9.596477881073952
END: th(7818012.6031877)=-9.596477881073952; dx=-4.7573029287599225E-7 evalInputDelta=1.299476407468319
Fitness changed from -8.297001473605633 to -9.596477881073952
Iteration 1
...skipping 3321 bytes...
p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4c41ffc3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.515e+04, gradient 5.232e-04, dot -0.762; [49b055d8-3fdd-4abe-8561-560f113506dd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -10.797328814864159, -11.077431667596102, -11.562508385628462, -11.641605086624622
LBFGS Accumulation History: 3 points
Removed measurement 6d6e930e to history. Total: 4
th(0)=-11.641605086624622;dx=-2.7375356931600047E-7
Armijo: th(6.048000000000001E7)=-9.757040426135063; dx=-8.5360492988962E-8 evalInputDelta=-1.8845646604895592
Armijo: th(3.0240000000000004E7)=-11.548150271177292; dx=-1.2511585812400674E-7 evalInputDelta=-0.09345481544733047
New Minimum: -11.641605086624622 > -11.892054505646229
END: th(1.0080000000000002E7)=-11.892054505646229; dx=-1.885817111462121E-7 evalInputDelta=0.25044941902160645
Fitness changed from -11.641605086624622 to -11.892054505646229
Iteration 6 complete. Error: -11.892054505646229 Total: 1529.3483; Orientation: 17.6557; Line Search: 1209.9648
Adding measurement 1fa40bb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.151e+04, gradient 4.561e-04, dot -0.931; [49b055d8-3fdd-4abe-8561-560f113506dd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -11.077431667596102, -11.562508385628462, -11.641605086624622, -11.892054505646229
LBFGS Accumulation History: 3 points
Removed measurement 62e2e64a to history. Total: 4
th(0)=-11.892054505646229;dx=-2.0803148527235987E-7
New Minimum: -11.892054505646229 > -12.02832429856062
END: th(2.1716701675521392E7)=-12.02832429856062; dx=-1.2943105672135711E-7 evalInputDelta=0.13626979291439056
Fitness changed from -11.892054505646229 to -12.02832429856062
Iteration 7 complete. Error: -12.02832429856062 Total: 916.1168; Orientation: 17.4665; Line Search: 599.2538
Final threshold in iteration 7: -12.02832429856062 (> -Infinity) after 11400.441s (< 10800.000s)
-12.02832429856062