Code from BasicOptimizer.scala:75 executed in 328.79 seconds (10.246 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 774819260715
Reset training subject: 776958990591
Adding measurement 7c6c848b to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=1.5220458838025022;dx=-7.428285941665106E-10
New Minimum: 1.5220458838025022 > 1.5220458822021263
WOLFE (weak): th(2.154434690031884)=1.5220458822021263; dx=-7.428285910973314E-10 evalInputDelta=1.6003758318561268E-9
New Minimum: 1.5220458822021263 > 1.5220458806017507
WOLFE (weak): th(4.308869380063768)=1.5220458806017507; dx=-7.428285880281523E-10 evalInputDelta=3.2007514416676486E-9
New Minimum: 1.5220458806017507 > 1.522045874200248
WOLFE (weak): th(12.926608140191302)=1.522045874200248; dx=-7.428285757514355E-10 evalInputDelta=9.60225410295834E-9
New Minimum: 1.522045874200248 > 1.522045845393487
WOLFE (weak): th(51.70643256076521)=1.522045845393487; dx=-7.428285312865541E-10 evalInputDelta=3.8409015079565734E-8
New Minimum: 1.522045845393487 > 1.5220456917573781
WOLFE (weak): th(258.53216280382605)=1.5220456917573781; dx=-7.428291346165162E-10 evalInputDelta=1.9204512402559715E-7
New Minimum: 1.5220456917573781 > 1.522044731528717
WOLFE (weak): th(1551.1929768229563)=1.522044731528717; dx=-7.42835678944054E-10 evalInputDelta=1.1522737850544473E-6
New Minimum: 1.522044731528717 > 1.522037817637247
WOLFE (weak): th(10858.350837760694)=1.522037817637247; dx=-7.42883648653555E-10 evalInputDelta=8.066165255060653E-6
New Minimum: 1.522037817637247 > 1.5219813395157256
WOLFE (weak): th(86866.80670208555)=1.5219813395157256; dx=-7.432227209498127E-10 evalInputDelta=6.454428677660218E-5
New Minimum: 1.5219813395157256 > 1.5214638656604775
WOLFE (weak): th(781801.26031877)=1.5214638656604775; dx=-7.460180516392563E-10 evalInputDelta=5.820181420246318E-4
New Minimum: 1.5214638656604775 > 1.5161284894813036
WOLFE (weak): th(7818012.6031877)=1.5161284894813036; dx=-7.687443308750501E-10 evalInputDelta=0.0059173943211985325
New Minimum: 1.5161284894813036 > 1.455814237676782
WOLFE (weak): th(8.599813863506469E7)=
...skipping 42595 bytes...
utDelta=2.3176332313091564E-6
Fitness changed from 3.5737731522061296E-5 to 3.2685073442307984E-5
Iteration 48 complete. Error: 3.2685073442307984E-5 Total: 6.5350; Orientation: 1.5829; Line Search: 3.8415
Adding measurement 63fdfe0d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.839e+02, gradient 8.508e-08, dot -0.824; [49175934-466c-4337-b56d-a880db6bd62d = 1.000/1.000e+00]
Orientation rejected. Popping history element from 4.5159806570036345E-5, 3.885629684956895E-5, 3.5737731522061296E-5, 3.2685073442307984E-5
LBFGS Accumulation History: 3 points
Removed measurement 42130b57 to history. Total: 4
th(0)=3.2685073442307984E-5;dx=-7.239285881563816E-15
New Minimum: 3.2685073442307984E-5 > 3.072853087815513E-5
END: th(3.867990694677316E8)=3.072853087815513E-5; dx=-2.914427042944524E-15 evalInputDelta=1.9565425641528527E-6
Fitness changed from 3.2685073442307984E-5 to 3.072853087815513E-5
Iteration 49 complete. Error: 3.072853087815513E-5 Total: 5.3346; Orientation: 1.5848; Line Search: 2.6140
Adding measurement 3e16b1b3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.174e+02, gradient 7.056e-08, dot -0.878; [49175934-466c-4337-b56d-a880db6bd62d = 1.000/1.000e+00]
Orientation rejected. Popping history element from 3.885629684956895E-5, 3.5737731522061296E-5, 3.2685073442307984E-5, 3.072853087815513E-5
LBFGS Accumulation History: 3 points
Removed measurement 55096eed to history. Total: 4
th(0)=3.072853087815513E-5;dx=-4.9785836304188574E-15
New Minimum: 3.072853087815513E-5 > 2.8110501312778602E-5
END: th(8.333333333333334E8)=2.8110501312778602E-5; dx=-1.3628417483667013E-15 evalInputDelta=2.6180295653765288E-6
Fitness changed from 3.072853087815513E-5 to 2.8110501312778602E-5
Iteration 50 complete. Error: 2.8110501312778602E-5 Total: 6.5332; Orientation: 1.5815; Line Search: 3.8473
<a id="p-29"></a>Iteration 50
<a id="p-28"></a>
Final threshold in iteration 51: 2.8110501312778602E-5 (> -Infinity) after 328.790s (< 3600.000s)
2.8110501312778602E-5