Code from BasicOptimizer.scala:75 executed in 903.62 seconds (5.882 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 959120555712400
Reset training subject: 959170845731500
Adding measurement d014fb4 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=3.856253743171692;dx=-7.620531706644023E-5
New Minimum: 3.856253743171692 > 3.8561351895332336
WOLFE (weak): th(2.154434690031884)=3.8561351895332336; dx=-7.621380388674841E-5 evalInputDelta=1.1855363845825195E-4
New Minimum: 3.8561351895332336 > 3.856016620993614
WOLFE (weak): th(4.308869380063768)=3.856016620993614; dx=-7.619274844783663E-5 evalInputDelta=2.3712217807769775E-4
New Minimum: 3.856016620993614 > 3.85554239153862
WOLFE (weak): th(12.926608140191302)=3.85554239153862; dx=-7.615910256205587E-5 evalInputDelta=7.113516330718994E-4
New Minimum: 3.85554239153862 > 3.8534121811389923
WOLFE (weak): th(51.70643256076521)=3.8534121811389923; dx=-7.604335060186152E-5 evalInputDelta=0.002841562032699585
New Minimum: 3.8534121811389923 > 3.842134326696396
WOLFE (weak): th(258.53216280382605)=3.842134326696396; dx=-7.530451174156843E-5 evalInputDelta=0.01411941647529602
New Minimum: 3.842134326696396 > 3.7741397619247437
WOLFE (weak): th(1551.1929768229563)=3.7741397619247437; dx=-7.042064732738227E-5 evalInputDelta=0.08211398124694824
New Minimum: 3.7741397619247437 > 3.4176610857248306
END: th(10858.350837760694)=3.4176610857248306; dx=-3.6381092916383805E-5 evalInputDelta=0.43859265744686127
Fitness changed from 3.856253743171692 to 3.4176610857248306
Iteration 1 complete. Error: 3.4176610857248306 Total: 552.8734; Orientation: 0.1731; Line Search: 402.8503
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5b7a5033 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=3.4176610857248306;dx=-4.0699182270411754E-5
New Minimum: 3.4176610857248306 > 2.9947709441184998
END: th(23393.607721408407)=2.9947709441184998; dx=-1.290970857002003E-5 evalInputDelta=0.42289014160633087
Fitness changed from 3.4176610857248306 to 2.9947709441184998
Iteration 2 complete. Error: 2.9947709441184998 Total: 150.2420; Orientation: 0.0624; Line Search: 100.0623
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 667c70e3 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=2.9947709441184998;dx=-4.357312831365632E-5
New Minimum: 2.9947709441184998 > 2.849335104227066
WOLF (strong): th(50400.00000000001)=2.849335104227066; dx=1.1779313218263142E-7 evalInputDelta=0.14543583989143372
New Minimum: 2.849335104227066 > 2.8250955641269684
END: th(25200.000000000004)=2.8250955641269684; dx=-2.869009334890852E-6 evalInputDelta=0.16967537999153137
Fitness changed from 2.9947709441184998 to 2.8250955641269684
Iteration 3 complete. Error: 2.8250955641269684 Total: 200.4471; Orientation: 0.0669; Line Search: 150.6817
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Final threshold in iteration 3: 2.8250955641269684 (> -Infinity) after 903.615s (< 720.000s)
2.8250955641269684