Code from BasicOptimizer.scala:75 executed in 466.02 seconds (5.349 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 3827393919114
Reset training subject: 3829093475885
Adding measurement 79c14b8e to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=1.0034573563781166;dx=-9.741047280018185E-8
New Minimum: 1.0034573563781166 > 1.0034571793996068
WOLFE (weak): th(2.154434690031884)=1.0034571793996068; dx=-9.741019106721093E-8 evalInputDelta=1.7697850984710328E-7
New Minimum: 1.0034571793996068 > 1.0034570024229514
WOLFE (weak): th(4.308869380063768)=1.0034570024229514; dx=-9.740997196547568E-8 evalInputDelta=3.5395516517766623E-7
New Minimum: 1.0034570024229514 > 1.0034562945212142
WOLFE (weak): th(12.926608140191302)=1.0034562945212142; dx=-9.740941755874964E-8 evalInputDelta=1.061856902406788E-6
New Minimum: 1.0034562945212142 > 1.0034531088957448
WOLFE (weak): th(51.70643256076521)=1.0034531088957448; dx=-9.741204645794607E-8 evalInputDelta=4.247482371821931E-6
New Minimum: 1.0034531088957448 > 1.0034361141273458
WOLFE (weak): th(258.53216280382605)=1.0034361141273458; dx=-9.74446892849337E-8 evalInputDelta=2.124225077082542E-5
New Minimum: 1.0034361141273458 > 1.0033298406645705
WOLFE (weak): th(1551.1929768229563)=1.0033298406645705; dx=-9.749874260773527E-8 evalInputDelta=1.2751571354607805E-4
New Minimum: 1.0033298406645705 > 1.0025622928789166
WOLFE (weak): th(10858.350837760694)=1.0025622928789166; dx=-9.767607856463695E-8 evalInputDelta=8.950634991999884E-4
New Minimum: 1.0025622928789166 > 0.9961464503027777
WOLFE (weak): th(86866.80670208555)=0.9961464503027777; dx=-9.920178546974306E-8 evalInputDelta=0.007310906075338908
New Minimum: 0.9961464503027777 > 0.9455982220985519
END: th(781801.26031877)=0.9455982220985519; dx=-6.138410256198734E-8 evalInputDelta=0.05785913427956468
Fitness changed from 1.0034573563781166 to 0.9455982220985519
Iteration 1 complete. Error: 0.9455982220985519 Total: 24.3513; Orientation: 0.0725; Line Search: 19.0253
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>=0.2863397593385234;dx=-2.004592042185285E-9
New Minimum: 0.2863397593385234 > 0.2855018480128086
END: th(9133772.298307233)=0.2855018480128086; dx=-1.4559143425150062E-10 evalInputDelta=8.37911325714813E-4
Fitness changed from 0.2863397593385234 to 0.2855018480128086
Iteration 49 complete. Error: 0.2855018480128086 Total: 7.2107; Orientation: 1.6138; Line Search: 3.8394
Adding measurement 6a1acef6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.015e+03, gradient 5.865e-05, dot -0.522; [902ec7a7-3eb7-4b15-b39e-c9d644a72e2b = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.2911936739317844, 0.2898903514947684, 0.2863397593385234, 0.2855018480128086
LBFGS Accumulation History: 3 points
Removed measurement 1b9320bd to history. Total: 4
th(0)=0.2855018480128086;dx=-3.440161286606967E-9
Armijo: th(1.967811589032535E7)=0.31182858862489304; dx=1.5723261030864362E-9 evalInputDelta=-0.026326740612084454
Armijo: th(9839057.945162674)=0.2892891097998386; dx=1.1279075306446577E-9 evalInputDelta=-0.003787261787029983
New Minimum: 0.2855018480128086 > 0.2817737385532054
END: th(3279685.9817208913)=0.2817737385532054; dx=-9.261649815449653E-10 evalInputDelta=0.0037281094596031683
Fitness changed from 0.2855018480128086 to 0.2817737385532054
Iteration 50 complete. Error: 0.2817737385532054 Total: 11.0644; Orientation: 1.6116; Line Search: 7.6967
<a id="p-29"></a>Iteration 50
<a id="p-28"></a>
Final threshold in iteration 51: 0.2817737385532054 (> -Infinity) after 466.017s (< 3600.000s)
0.2817737385532054