Code from BasicOptimizer.scala:75 executed in 5663.18 seconds (277.522 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1394558626624200
Reset training subject: 1394720704113200
Adding measurement 589cc8eb to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=6.096919845789671;dx=-3.62561004792003E-6
New Minimum: 6.096919845789671 > 6.0969168692827225
WOLFE (weak): th(2.154434690031884)=6.0969168692827225; dx=-3.5818896045821517E-6 evalInputDelta=2.9765069484710693E-6
New Minimum: 6.0969168692827225 > 6.096913367509842
WOLFE (weak): th(4.308869380063768)=6.096913367509842; dx=-3.5818745868825934E-6 evalInputDelta=6.4782798290252686E-6
New Minimum: 6.096913367509842 > 6.003735587000847
WOLFE (weak): th(12.926608140191302)=6.003735587000847; dx=-3.581799928883876E-6 evalInputDelta=0.09318425878882408
WOLFE (weak): th(51.70643256076521)=6.096843793988228; dx=-3.5814352013318796E-6 evalInputDelta=7.605180144309998E-5
WOLFE (weak): th(258.53216280382605)=6.096540339291096; dx=-3.580849158184213E-6 evalInputDelta=3.7950649857521057E-4
WOLFE (weak): th(1551.1929768229563)=6.0946443118155; dx=-3.5769488317136776E-6 evalInputDelta=0.002275533974170685
WOLFE (weak): th(10858.350837760694)=6.081048306077719; dx=-3.548164602631958E-6 evalInputDelta=0.01587153971195221
New Minimum: 6.003735587000847 > 5.983915604650974
END: th(86866.80670208555)=5.983915604650974; dx=-2.8904310307303707E-6 evalInputDelta=0.11300424113869667
Fitness changed from 6.096919845789671 to 5.983915604650974
Iteration 1 complete. Error: 5.983915604650974 Total: 1905.1909; Orientation: 0.2594; Line Search: 1425.1008
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 309ac89e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=5.983915604650974;dx=-2.7028050657804793E-6
New Minimum: 5.983915604650974 > 5.804772932082415
END: th(187148.86177126726)=5.804772932082415; dx=-2.1359388606782287E-6 evalInputDelta=0.17914267256855965
Fitness changed from 5.983915604650974 to 5.8047729320824
...skipping 3369 bytes...
rement 5122387 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.111e+03, gradient 1.058e-03, dot -0.592; [f02fd6a3-fadb-471f-b4f1-f2eb50533dae = 1.000/1.000e+00]
Orientation rejected. Popping history element from 5.549082450568676, 5.211487762629986, 4.772534057497978, 4.239217013120651
LBFGS Accumulation History: 3 points
Removed measurement 2bb03136 to history. Total: 4
th(0)=4.239217013120651;dx=-1.118635756736116E-6
New Minimum: 4.239217013120651 > 3.9821069166064262
END: th(8686680.670208558)=3.9821069166064262; dx=-4.76510978929599E-8 evalInputDelta=0.257110096514225
Fitness changed from 4.239217013120651 to 3.9821069166064262
Iteration 7 complete. Error: 3.9821069166064262 Total: 488.5960; Orientation: 5.8045; Line Search: 329.6861
Adding measurement 13231e7b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.206e+04, gradient 1.574e-03, dot -0.487; [f02fd6a3-fadb-471f-b4f1-f2eb50533dae = 1.000/1.000e+00]
Orientation rejected. Popping history element from 5.211487762629986, 4.772534057497978, 4.239217013120651, 3.9821069166064262
LBFGS Accumulation History: 3 points
Removed measurement 452ea8f0 to history. Total: 4
th(0)=3.9821069166064262;dx=-2.4761922791443727E-6
Armijo: th(1.871488617712673E7)=6.017211928963661; dx=2.398786990703666E-7 evalInputDelta=-2.035105012357235
Armijo: th(9357443.088563366)=4.358494099229574; dx=1.4598527270080295E-7 evalInputDelta=-0.37638718262314796
New Minimum: 3.9821069166064262 > 3.61765955388546
WOLF (strong): th(3119147.6961877886)=3.61765955388546; dx=9.460010279129474E-8 evalInputDelta=0.36444736272096634
New Minimum: 3.61765955388546 > 3.6004474759101868
END: th(779786.9240469472)=3.6004474759101868; dx=-5.472678539721856E-7 evalInputDelta=0.38165944069623947
Fitness changed from 3.9821069166064262 to 3.6004474759101868
Iteration 8 complete. Error: 3.6004474759101868 Total: 933.1129; Orientation: 5.8584; Line Search: 771.5992
Final threshold in iteration 8: 3.6004474759101868 (> -Infinity) after 5663.166s (< 5400.000s)
3.6004474759101868