Code from BasicOptimizer.scala:75 executed in 178.80 seconds (2.626 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 730897456737600
Reset training subject: 730900289919700
Adding measurement 26837057 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=9.189195111393929;dx=-2.6776429053219713E-5
New Minimum: 9.189195111393929 > 9.18909353017807
WOLFE (weak): th(2.154434690031884)=9.18909353017807; dx=-2.677418129208701E-5 evalInputDelta=1.0158121585845947E-4
New Minimum: 9.18909353017807 > 9.188992232084274
WOLFE (weak): th(4.308869380063768)=9.188992232084274; dx=-2.6764839235533793E-5 evalInputDelta=2.0287930965423584E-4
New Minimum: 9.188992232084274 > 9.188585601747036
WOLFE (weak): th(12.926608140191302)=9.188585601747036; dx=-2.6783013394172884E-5 evalInputDelta=6.095096468925476E-4
New Minimum: 9.188585601747036 > 9.186756946146488
WOLFE (weak): th(51.70643256076521)=9.186756946146488; dx=-2.6780870349159325E-5 evalInputDelta=0.002438165247440338
New Minimum: 9.186756946146488 > 9.177006393671036
WOLFE (weak): th(258.53216280382605)=9.177006393671036; dx=-2.6716196248657343E-5 evalInputDelta=0.012188717722892761
New Minimum: 9.177006393671036 > 9.115592680871487
WOLFE (weak): th(1551.1929768229563)=9.115592680871487; dx=-2.655336939366773E-5 evalInputDelta=0.07360243052244186
New Minimum: 9.115592680871487 > 8.70523401349783
END: th(10858.350837760694)=8.70523401349783; dx=-2.3945033614803922E-5 evalInputDelta=0.4839610978960991
Fitness changed from 9.189195111393929 to 8.70523401349783
Iteration 1 complete. Error: 8.70523401349783 Total: 32.5378; Orientation: 0.0140; Line Search: 23.3476
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 40113163 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=8.70523401349783;dx=-2.227783722979215E-5
New Minimum: 8.70523401349783 > 7.874908968806267
END: th(23393.607721408407)=7.874908968806267; dx=-1.8196486806910483E-5 evalInputDelta=0.8303250446915627
Fitness changed from 8.705234013497
...skipping 10097 bytes...
ot -0.668; [1c5f6227-3f02-4ca5-b35e-85b6922ab4d1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.7930246144533157, -0.9247310757637024, -1.0127795785665512, -1.0833276510238647
LBFGS Accumulation History: 3 points
Removed measurement 5cff6b74 to history. Total: 4
th(0)=-1.0833276510238647;dx=-7.883383139958258E-8
Armijo: th(2436834.13764671)=-1.0184704065322876; dx=5.3489316288847173E-8 evalInputDelta=-0.06485724449157715
New Minimum: -1.0833276510238647 > -1.1414366960525513
WOLF (strong): th(1218417.068823355)=-1.1414366960525513; dx=1.7577077820815174E-8 evalInputDelta=0.05810904502868652
END: th(406139.02294111834)=-1.1309171169996262; dx=-4.3074374810345905E-8 evalInputDelta=0.047589465975761414
Fitness changed from -1.0833276510238647 to -1.1414366960525513
Iteration 14 complete. Error: -1.1414366960525513 Total: 14.1370; Orientation: 0.0679; Line Search: 11.3484
Adding measurement 3d53e6f7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.874e+02, gradient 3.156e-04, dot -0.609; [1c5f6227-3f02-4ca5-b35e-85b6922ab4d1 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.9247310757637024, -1.0127795785665512, -1.0833276510238647, -1.1414366960525513
LBFGS Accumulation History: 3 points
Removed measurement 750f64fe to history. Total: 4
th(0)=-1.1414366960525513;dx=-9.944792308225052E-8
New Minimum: -1.1414366960525513 > -1.2091663181781769
WOLF (strong): th(875000.0000000005)=-1.2091663181781769; dx=9.753075500317702E-9 evalInputDelta=0.06772962212562561
END: th(437500.00000000023)=-1.200744390487671; dx=-3.845628559619821E-8 evalInputDelta=0.05930769443511963
Fitness changed from -1.1414366960525513 to -1.2091663181781769
Iteration 15 complete. Error: -1.2091663181781769 Total: 12.0277; Orientation: 0.0705; Line Search: 9.2433
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: -1.2091663181781769 (> -Infinity) after 178.789s (< 3600.000s)
-1.2091663181781769