Code from BasicOptimizer.scala:75 executed in 3837.67 seconds (41.209 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1267685036132000
Reset training subject: 1267739326129800
Adding measurement 689f9dc8 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=1.0210350478870907;dx=-2.6649306569322876E-7
New Minimum: 1.0210350478870907 > 1.0210349312155134
WOLFE (weak): th(2.154434690031884)=1.0210349312155134; dx=-2.627367021093041E-7 evalInputDelta=1.1667157728822986E-7
New Minimum: 1.0210349312155134 > 1.021034691442283
WOLFE (weak): th(4.308869380063768)=1.021034691442283; dx=-2.627366434240603E-7 evalInputDelta=3.564448076698312E-7
New Minimum: 1.021034691442283 > 1.0210339538348039
WOLFE (weak): th(12.926608140191302)=1.0210339538348039; dx=-2.627358524965298E-7 evalInputDelta=1.0940522867652902E-6
New Minimum: 1.0210339538348039 > 1.0210304586545558
WOLFE (weak): th(51.70643256076521)=1.0210304586545558; dx=-2.6273686980967483E-7 evalInputDelta=4.589232534879528E-6
New Minimum: 1.0210304586545558 > 1.0210117564509633
WOLFE (weak): th(258.53216280382605)=1.0210117564509633; dx=-2.627388595984518E-7 evalInputDelta=2.3291436127337306E-5
New Minimum: 1.0210117564509633 > 1.0208951136831392
WOLFE (weak): th(1551.1929768229563)=1.0208951136831392; dx=-2.6270306647191307E-7 evalInputDelta=1.3993420395141953E-4
New Minimum: 1.0208951136831392 > 1.0200558792906318
WOLFE (weak): th(10858.350837760694)=1.0200558792906318; dx=-2.6251654093522564E-7 evalInputDelta=9.79168596458857E-4
New Minimum: 1.0200558792906318 > 1.0132424753934803
WOLFE (weak): th(86866.80670208555)=1.0132424753934803; dx=-2.6091670194127387E-7 evalInputDelta=0.007792572493610317
New Minimum: 1.0132424753934803 > 0.9545158336842557
WOLFE (weak): th(781801.26031877)=0.9545158336842557; dx=-2.4647300578056194E-7 evalInputDelta=0.06651921420283491
New Minimum: 0.9545158336842557 > 0.6487432015699808
END: th(7818012.6031877)=0.6487432015699808; dx=-1.2957610582178174E-7 evalInputDelta=0.3722918463171099
Fitness changed from 1.0210350478870907 to 0.6487432015699808
...skipping 11144 bytes...
9280-56fe2d23327f = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.04116976338085665, -0.028363168367727704, -0.06996877513286466, -0.09869711425069876
LBFGS Accumulation History: 3 points
Removed measurement 4b06009d to history. Total: 4
th(0)=-0.09869711425069876;dx=-2.0644549549236706E-8
Armijo: th(5.482876809705099E7)=0.08385750797311821; dx=3.637420476588378E-11 evalInputDelta=-0.18255462222381696
New Minimum: -0.09869711425069876 > -0.11616307880322915
END: th(2.7414384048525494E7)=-0.11616307880322915; dx=-7.039453945781063E-9 evalInputDelta=0.017465964552530397
Fitness changed from -0.09869711425069876 to -0.11616307880322915
Iteration 14 complete. Error: -0.11616307880322915 Total: 221.2202; Orientation: 1.4930; Line Search: 165.7279
Adding measurement 6a03c039 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.389e+03, gradient 1.516e-04, dot -0.666; [aaee4110-5764-4c27-9280-56fe2d23327f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.028363168367727704, -0.06996877513286466, -0.09869711425069876, -0.11616307880322915
LBFGS Accumulation History: 3 points
Removed measurement 19518325 to history. Total: 4
th(0)=-0.11616307880322915;dx=-2.2983748553716242E-8
Armijo: th(5.9062500000000045E7)=0.2014554210052832; dx=7.014076812244746E-9 evalInputDelta=-0.3176184998085123
Armijo: th(2.9531250000000022E7)=-0.10628770763579261; dx=-2.010568364841294E-9 evalInputDelta=-0.009875371167436545
New Minimum: -0.11616307880322915 > -0.16165152954069578
END: th(9843750.000000007)=-0.16165152954069578; dx=-1.4178476686902375E-8 evalInputDelta=0.04548845073746663
Fitness changed from -0.11616307880322915 to -0.16165152954069578
Iteration 15 complete. Error: -0.16165152954069578 Total: 270.1595; Orientation: 1.5119; Line Search: 215.7620
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 15: -0.16165152954069578 (> -Infinity) after 3837.661s (< 3600.000s)
-0.16165152954069578