Code from BasicOptimizer.scala:75 executed in 1804.97 seconds (10.343 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 731223464266500
Reset training subject: 731249531236800
Adding measurement 6537ac to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=3.3670832365751266;dx=-2.650234076735295E-7
New Minimum: 3.3670832365751266 > 3.367082327604294
WOLFE (weak): th(2.154434690031884)=3.367082327604294; dx=-2.615796351863072E-7 evalInputDelta=9.08970832824707E-7
New Minimum: 3.367082327604294 > 3.3670809268951416
WOLFE (weak): th(4.308869380063768)=3.3670809268951416; dx=-2.615820401227948E-7 evalInputDelta=2.3096799850463867E-6
New Minimum: 3.3670809268951416 > 3.3670766055583954
WOLFE (weak): th(12.926608140191302)=3.3670766055583954; dx=-2.6158657938487656E-7 evalInputDelta=6.631016731262207E-6
New Minimum: 3.3670766055583954 > 3.367057040333748
WOLFE (weak): th(51.70643256076521)=3.367057040333748; dx=-2.615993387408038E-7 evalInputDelta=2.619624137878418E-5
New Minimum: 3.367057040333748 > 3.3669521659612656
WOLFE (weak): th(258.53216280382605)=3.3669521659612656; dx=-2.6157324113528083E-7 evalInputDelta=1.3107061386108398E-4
New Minimum: 3.3669521659612656 > 3.366297721862793
WOLFE (weak): th(1551.1929768229563)=3.366297721862793; dx=-2.616237218353305E-7 evalInputDelta=7.855147123336792E-4
New Minimum: 3.366297721862793 > 3.3615853637456894
WOLFE (weak): th(10858.350837760694)=3.3615853637456894; dx=-2.6144848938721076E-7 evalInputDelta=0.005497872829437256
New Minimum: 3.3615853637456894 > 3.323210284113884
WOLFE (weak): th(86866.80670208555)=3.323210284113884; dx=-2.599694119252383E-7 evalInputDelta=0.043872952461242676
New Minimum: 3.323210284113884 > 2.985652819275856
WOLFE (weak): th(781801.26031877)=2.985652819275856; dx=-2.389260788941E-7 evalInputDelta=0.38143041729927063
New Minimum: 2.985652819275856 > 1.0129020512104034
END: th(7818012.6031877)=1.0129020512104034; dx=-7.450527348505146E-8 evalInputDelta=2.354181185364723
Fitness changed from 3.3670832365751266 to 1.0129020512104034
Iteration 1 complete. Erro
...skipping 11107 bytes...
dot -0.814; [4ecf4dca-ce60-4ad6-ba9b-55daeacc25ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.9136145859956741, -1.9347404167056084, -1.96402607858181, -1.988739013671875
LBFGS Accumulation History: 3 points
Removed measurement 4adf3582 to history. Total: 4
th(0)=-1.988739013671875;dx=-1.5582510500504715E-9
New Minimum: -1.988739013671875 > -2.0192785784602165
END: th(2.4368341376467105E7)=-2.0192785784602165; dx=-1.6692525544704471E-10 evalInputDelta=0.030539564788341522
Fitness changed from -1.988739013671875 to -2.0192785784602165
Iteration 14 complete. Error: -2.0192785784602165 Total: 77.6912; Orientation: 0.6692; Line Search: 52.0412
Adding measurement 46b6701e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.036e+03, gradient 6.886e-05, dot -0.450; [4ecf4dca-ce60-4ad6-ba9b-55daeacc25ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.9347404167056084, -1.96402607858181, -1.988739013671875, -2.0192785784602165
LBFGS Accumulation History: 3 points
Removed measurement 1c7f6e96 to history. Total: 4
th(0)=-2.0192785784602165;dx=-4.7410374093071165E-9
Armijo: th(5.250000000000004E7)=-1.5819574519991875; dx=5.687753156802461E-9 evalInputDelta=-0.43732112646102905
Armijo: th(2.625000000000002E7)=-1.895937368273735; dx=4.947338823946336E-9 evalInputDelta=-0.12334121018648148
New Minimum: -2.0192785784602165 > -2.0373101383447647
WOLF (strong): th(8750000.000000006)=-2.0373101383447647; dx=1.5419340637467075E-9 evalInputDelta=0.018031559884548187
END: th(2187500.0000000014)=-2.034358114004135; dx=-2.5612926318186102E-9 evalInputDelta=0.01507953554391861
Fitness changed from -2.0192785784602165 to -2.0373101383447647
Iteration 15 complete. Error: -2.0373101383447647 Total: 157.8015; Orientation: 0.6601; Line Search: 132.0580
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: -2.0373101383447647 (> -Infinity) after 1804.966s (< 3600.000s)
-2.0373101383447647