Code from BasicOptimizer.scala:75 executed in 68.59 seconds (0.795 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 928118077392500
Reset training subject: 928120639891600
Adding measurement 198e6b32 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=2.205201968550682;dx=-3.002913737339245E-6
New Minimum: 2.205201968550682 > 2.2051994800567627
WOLFE (weak): th(2.154434690031884)=2.2051994800567627; dx=-3.002860753692891E-6 evalInputDelta=2.4884939193725586E-6
New Minimum: 2.2051994800567627 > 2.205196499824524
WOLFE (weak): th(4.308869380063768)=2.205196499824524; dx=-3.0029083647820998E-6 evalInputDelta=5.46872615814209E-6
New Minimum: 2.205196499824524 > 2.2051850631833076
WOLFE (weak): th(12.926608140191302)=2.2051850631833076; dx=-3.002652901787818E-6 evalInputDelta=1.6905367374420166E-5
New Minimum: 2.2051850631833076 > 2.2051346004009247
WOLFE (weak): th(51.70643256076521)=2.2051346004009247; dx=-3.0017011726658492E-6 evalInputDelta=6.736814975738525E-5
New Minimum: 2.2051346004009247 > 2.2048648931086063
WOLFE (weak): th(258.53216280382605)=2.2048648931086063; dx=-3.000399015820579E-6 evalInputDelta=3.3707544207572937E-4
New Minimum: 2.2048648931086063 > 2.2031887769699097
WOLFE (weak): th(1551.1929768229563)=2.2031887769699097; dx=-2.9886280603578606E-6 evalInputDelta=0.0020131915807724
New Minimum: 2.2031887769699097 > 2.1916438937187195
WOLFE (weak): th(10858.350837760694)=2.1916438937187195; dx=-2.7768677324032155E-6 evalInputDelta=0.013558074831962585
New Minimum: 2.1916438937187195 > 2.130658395588398
END: th(86866.80670208555)=2.130658395588398; dx=-1.6458118019753694E-6 evalInputDelta=0.07454357296228409
Fitness changed from 2.205201968550682 to 2.130658395588398
Iteration 1 complete. Error: 2.130658395588398 Total: 29.2435; Orientation: 0.0380; Line Search: 21.8356
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 761fc6bd to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=2.130658395588398;dx=-2.1541218946323637E-6
...skipping 1631 bytes...
Fitness changed from 2.023668557405472 to 1.9969574958086014
Iteration 4 complete. Error: 1.9969574958086014 Total: 7.9905; Orientation: 0.9249; Line Search: 4.7022
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 61c95cd2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.078e+03, gradient 1.296e-03, dot -0.701; [404b4a7b-bea4-4d44-b719-12b8727544db = 1.000/1.000e+00]
Orientation rejected. Popping history element from 2.130658395588398, 2.0611387342214584, 2.023668557405472, 1.9969574958086014
LBFGS Accumulation History: 3 points
Removed measurement 761fc6bd to history. Total: 4
th(0)=1.9969574958086014;dx=-1.6802928798269086E-6
New Minimum: 1.9969574958086014 > 1.866369053721428
END: th(1871488.617712673)=1.866369053721428; dx=-8.429348195585799E-8 evalInputDelta=0.13058844208717346
Fitness changed from 1.9969574958086014 to 1.866369053721428
Iteration 5 complete. Error: 1.866369053721428 Total: 8.1120; Orientation: 0.9499; Line Search: 4.7835
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 40d8c8a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.659e+03, gradient 9.664e-04, dot -0.791; [404b4a7b-bea4-4d44-b719-12b8727544db = 1.000/1.000e+00]
Orientation rejected. Popping history element from 2.0611387342214584, 2.023668557405472, 1.9969574958086014, 1.866369053721428
LBFGS Accumulation History: 3 points
Removed measurement 57acd3b5 to history. Total: 4
th(0)=1.866369053721428;dx=-9.33860378672503E-7
New Minimum: 1.866369053721428 > 1.5193275660276413
END: th(4032000.0000000014)=1.5193275660276413; dx=-3.970250465438383E-8 evalInputDelta=0.3470414876937866
Fitness changed from 1.866369053721428 to 1.5193275660276413
Iteration 6 complete. Error: 1.5193275660276413 Total: 7.9184; Orientation: 0.9150; Line Search: 4.6005
Final threshold in iteration 7: 1.5193275660276413 (> -Infinity) after 68.585s (< 720.000s)
1.5193275660276413