Code from BasicOptimizer.scala:75 executed in 1589.67 seconds (2.674 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 850446232973300
Reset training subject: 850464588279000
Adding measurement 25a290ee to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=4.501152798141138;dx=-1.3222908947526814E-7
New Minimum: 4.501152798141138 > 4.501152587765988
WOLFE (weak): th(2.154434690031884)=4.501152587765988; dx=-1.3222899409264374E-7 evalInputDelta=2.103751501891793E-7
New Minimum: 4.501152587765988 > 4.5011523249653465
WOLFE (weak): th(4.308869380063768)=4.5011523249653465; dx=-1.3222887426083602E-7 evalInputDelta=4.7317579188188574E-7
New Minimum: 4.5011523249653465 > 4.501151025420677
WOLFE (weak): th(12.926608140191302)=4.501151025420677; dx=-1.3222882519687186E-7 evalInputDelta=1.772720461090671E-6
New Minimum: 4.501151025420677 > 4.501146002868795
WOLFE (weak): th(51.70643256076521)=4.501146002868795; dx=-1.3222842350223695E-7 evalInputDelta=6.795272343040892E-6
New Minimum: 4.501146002868795 > 4.501118587951117
WOLFE (weak): th(258.53216280382605)=4.501118587951117; dx=-1.3222441053099335E-7 evalInputDelta=3.421019002125547E-5
New Minimum: 4.501118587951117 > 4.500948097208063
WOLFE (weak): th(1551.1929768229563)=4.500948097208063; dx=-1.3220565723947727E-7 evalInputDelta=2.047009330752303E-4
New Minimum: 4.500948097208063 > 4.499721004096425
WOLFE (weak): th(10858.350837760694)=4.499721004096425; dx=-1.32084128098376E-7 evalInputDelta=0.001431794044713719
New Minimum: 4.499721004096425 > 4.489734475753406
WOLFE (weak): th(86866.80670208555)=4.489734475753406; dx=-1.3108781727977645E-7 evalInputDelta=0.011418322387732438
New Minimum: 4.489734475753406 > 4.401403315930306
WOLFE (weak): th(781801.26031877)=4.401403315930306; dx=-1.2237354397791088E-7 evalInputDelta=0.09974948221083224
New Minimum: 4.401403315930306 > 3.7159570483299227
END: th(7818012.6031877)=3.7159570483299227; dx=-7.502478704591283E-8 evalInputDelta=0.7851957498112156
Fitness changed from 4.501152798141138 to 3.7159570483299227
Iteration 1 complete. Error
...skipping 15211 bytes...
1e+04, gradient 8.903e-05, dot -0.349; [59d8a4c6-f5a2-43ba-9f46-93bafda84a6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.8023562228222658, 0.7809288601131779, 0.7400330331006121, 0.6946230519183942
LBFGS Accumulation History: 3 points
Removed measurement 3e753289 to history. Total: 4
th(0)=0.6946230519183942;dx=-7.925587183767563E-9
Armijo: th(1.8851303537778997E8)=2.9773232815103206; dx=1.797247996559359E-8 evalInputDelta=-2.282700229591926
Armijo: th(9.425651768889499E7)=1.5233608170072117; dx=1.1238601823295545E-8 evalInputDelta=-0.8287377650888175
Armijo: th(3.1418839229631662E7)=0.7724001692553488; dx=8.026800306053009E-9 evalInputDelta=-0.07777711733695458
New Minimum: 0.6946230519183942 > 0.6599527921403656
END: th(7854709.807407916)=0.6599527921403656; dx=-1.6157865472310476E-9 evalInputDelta=0.03467025977802862
Fitness changed from 0.6946230519183942 to 0.6599527921403656
Iteration 19 complete. Error: 0.6599527921403656 Total: 111.7632; Orientation: 1.8436; Line Search: 91.6739
Adding measurement 1e477944 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.260e+04, gradient 3.371e-05, dot -0.808; [59d8a4c6-f5a2-43ba-9f46-93bafda84a6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.7809288601131779, 0.7400330331006121, 0.6946230519183942, 0.6599527921403656
LBFGS Accumulation History: 3 points
Removed measurement 5ad6f98e to history. Total: 4
th(0)=0.6599527921403656;dx=-1.1365664653857187E-9
New Minimum: 0.6599527921403656 > 0.6460024989768336
END: th(1.692245928921327E7)=0.6460024989768336; dx=-8.42711915758744E-10 evalInputDelta=0.013950293163532024
Fitness changed from 0.6599527921403656 to 0.6460024989768336
Iteration 20 complete. Error: 0.6460024989768336 Total: 56.7276; Orientation: 1.8548; Line Search: 36.6235
<a id="p-17"></a>Iteration 20
<a id="p-16"></a>
Final threshold in iteration 21: 0.6460024989768336 (> -Infinity) after 1589.673s (< 3600.000s)
0.6460024989768336