Code from BasicOptimizer.scala:75 executed in 3743.60 seconds (38.324 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1329248103312500
Reset training subject: 1329293554025600
Adding measurement 713e7d9a to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=10.631475880742073;dx=-6.276915835404005E-5
New Minimum: 10.631475880742073 > 10.631407314911485
WOLFE (weak): th(2.154434690031884)=10.631407314911485; dx=-6.257142238055879E-5 evalInputDelta=6.856583058834076E-5
New Minimum: 10.631407314911485 > 10.631339000537992
WOLFE (weak): th(4.308869380063768)=10.631339000537992; dx=-6.257045030783798E-5 evalInputDelta=1.3688020408153534E-4
New Minimum: 10.631339000537992 > 10.631065215915442
WOLFE (weak): th(12.926608140191302)=10.631065215915442; dx=-6.254905944268232E-5 evalInputDelta=4.10664826631546E-4
New Minimum: 10.631065215915442 > 10.629833895713091
WOLFE (weak): th(51.70643256076521)=10.629833895713091; dx=-6.251214955205625E-5 evalInputDelta=0.0016419850289821625
New Minimum: 10.629833895713091 > 10.623195692896843
WOLFE (weak): th(258.53216280382605)=10.623195692896843; dx=-6.21436194322467E-5 evalInputDelta=0.008280187845230103
New Minimum: 10.623195692896843 > 10.580998782068491
WOLFE (weak): th(1551.1929768229563)=10.580998782068491; dx=-6.030989462801649E-5 evalInputDelta=0.05047709867358208
New Minimum: 10.580998782068491 > 10.316910346969962
END: th(10858.350837760694)=10.316910346969962; dx=-4.91678680997029E-5 evalInputDelta=0.31456553377211094
Fitness changed from 10.631475880742073 to 10.316910346969962
Iteration 1 complete. Error: 10.316910346969962 Total: 496.9251; Orientation: 0.0274; Line Search: 361.1531
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2f0cab82 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=10.316910346969962;dx=-4.543160035845924E-5
New Minimum: 10.316910346969962 > 9.88465692102909
END: th(23393.607721408407)=9.88465692102909; dx=-2.7922925748123838E-5 evalInputDelta=0.43225342594087124
Fitn
...skipping 14762 bytes...
surement 615c4ea4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.879e+02, gradient 1.465e-03, dot -0.713; [b2cfdbea-020a-4580-bf72-ed3d2c3e11c6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 6.478293655440211, 6.388057377189398, 6.28479977324605, 6.184415444731712
LBFGS Accumulation History: 3 points
Removed measurement 470c4229 to history. Total: 4
th(0)=6.184415444731712;dx=-2.1461684253513107E-6
New Minimum: 6.184415444731712 > 6.143894139677286
WOLF (strong): th(392735.4903703959)=6.143894139677286; dx=9.270467802044025E-8 evalInputDelta=0.04052130505442619
New Minimum: 6.143894139677286 > 6.121691072359681
END: th(196367.74518519794)=6.121691072359681; dx=-2.919355731502914E-7 evalInputDelta=0.06272437237203121
Fitness changed from 6.184415444731712 to 6.121691072359681
Iteration 19 complete. Error: 6.121691072359681 Total: 185.8213; Orientation: 0.8275; Line Search: 138.8560
Adding measurement 13d10057 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.371e+02, gradient 1.735e-03, dot -0.584; [b2cfdbea-020a-4580-bf72-ed3d2c3e11c6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 6.388057377189398, 6.28479977324605, 6.184415444731712, 6.121691072359681
LBFGS Accumulation History: 3 points
Removed measurement 492fa72a to history. Total: 4
th(0)=6.121691072359681;dx=-3.011604400740834E-6
Armijo: th(423061.48223033187)=6.138781189918518; dx=6.13237797314222E-7 evalInputDelta=-0.017090117558836937
New Minimum: 6.121691072359681 > 6.053950320929289
END: th(211530.74111516593)=6.053950320929289; dx=-1.4738927572768006E-7 evalInputDelta=0.06774075143039227
Fitness changed from 6.121691072359681 to 6.053950320929289
Iteration 20 complete. Error: 6.053950320929289 Total: 186.6729; Orientation: 0.8157; Line Search: 139.0654
<a id="p-17"></a>Iteration 20
<a id="p-16"></a>
Final threshold in iteration 20: 6.053950320929289 (> -Infinity) after 3743.597s (< 3600.000s)
6.053950320929289