Code from BasicOptimizer.scala:75 executed in 3764.02 seconds (25.755 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
IterativeTrainer.wrap(trainable)
.setOrientation(orientation())
.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = trainingMonitor.log(msg)
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable, currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable, currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
.setTimeout(trainingMinutes, TimeUnit.MINUTES)
.setMaxIterations(trainingIterations)
.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
.runAndFree
.asInstanceOf[lang.Double]
Reset training subject: 1199098292681900
Reset training subject: 1199153126561600
Adding measurement 1801aaef to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=1.2335006679367846;dx=-3.4208078793399644E-7
New Minimum: 1.2335006679367846 > 1.2335005929883691
WOLFE (weak): th(2.154434690031884)=1.2335005929883691; dx=-3.365927934441016E-7 evalInputDelta=7.494841547384112E-8
New Minimum: 1.2335005929883691 > 1.2334999662196875
WOLFE (weak): th(4.308869380063768)=1.2334999662196875; dx=-3.365929246606825E-7 evalInputDelta=7.017170970957665E-7
New Minimum: 1.2334999662196875 > 1.233499080025858
WOLFE (weak): th(12.926608140191302)=1.233499080025858; dx=-3.3659255463165314E-7 evalInputDelta=1.5879109265259927E-6
New Minimum: 1.233499080025858 > 1.2334945630994976
WOLFE (weak): th(51.70643256076521)=1.2334945630994976; dx=-3.365915453479025E-7 evalInputDelta=6.104837287024267E-6
New Minimum: 1.2334945630994976 > 1.233470111826101
WOLFE (weak): th(258.53216280382605)=1.233470111826101; dx=-3.3658866300366225E-7 evalInputDelta=3.0556110683699345E-5
New Minimum: 1.233470111826101 > 1.2333181963471032
WOLFE (weak): th(1551.1929768229563)=1.2333181963471032; dx=-3.365565680371789E-7 evalInputDelta=1.8247158968143218E-4
New Minimum: 1.2333181963471032 > 1.2322241711072601
WOLFE (weak): th(10858.350837760694)=1.2322241711072601; dx=-3.3632673901240657E-7 evalInputDelta=0.001276496829524465
New Minimum: 1.2322241711072601 > 1.223334428960061
WOLFE (weak): th(86866.80670208555)=1.223334428960061; dx=-3.3441635586344443E-7 evalInputDelta=0.01016623897672364
New Minimum: 1.223334428960061 > 1.1458690565978853
WOLFE (weak): th(781801.26031877)=1.1458690565978853; dx=-3.1604300781812426E-7 evalInputDelta=0.0876316113388993
New Minimum: 1.1458690565978853 > 0.7122655261217075
END: th(7818012.6031877)=0.7122655261217075; dx=-1.6587473089100004E-7 evalInputDelta=0.5212351418150771
Fitness changed from 1.2335006679367846 to 0.7122655261217075
Iteratio
...skipping 11091 bytes...
b3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.387e+04, gradient 1.453e-04, dot -0.870; [c8feb684-c076-4ff7-97a1-febb2808c36b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.09407430710159359, -0.16273991181908365, -0.21717264552577253, -0.2625171944514998
LBFGS Accumulation History: 3 points
Removed measurement 37eacfbc to history. Total: 4
th(0)=-0.2625171944514998;dx=-2.1108756895260805E-8
Armijo: th(3.655251206470066E7)=-0.24492413505983868; dx=-9.02339486425428E-9 evalInputDelta=-0.017593059391661114
New Minimum: -0.2625171944514998 > -0.3008462153913023
END: th(1.827625603235033E7)=-0.3008462153913023; dx=-1.2386544297998961E-8 evalInputDelta=0.038329020939802505
Fitness changed from -0.2625171944514998 to -0.3008462153913023
Iteration 14 complete. Error: -0.3008462153913023 Total: 219.3110; Orientation: 1.4822; Line Search: 163.9332
Adding measurement 5caf0976 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.022e+04, gradient 1.381e-04, dot -0.823; [c8feb684-c076-4ff7-97a1-febb2808c36b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.16273991181908365, -0.21717264552577253, -0.2625171944514998, -0.3008462153913023
LBFGS Accumulation History: 3 points
Removed measurement 75072d3e to history. Total: 4
th(0)=-0.3008462153913023;dx=-1.9082234038018088E-8
Armijo: th(3.937500000000003E7)=-0.2045128609409912; dx=-1.285470684996034E-9 evalInputDelta=-0.0963333544503111
New Minimum: -0.3008462153913023 > -0.31994132670788966
END: th(1.9687500000000015E7)=-0.31994132670788966; dx=-7.011701659507722E-9 evalInputDelta=0.019095111316587365
Fitness changed from -0.3008462153913023 to -0.31994132670788966
Iteration 15 complete. Error: -0.31994132670788966 Total: 217.2787; Orientation: 1.4764; Line Search: 160.6508
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 15: -0.31994132670788966 (> -Infinity) after 3764.009s (< 3600.000s)
-0.31994132670788966