BasicOptimizer.scala:89 executed in 310.47 seconds (4.572 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 647231140303700
Reset training subject: 647236965790500
Adding measurement 2f282f3 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-29.71433663522221;dx=-2.0037323530295245E-6
New Minimum: -29.71433663522221 > -29.714340447889118
WOLFE (weak): th(2.154434690031884)=-29.714340447889118; dx=-1.9941787699294915E-6 evalInputDelta=3.812666907521134E-6
New Minimum: -29.714340447889118 > -29.71434680233288
WOLFE (weak): th(4.308869380063768)=-29.71434680233288; dx=-1.9942412848317933E-6 evalInputDelta=1.0167110669812018E-5
New Minimum: -29.71434680233288 > -29.714364594768178
WOLFE (weak): th(12.926608140191302)=-29.714364594768178; dx=-1.9940164165794452E-6 evalInputDelta=2.795954596734873E-5
New Minimum: -29.714364594768178 > -29.71445101501665
WOLFE (weak): th(51.70643256076521)=-29.71445101501665; dx=-1.9941946377240876E-6 evalInputDelta=1.1437979443940094E-4
New Minimum: -29.71445101501665 > -29.71491107152073
WOLFE (weak): th(258.53216280382605)=-29.71491107152073; dx=-1.9941473477247036E-6 evalInputDelta=5.744362985211637E-4
New Minimum: -29.71491107152073 > -29.71778308645798
WOLFE (weak): th(1551.1929768229563)=-29.71778308645798; dx=-1.993957104156655E-6 evalInputDelta=0.003446451235770809
New Minimum: -29.71778308645798 > -29.738454675987686
WOLFE (weak): th(10858.350837760694)=-29.738454675987686; dx=-1.992432680749906E-6 evalInputDelta=0.024118040765475968
New Minimum: -29.738454675987686 > -29.90668586348249
WOLFE (weak): th(86866.80670208555)=-29.90668586348249; dx=-1.979430949144396E-6 evalInputDelta=0.19234922826028011
New Minimum: -29.90668586348249 > -31.390245914558104
WOLFE (weak): th(781801.26031877)=-31.390245914558104; dx=-1.8482056979376635E-6 evalInputDelta=1.6759092793358938
New Minimum: -31.390245914558104 > -39.41754258026414
END: th(7818012.6031877)=-39.41754258026414; dx=-2.92149582701416E-7 evalInputDelta=9.70320594504193
Fitness changed from -29.71433663522221 to -39.41754258026414
Iteration 1 complete. Error: -39.41754258026414 Total: 82.4916; Orientation: 0.1390; Line Search: 65.2224
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 48c13c48 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-39.41754258026414;dx=-1.1656257489363646E-6
New Minimum: -39.41754258026414 > -44.0866471279137
WOLF (strong): th(1.684339755941405E7)=-44.0866471279137; dx=1.4877282059304436E-7 evalInputDelta=4.66910454764956
New Minimum: -44.0866471279137 > -44.83712108179807
END: th(8421698.779707026)=-44.83712108179807; dx=-9.486187968689894E-8 evalInputDelta=5.419578501533927
Fitness changed from -39.41754258026414 to -44.83712108179807
Iteration 2 complete. Error: -44.83712108179807 Total: 25.6802; Orientation: 0.1395; Line Search: 18.3079
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4af5a9dc to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-44.83712108179807;dx=-1.041152780642748E-6
New Minimum: -44.83712108179807 > -47.41833827231591
WOLF (strong): th(1.8144E7)=-47.41833827231591; dx=2.0615674705045198E-7 evalInputDelta=2.5812171905178403
New Minimum: -47.41833827231591 > -49.26784545991685
WOLF (strong): th(9072000.0)=-49.26784545991685; dx=5.062346220307497E-8 evalInputDelta=4.430724378118782
END: th(3024000.0)=-47.718759178873945; dx=-6.521683476054584E-7 evalInputDelta=2.8816380970758786
Fitness changed from -44.83712108179807 to -49.26784545991685
Iteration 3 complete. Error: -49.26784545991685 Total: 31.2265; Orientation: 0.1343; Line Search: 24.2364
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 187df504 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.485e+04, gradient 1.017e-03, dot -0.667; [655b5bce-4d4d-430b-93cb-a4c47a843d44 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -49.26784545991685, -44.83712108179807, -39.41754258026414, -29.71433663522221
LBFGS Accumulation History: 3 points
Removed measurement 187df504 to history. Total: 3
th(0)=-49.26784545991685;dx=-1.0336392291687375E-6
New Minimum: -49.26784545991685 > -53.590365859897666
END: th(6515010.502656417)=-53.590365859897666; dx=-1.2406437543343825E-7 evalInputDelta=4.322520399980817
Fitness changed from -49.26784545991685 to -53.590365859897666
Iteration 4 complete. Error: -53.590365859897666 Total: 22.0481; Orientation: 2.7285; Line Search: 12.3217
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 594210f1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.486e+04, gradient 7.850e-04, dot -0.764; [655b5bce-4d4d-430b-93cb-a4c47a843d44 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.590365859897666, -44.83712108179807, -39.41754258026414, -29.71433663522221
LBFGS Accumulation History: 3 points
Removed measurement 594210f1 to history. Total: 3
th(0)=-53.590365859897666;dx=-6.156988267592267E-7
New Minimum: -53.590365859897666 > -57.37169773239688
END: th(1.4036164632845046E7)=-57.37169773239688; dx=-1.7717657236571306E-8 evalInputDelta=3.7813318724992158
Fitness changed from -53.590365859897666 to -57.37169773239688
Iteration 5 complete. Error: -57.37169773239688 Total: 20.7965; Orientation: 2.4511; Line Search: 11.3584
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7c49ac74 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.725e+04, gradient 1.028e-03, dot -0.540; [655b5bce-4d4d-430b-93cb-a4c47a843d44 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -57.37169773239688, -44.83712108179807, -39.41754258026414, -29.71433663522221
LBFGS Accumulation History: 3 points
Removed measurement 7c49ac74 to history. Total: 3
th(0)=-57.37169773239688;dx=-1.0554621760752944E-6
Armijo: th(3.0240000000000007E7)=-53.08018464392957; dx=3.2414997821068624E-7 evalInputDelta=-4.291513088467312
New Minimum: -57.37169773239688 > -59.977400800236026
WOLF (strong): th(1.5120000000000004E7)=-59.977400800236026; dx=4.000310489379319E-7 evalInputDelta=2.605703067839144
New Minimum: -59.977400800236026 > -61.664040170931
END: th(5040000.000000001)=-61.664040170931; dx=-4.1207362946631265E-7 evalInputDelta=4.292342438534121
Fitness changed from -57.37169773239688 to -61.664040170931
Iteration 6 complete. Error: -61.664040170931 Total: 32.5413; Orientation: 2.4604; Line Search: 23.1808
Adding measurement 69f38f09 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.229e+04, gradient 6.492e-04, dot -0.797; [655b5bce-4d4d-430b-93cb-a4c47a843d44 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -61.664040170931, -44.83712108179807, -39.41754258026414, -29.71433663522221
LBFGS Accumulation History: 3 points
Removed measurement 69f38f09 to history. Total: 3
th(0)=-61.664040170931;dx=-4.212028226786365E-7
New Minimum: -61.664040170931 > -65.40669193296343
END: th(1.0858350837760696E7)=-65.40669193296343; dx=-2.3434596661866726E-7 evalInputDelta=3.7426517620324233
Fitness changed from -61.664040170931 to -65.40669193296343
Iteration 7 complete. Error: -65.40669193296343 Total: 20.8481; Orientation: 2.6099; Line Search: 12.3522
Adding measurement 18234d91 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.023e+05, gradient 6.911e-04, dot -0.717; [655b5bce-4d4d-430b-93cb-a4c47a843d44 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.40669193296343, -44.83712108179807, -39.41754258026414, -29.71433663522221
LBFGS Accumulation History: 3 points
Removed measurement 18234d91 to history. Total: 3
th(0)=-65.40669193296343;dx=-4.77435069556732E-7
New Minimum: -65.40669193296343 > -69.40954620798664
END: th(2.339360772140841E7)=-69.40954620798664; dx=-2.1335580568467814E-8 evalInputDelta=4.002854275023211
Fitness changed from -65.40669193296343 to -69.40954620798664
Iteration 8 complete. Error: -69.40954620798664 Total: 20.6884; Orientation: 2.5476; Line Search: 12.3911
Adding measurement 3a6aa911 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.009e+04, gradient 9.643e-04, dot -0.447; [655b5bce-4d4d-430b-93cb-a4c47a843d44 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.40954620798664, -44.83712108179807, -39.41754258026414, -29.71433663522221
LBFGS Accumulation History: 3 points
Removed measurement 3a6aa911 to history. Total: 3
th(0)=-69.40954620798664;dx=-9.286623824489142E-7
Armijo: th(5.0400000000000015E7)=-59.66294219018028; dx=2.9000982646580496E-7 evalInputDelta=-9.746604017806355
New Minimum: -69.40954620798664 > -70.49610567951605
WOLF (strong): th(2.5200000000000007E7)=-70.49610567951605; dx=4.170305850998149E-7 evalInputDelta=1.0865594715294122
New Minimum: -70.49610567951605 > -75.08706635699762
END: th(8400000.000000002)=-75.08706635699762; dx=-2.3539430943165906E-7 evalInputDelta=5.677520149010988
Fitness changed from -69.40954620798664 to -75.08706635699762
Iteration 9 complete. Error: -75.08706635699762 Total: 32.5293; Orientation: 2.6082; Line Search: 24.2127
Adding measurement 3bd480a3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.137e+05, gradient 6.503e-04, dot -0.650; [655b5bce-4d4d-430b-93cb-a4c47a843d44 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.08706635699762, -44.83712108179807, -39.41754258026414, -29.71433663522221
LBFGS Accumulation History: 3 points
Removed measurement 3bd480a3 to history. Total: 3
th(0)=-75.08706635699762;dx=-4.222526167174709E-7
New Minimum: -75.08706635699762 > -79.0745383470086
END: th(1.8097251396267828E7)=-79.0745383470086; dx=-3.9280130973534353E-8 evalInputDelta=3.987471990010974
Fitness changed from -75.08706635699762 to -79.0745383470086
Iteration 10 complete. Error: -79.0745383470086 Total: 20.3401; Orientation: 2.6583; Line Search: 11.5772
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -79.0745383470086 (> -Infinity) after 310.471s (< 5400.000s)
Returns
-79.0745383470086