BasicOptimizer.scala:89 executed in 113.88 seconds (1.404 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 41401254409200
Reset training subject: 41403573393500
Adding measurement 3e9fc3 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-29.620049921785625;dx=-2.005355289263795E-6
New Minimum: -29.620049921785625 > -29.62005582669971
WOLFE (weak): th(2.154434690031884)=-29.62005582669971; dx=-1.8329821775376765E-6 evalInputDelta=5.904914083032509E-6
New Minimum: -29.62005582669971 > -29.620060255384498
WOLFE (weak): th(4.308869380063768)=-29.620060255384498; dx=-1.833877489140163E-6 evalInputDelta=1.0333598872591665E-5
New Minimum: -29.620060255384498 > -29.620076493889727
WOLFE (weak): th(12.926608140191302)=-29.620076493889727; dx=-1.8335383096980581E-6 evalInputDelta=2.6572104101063587E-5
New Minimum: -29.620076493889727 > -29.6201547338356
WOLFE (weak): th(51.70643256076521)=-29.6201547338356; dx=-1.83452653340993E-6 evalInputDelta=1.04812049976033E-4
New Minimum: -29.6201547338356 > -29.620569549718752
WOLFE (weak): th(258.53216280382605)=-29.620569549718752; dx=-1.8337796555292469E-6 evalInputDelta=5.19627933126543E-4
New Minimum: -29.620569549718752 > -29.62316312444015
WOLFE (weak): th(1551.1929768229563)=-29.62316312444015; dx=-1.8338631041796374E-6 evalInputDelta=0.0031132026545250824
New Minimum: -29.62316312444015 > -29.64183252368233
WOLFE (weak): th(10858.350837760694)=-29.64183252368233; dx=-1.83377249698451E-6 evalInputDelta=0.021782601896703113
New Minimum: -29.64183252368233 > -29.79396462447107
WOLFE (weak): th(86866.80670208555)=-29.79396462447107; dx=-1.8251142193470257E-6 evalInputDelta=0.17391470268544396
New Minimum: -29.79396462447107 > -31.13495817007715
END: th(781801.26031877)=-31.13495817007715; dx=-1.7086500217496942E-6 evalInputDelta=1.5149082482915261
Fitness changed from -29.620049921785625 to -31.13495817007715
Iteration 1 complete. Error: -31.13495817007715 Total: 30.1627; Orientation: 0.0645; Line Search: 23.3134
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3f0e80a7 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-31.13495817007715;dx=-1.6720908375992317E-6
New Minimum: -31.13495817007715 > -34.012315648234804
END: th(1684339.7559414052)=-34.012315648234804; dx=-1.451608987902329E-6 evalInputDelta=2.877357478157652
Fitness changed from -31.13495817007715 to -34.012315648234804
Iteration 2 complete. Error: -34.012315648234804 Total: 7.2858; Orientation: 0.0620; Line Search: 4.5485
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 61f472ec to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-34.012315648234804;dx=-1.408041266157961E-6
New Minimum: -34.012315648234804 > -38.9075307011265
END: th(3628800.0)=-38.9075307011265; dx=-1.0657814324070565E-6 evalInputDelta=4.895215052891693
Fitness changed from -34.012315648234804 to -38.9075307011265
Iteration 3 complete. Error: -38.9075307011265 Total: 7.7490; Orientation: 0.0601; Line Search: 4.7577
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 22b0fe81 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.063e+04, gradient 1.034e-03, dot -0.869; [6cfa1ce8-d553-4d16-84bc-29658757e118 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -38.9075307011265, -34.012315648234804, -31.13495817007715, -29.620049921785625
LBFGS Accumulation History: 3 points
Removed measurement 22b0fe81 to history. Total: 3
th(0)=-38.9075307011265;dx=-1.0682684953510881E-6
New Minimum: -38.9075307011265 > -46.21072629820909
END: th(7818012.6031877)=-46.21072629820909; dx=-6.733091466206137E-7 evalInputDelta=7.303195597082592
Fitness changed from -38.9075307011265 to -46.21072629820909
Iteration 4 complete. Error: -46.21072629820909 Total: 8.4938; Orientation: 1.1403; Line Search: 4.6773
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 662a58fd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.985e+04, gradient 8.874e-04, dot -0.698; [6cfa1ce8-d553-4d16-84bc-29658757e118 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.21072629820909, -34.012315648234804, -31.13495817007715, -29.620049921785625
LBFGS Accumulation History: 3 points
Removed measurement 662a58fd to history. Total: 3
th(0)=-46.21072629820909;dx=-7.864983081568281E-7
New Minimum: -46.21072629820909 > -55.85655221343012
END: th(1.684339755941405E7)=-55.85655221343012; dx=-3.5234897695929276E-7 evalInputDelta=9.645825915221032
Fitness changed from -46.21072629820909 to -55.85655221343012
Iteration 5 complete. Error: -55.85655221343012 Total: 8.4249; Orientation: 1.1279; Line Search: 4.6953
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 56bd72d6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.523e+04, gradient 8.507e-04, dot -0.518; [6cfa1ce8-d553-4d16-84bc-29658757e118 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -55.85655221343012, -34.012315648234804, -31.13495817007715, -29.620049921785625
LBFGS Accumulation History: 3 points
Removed measurement 56bd72d6 to history. Total: 3
th(0)=-55.85655221343012;dx=-7.235962518465275E-7
New Minimum: -55.85655221343012 > -63.67983180173202
END: th(3.6288E7)=-63.67983180173202; dx=-2.1404862771521807E-8 evalInputDelta=7.823279588301901
Fitness changed from -55.85655221343012 to -63.67983180173202
Iteration 6 complete. Error: -63.67983180173202 Total: 8.4118; Orientation: 1.1000; Line Search: 4.4513
Adding measurement 62728a6d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.132e+04, gradient 1.027e-03, dot -0.264; [6cfa1ce8-d553-4d16-84bc-29658757e118 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.67983180173202, -34.012315648234804, -31.13495817007715, -29.620049921785625
LBFGS Accumulation History: 3 points
Removed measurement 62728a6d to history. Total: 3
th(0)=-63.67983180173202;dx=-1.055067307441651E-6
Armijo: th(7.8180126031877E7)=-58.57844378424543; dx=1.9027599646110257E-7 evalInputDelta=-5.101388017486592
New Minimum: -63.67983180173202 > -69.53459067060027
WOLF (strong): th(3.90900630159385E7)=-69.53459067060027; dx=2.5558619108643614E-7 evalInputDelta=5.854758868868245
New Minimum: -69.53459067060027 > -72.8880575985274
END: th(1.3030021005312832E7)=-72.8880575985274; dx=-2.6978279295284477E-7 evalInputDelta=9.208225796795375
Fitness changed from -63.67983180173202 to -72.8880575985274
Iteration 7 complete. Error: -72.8880575985274 Total: 12.6504; Orientation: 1.0595; Line Search: 9.2077
Adding measurement 1d947def to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.577e+04, gradient 6.736e-04, dot -0.441; [6cfa1ce8-d553-4d16-84bc-29658757e118 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.8880575985274, -34.012315648234804, -31.13495817007715, -29.620049921785625
LBFGS Accumulation History: 3 points
Removed measurement 1d947def to history. Total: 3
th(0)=-72.8880575985274;dx=-4.5296824705355107E-7
New Minimum: -72.8880575985274 > -80.04045227827747
END: th(2.807232926569009E7)=-80.04045227827747; dx=-7.798373193655817E-8 evalInputDelta=7.152394679750074
Fitness changed from -72.8880575985274 to -80.04045227827747
Iteration 8 complete. Error: -80.04045227827747 Total: 7.8588; Orientation: 1.1267; Line Search: 4.6369
Adding measurement 7dccfc78 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.754e+04, gradient 7.443e-04, dot -0.390; [6cfa1ce8-d553-4d16-84bc-29658757e118 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.04045227827747, -34.012315648234804, -31.13495817007715, -29.620049921785625
LBFGS Accumulation History: 3 points
Removed measurement 7dccfc78 to history. Total: 3
th(0)=-80.04045227827747;dx=-5.530747572794942E-7
Armijo: th(6.048000000000001E7)=-78.9708957630006; dx=1.5043751996662136E-7 evalInputDelta=-1.0695565152768722
New Minimum: -80.04045227827747 > -84.30751659004423
WOLF (strong): th(3.0240000000000004E7)=-84.30751659004423; dx=1.021994748113074E-7 evalInputDelta=4.2670643117667595
END: th(1.0080000000000002E7)=-84.20483219017869; dx=-2.2894957038045813E-7 evalInputDelta=4.1643799119012215
Fitness changed from -80.04045227827747 to -84.30751659004423
Iteration 9 complete. Error: -84.30751659004423 Total: 12.5260; Orientation: 1.1059; Line Search: 9.2906
Adding measurement 36fa8978 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.175e+04, gradient 8.210e-04, dot -0.291; [6cfa1ce8-d553-4d16-84bc-29658757e118 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -84.30751659004423, -34.012315648234804, -31.13495817007715, -29.620049921785625
LBFGS Accumulation History: 3 points
Removed measurement 36fa8978 to history. Total: 3
th(0)=-84.30751659004423;dx=-6.720471717652043E-7
New Minimum: -84.30751659004423 > -91.36255066149116
WOLF (strong): th(2.1716701675521392E7)=-91.36255066149116; dx=4.193782983473432E-8 evalInputDelta=7.055034071446926
END: th(1.0858350837760696E7)=-90.08729458327939; dx=-3.047618594158001E-7 evalInputDelta=5.779777993235157
Fitness changed from -84.30751659004423 to -91.36255066149116
Iteration 10 complete. Error: -91.36255066149116 Total: 9.8403; Orientation: 1.0555; Line Search: 6.6519
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -91.36255066149116 (> -Infinity) after 113.881s (< 5400.000s)
Returns
-91.36255066149116