BasicOptimizer.scala:88 executed in 1563.37 seconds (9.390 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 1226563599446
Reset training subject: 1259537999562
Adding measurement 7f126ec6 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=7.994773969054222;dx=-1.142442616527538E-6
New Minimum: 7.994773969054222 > 7.994768887758255
WOLFE (weak): th(2.154434690031884)=7.994768887758255; dx=-1.14115731563517E-6 evalInputDelta=5.081295967102051E-6
New Minimum: 7.994768887758255 > 7.99476221203804
WOLFE (weak): th(4.308869380063768)=7.99476221203804; dx=-1.1409182033776575E-6 evalInputDelta=1.17570161819458E-5
New Minimum: 7.99476221203804 > 7.994737863540649
WOLFE (weak): th(12.926608140191302)=7.994737863540649; dx=-1.1430974472376275E-6 evalInputDelta=3.610551357269287E-5
New Minimum: 7.994737863540649 > 7.994630768895149
WOLFE (weak): th(51.70643256076521)=7.994630768895149; dx=-1.1425705564305157E-6 evalInputDelta=1.4320015907287598E-4
New Minimum: 7.994630768895149 > 7.994058310985565
WOLFE (weak): th(258.53216280382605)=7.994058310985565; dx=-1.1411449375307274E-6 evalInputDelta=7.156580686569214E-4
New Minimum: 7.994058310985565 > 7.99048238992691
WOLFE (weak): th(1551.1929768229563)=7.99048238992691; dx=-1.1414512147527972E-6 evalInputDelta=0.0042915791273117065
New Minimum: 7.99048238992691 > 7.964777320623398
WOLFE (weak): th(10858.350837760694)=7.964777320623398; dx=-1.1374861157594204E-6 evalInputDelta=0.02999664843082428
New Minimum: 7.964777320623398 > 7.757945731282234
WOLFE (weak): th(86866.80670208555)=7.757945731282234; dx=-1.1046572963908518E-6 evalInputDelta=0.23682823777198792
New Minimum: 7.757945731282234 > 6.204460084438324
END: th(781801.26031877)=6.204460084438324; dx=-7.503948214144084E-7 evalInputDelta=1.7903138846158981
Fitness changed from 7.994773969054222 to 6.204460084438324
Iteration 1 complete. Error: 6.204460084438324 Total: 437.7000; Orientation: 0.0813; Line Search: 341.2304
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 34200274 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=6.204460084438324;dx=-7.695879333634582E-7
New Minimum: 6.204460084438324 > 3.9026057571172714
END: th(1684339.7559414052)=3.9026057571172714; dx=-4.362561886813617E-7 evalInputDelta=2.3018543273210526
Fitness changed from 6.204460084438324 to 3.9026057571172714
Iteration 2 complete. Error: 3.9026057571172714 Total: 102.5356; Orientation: 0.0807; Line Search: 67.5287
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3c035a2c to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=3.9026057571172714;dx=-5.22356169492876E-7
New Minimum: 3.9026057571172714 > 1.4478133916854858
END: th(3628800.0)=1.4478133916854858; dx=-2.0986594375511686E-7 evalInputDelta=2.4547923654317856
Fitness changed from 3.9026057571172714 to 1.4478133916854858
Iteration 3 complete. Error: 1.4478133916854858 Total: 99.4847; Orientation: 0.0797; Line Search: 66.2111
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 57e8331 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.388e+03, gradient 6.060e-04, dot -0.593; [60f5ed54-a669-42ad-ad6a-d0c217e648bd = 1.000/1.000e+00]
Orientation rejected. Popping history element from 1.4478133916854858, 3.9026057571172714, 6.204460084438324, 7.994773969054222
LBFGS Accumulation History: 3 points
Removed measurement 57e8331 to history. Total: 3
th(0)=1.4478133916854858;dx=-3.6584903844126125E-7
New Minimum: 1.4478133916854858 > -0.5584909319877625
END: th(7818012.6031877)=-0.5584909319877625; dx=-5.566900116968464E-8 evalInputDelta=2.0063043236732483
Fitness changed from 1.4478133916854858 to -0.5584909319877625
Iteration 4 complete. Error: -0.5584909319877625 Total: 104.9729; Orientation: 1.8863; Line Search: 66.4942
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7553d4c0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.645e+03, gradient 5.713e-04, dot -0.385; [60f5ed54-a669-42ad-ad6a-d0c217e648bd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.5584909319877625, 3.9026057571172714, 6.204460084438324, 7.994773969054222
LBFGS Accumulation History: 3 points
Removed measurement 7553d4c0 to history. Total: 3
th(0)=-0.5584909319877625;dx=-3.2525113211995305E-7
New Minimum: -0.5584909319877625 > -0.9038355648517609
WOLF (strong): th(1.684339755941405E7)=-0.9038355648517609; dx=3.2287118681468686E-8 evalInputDelta=0.3453446328639984
New Minimum: -0.9038355648517609 > -1.7899723947048187
WOLF (strong): th(8421698.779707026)=-1.7899723947048187; dx=1.921947823800297E-9 evalInputDelta=1.2314814627170563
END: th(2807232.9265690087)=-1.7439862787723541; dx=-1.061707733956289E-7 evalInputDelta=1.1854953467845917
Fitness changed from -0.5584909319877625 to -1.7899723947048187
Iteration 5 complete. Error: -1.7899723947048187 Total: 171.9200; Orientation: 1.9332; Line Search: 135.7558
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 45565d7c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.995e+03, gradient 5.409e-04, dot -0.310; [60f5ed54-a669-42ad-ad6a-d0c217e648bd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.7899723947048187, 3.9026057571172714, 6.204460084438324, 7.994773969054222
LBFGS Accumulation History: 3 points
Removed measurement 45565d7c to history. Total: 3
th(0)=-1.7899723947048187;dx=-2.918589665396772E-7
New Minimum: -1.7899723947048187 > -2.7817166298627853
END: th(6048000.0)=-2.7817166298627853; dx=-9.234134621327424E-9 evalInputDelta=0.9917442351579666
Fitness changed from -1.7899723947048187 to -2.7817166298627853
Iteration 6 complete. Error: -2.7817166298627853 Total: 100.4241; Orientation: 1.8731; Line Search: 63.2674
Adding measurement 77ddea48 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.561e+03, gradient 4.182e-04, dot -0.344; [60f5ed54-a669-42ad-ad6a-d0c217e648bd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.7817166298627853, 3.9026057571172714, 6.204460084438324, 7.994773969054222
LBFGS Accumulation History: 3 points
Removed measurement 77ddea48 to history. Total: 3
th(0)=-2.7817166298627853;dx=-1.7417792863620202E-7
Armijo: th(1.3030021005312834E7)=-2.492625817656517; dx=3.939552197375016E-8 evalInputDelta=-0.2890908122062683
New Minimum: -2.7817166298627853 > -3.4181880354881287
WOLF (strong): th(6515010.502656417)=-3.4181880354881287; dx=5.761591323251249E-9 evalInputDelta=0.6364714056253433
END: th(2171670.167552139)=-3.3641087263822556; dx=-8.640758069684244E-8 evalInputDelta=0.5823920965194702
Fitness changed from -2.7817166298627853 to -3.4181880354881287
Iteration 7 complete. Error: -3.4181880354881287 Total: 172.4988; Orientation: 1.8588; Line Search: 137.6520
Adding measurement 277ac4c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.370e+03, gradient 4.358e-04, dot -0.311; [60f5ed54-a669-42ad-ad6a-d0c217e648bd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -3.4181880354881287, 3.9026057571172714, 6.204460084438324, 7.994773969054222
LBFGS Accumulation History: 3 points
Removed measurement 277ac4c to history. Total: 3
th(0)=-3.4181880354881287;dx=-1.8959714762123281E-7
New Minimum: -3.4181880354881287 > -4.023914381861687
WOLF (strong): th(4678721.544281682)=-4.023914381861687; dx=5.71574303568239E-10 evalInputDelta=0.605726346373558
END: th(2339360.772140841)=-4.023280277848244; dx=-4.697735765121624E-8 evalInputDelta=0.605092242360115
Fitness changed from -3.4181880354881287 to -4.023914381861687
Iteration 8 complete. Error: -4.023914381861687 Total: 131.9683; Orientation: 1.8720; Line Search: 97.2290
Adding measurement 33948083 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.729e+03, gradient 2.972e-04, dot -0.401; [60f5ed54-a669-42ad-ad6a-d0c217e648bd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -4.023914381861687, 3.9026057571172714, 6.204460084438324, 7.994773969054222
LBFGS Accumulation History: 3 points
Removed measurement 33948083 to history. Total: 3
th(0)=-4.023914381861687;dx=-8.818056363530419E-8
New Minimum: -4.023914381861687 > -4.428396433591843
END: th(5040000.000000001)=-4.428396433591843; dx=-1.614250435611951E-8 evalInputDelta=0.40448205173015594
Fitness changed from -4.023914381861687 to -4.428396433591843
Iteration 9 complete. Error: -4.428396433591843 Total: 105.7178; Orientation: 1.8686; Line Search: 70.7679
Adding measurement 76e7b49b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.803e+03, gradient 2.527e-04, dot -0.442; [60f5ed54-a669-42ad-ad6a-d0c217e648bd = 1.000/1.000e+00]
Orientation rejected. Popping history element from -4.428396433591843, 3.9026057571172714, 6.204460084438324, 7.994773969054222
LBFGS Accumulation History: 3 points
Removed measurement 76e7b49b to history. Total: 3
th(0)=-4.428396433591843;dx=-6.357238698946681E-8
New Minimum: -4.428396433591843 > -4.556639552116394
WOLF (strong): th(1.0858350837760696E7)=-4.556639552116394; dx=4.488950329158236E-9 evalInputDelta=0.1282431185245514
New Minimum: -4.556639552116394 > -4.725644111633301
END: th(5429175.418880348)=-4.725644111633301; dx=-1.2906296289080511E-8 evalInputDelta=0.29724767804145813
Fitness changed from -4.428396433591843 to -4.725644111633301
Iteration 10 complete. Error: -4.725644111633301 Total: 135.2394; Orientation: 1.8721; Line Search: 98.8598
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -4.725644111633301 (> -Infinity) after 1563.366s (< 1800.000s)
Returns
-4.725644111633301