BasicOptimizer.scala:89 executed in 330.64 seconds (3.768 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 571668729615200
Reset training subject: 571675060536100
Adding measurement 13203cb6 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-65.45255569510667;dx=-1.890366791788018E-6
New Minimum: -65.45255569510667 > -65.45256031080099
WOLFE (weak): th(2.154434690031884)=-65.45256031080099; dx=-1.8873412371869638E-6 evalInputDelta=4.615694322751551E-6
New Minimum: -65.45256031080099 > -65.45256261864803
WOLFE (weak): th(4.308869380063768)=-65.45256261864803; dx=-1.887466190698041E-6 evalInputDelta=6.923541363335062E-6
New Minimum: -65.45256261864803 > -65.45258338926774
WOLFE (weak): th(12.926608140191302)=-65.45258338926774; dx=-1.887446107059413E-6 evalInputDelta=2.7694161076396995E-5
New Minimum: -65.45258338926774 > -65.4526641638373
WOLFE (weak): th(51.70643256076521)=-65.4526641638373; dx=-1.8871216489213227E-6 evalInputDelta=1.0846873063030671E-4
New Minimum: -65.4526641638373 > -65.45310034479039
WOLFE (weak): th(258.53216280382605)=-65.45310034479039; dx=-1.8866713290018998E-6 evalInputDelta=5.446496837180348E-4
New Minimum: -65.45310034479039 > -65.45581890976537
WOLFE (weak): th(1551.1929768229563)=-65.45581890976537; dx=-1.8865199572204314E-6 evalInputDelta=0.0032632146587019406
New Minimum: -65.45581890976537 > -65.47540401055764
WOLFE (weak): th(10858.350837760694)=-65.47540401055764; dx=-1.8854279481505334E-6 evalInputDelta=0.022848315450971768
New Minimum: -65.47540401055764 > -65.63489167224728
WOLFE (weak): th(86866.80670208555)=-65.63489167224728; dx=-1.8763227794921135E-6 evalInputDelta=0.18233597714061034
New Minimum: -65.63489167224728 > -67.05434539231564
WOLFE (weak): th(781801.26031877)=-67.05434539231564; dx=-1.7838195708262415E-6 evalInputDelta=1.6017896972089716
New Minimum: -67.05434539231564 > -77.16191132963522
END: th(7818012.6031877)=-77.16191132963522; dx=-8.149964285674701E-7 evalInputDelta=11.70935563452855
Fitness changed from -65.45255569510667 to -77.16191132963522
Iteration 1 complete. Error: -77.16191132963522 Total: 87.7779; Orientation: 0.1481; Line Search: 69.1179
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 42ff1b65 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-77.16191132963522;dx=-9.77971817264964E-7
New Minimum: -77.16191132963522 > -88.7328033820338
END: th(1.684339755941405E7)=-88.7328033820338; dx=-3.6745426951938864E-7 evalInputDelta=11.570892052398577
Fitness changed from -77.16191132963522 to -88.7328033820338
Iteration 2 complete. Error: -88.7328033820338 Total: 20.1980; Orientation: 0.1535; Line Search: 12.6360
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3862158f to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-88.7328033820338;dx=-9.351299034888408E-7
New Minimum: -88.7328033820338 > -94.83965819255353
WOLF (strong): th(3.6288E7)=-94.83965819255353; dx=1.376374535990644E-7 evalInputDelta=6.106854810519735
New Minimum: -94.83965819255353 > -96.64538248316728
END: th(1.8144E7)=-96.64538248316728; dx=-3.806494385567559E-8 evalInputDelta=7.912579101133488
Fitness changed from -88.7328033820338 to -96.64538248316728
Iteration 3 complete. Error: -96.64538248316728 Total: 25.9267; Orientation: 0.1453; Line Search: 18.4594
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 325004b9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.896e+04, gradient 9.827e-04, dot -0.629; [6c5840ed-ffb6-4889-b683-805bc712d5b5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -96.64538248316728, -88.7328033820338, -77.16191132963522, -65.45255569510667
LBFGS Accumulation History: 3 points
Removed measurement 325004b9 to history. Total: 3
th(0)=-96.64538248316728;dx=-9.65219537693001E-7
New Minimum: -96.64538248316728 > -96.68207421571802
WOLF (strong): th(3.90900630159385E7)=-96.68207421571802; dx=3.563595008300973E-7 evalInputDelta=0.03669173255073588
New Minimum: -96.68207421571802 > -103.65617822384
WOLF (strong): th(1.954503150796925E7)=-103.65617822384; dx=1.6545673726947193E-7 evalInputDelta=7.0107957406727195
END: th(6515010.502656416)=-102.0873883562154; dx=-5.374138445048079E-7 evalInputDelta=5.442005873048117
Fitness changed from -96.64538248316728 to -103.65617822384
Iteration 4 complete. Error: -103.65617822384 Total: 35.4800; Orientation: 2.8195; Line Search: 25.3718
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 6ca9a40b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.544e+04, gradient 9.565e-04, dot -0.519; [6c5840ed-ffb6-4889-b683-805bc712d5b5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -103.65617822384, -88.7328033820338, -77.16191132963522, -65.45255569510667
LBFGS Accumulation History: 3 points
Removed measurement 6ca9a40b to history. Total: 3
th(0)=-103.65617822384;dx=-9.132610453866672E-7
New Minimum: -103.65617822384 > -110.83843461115305
END: th(1.4036164632845044E7)=-110.83843461115305; dx=-1.7907321559595545E-8 evalInputDelta=7.182256387313046
Fitness changed from -103.65617822384 to -110.83843461115305
Iteration 5 complete. Error: -110.83843461115305 Total: 22.1649; Orientation: 2.5750; Line Search: 12.5265
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7269135a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.092e+04, gradient 6.704e-04, dot -0.661; [6c5840ed-ffb6-4889-b683-805bc712d5b5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -110.83843461115305, -88.7328033820338, -77.16191132963522, -65.45255569510667
LBFGS Accumulation History: 3 points
Removed measurement 7269135a to history. Total: 3
th(0)=-110.83843461115305;dx=-4.4862992753055144E-7
New Minimum: -110.83843461115305 > -114.81878250001111
WOLF (strong): th(3.0240000000000004E7)=-114.81878250001111; dx=7.736824183315963E-8 evalInputDelta=3.980347888858063
New Minimum: -114.81878250001111 > -115.12883796212279
END: th(1.5120000000000002E7)=-115.12883796212279; dx=-1.0319751434859525E-7 evalInputDelta=4.29040335096974
Fitness changed from -110.83843461115305 to -115.12883796212279
Iteration 6 complete. Error: -115.12883796212279 Total: 28.8239; Orientation: 2.5224; Line Search: 19.0657
Adding measurement 3fa3ffd4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.619e+04, gradient 6.133e-04, dot -0.664; [6c5840ed-ffb6-4889-b683-805bc712d5b5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -115.12883796212279, -88.7328033820338, -77.16191132963522, -65.45255569510667
LBFGS Accumulation History: 3 points
Removed measurement 3fa3ffd4 to history. Total: 3
th(0)=-115.12883796212279;dx=-3.753803114942206E-7
New Minimum: -115.12883796212279 > -118.36158601249495
WOLF (strong): th(3.2575052513282087E7)=-118.36158601249495; dx=5.5151969448611184E-8 evalInputDelta=3.232748050372166
New Minimum: -118.36158601249495 > -118.70579553211466
END: th(1.6287526256641043E7)=-118.70579553211466; dx=-7.181977386938377E-8 evalInputDelta=3.576957569991876
Fitness changed from -115.12883796212279 to -118.70579553211466
Iteration 7 complete. Error: -118.70579553211466 Total: 27.4936; Orientation: 2.5576; Line Search: 18.6648
Adding measurement 17f4b8ab to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.515e+04, gradient 6.046e-04, dot -0.631; [6c5840ed-ffb6-4889-b683-805bc712d5b5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -118.70579553211466, -88.7328033820338, -77.16191132963522, -65.45255569510667
LBFGS Accumulation History: 3 points
Removed measurement 17f4b8ab to history. Total: 3
th(0)=-118.70579553211466;dx=-3.6460185145334205E-7
New Minimum: -118.70579553211466 > -120.62925003015002
WOLF (strong): th(3.509041158211262E7)=-120.62925003015002; dx=1.0148088872928883E-7 evalInputDelta=1.9234544980353547
New Minimum: -120.62925003015002 > -121.9462544748169
END: th(1.754520579105631E7)=-121.9462544748169; dx=-2.3853214832828675E-8 evalInputDelta=3.240458942702233
Fitness changed from -118.70579553211466 to -121.9462544748169
Iteration 8 complete. Error: -121.9462544748169 Total: 27.6873; Orientation: 2.5372; Line Search: 19.2204
Adding measurement 4f2f3e6f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.677e+04, gradient 6.104e-04, dot -0.582; [6c5840ed-ffb6-4889-b683-805bc712d5b5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -121.9462544748169, -88.7328033820338, -77.16191132963522, -65.45255569510667
LBFGS Accumulation History: 3 points
Removed measurement 4f2f3e6f to history. Total: 3
th(0)=-121.9462544748169;dx=-3.721764890901307E-7
New Minimum: -121.9462544748169 > -122.37363404803722
WOLF (strong): th(3.7800000000000015E7)=-122.37363404803722; dx=1.5412157548764698E-7 evalInputDelta=0.42737957322032116
New Minimum: -122.37363404803722 > -124.92930170260342
WOLF (strong): th(1.8900000000000007E7)=-124.92930170260342; dx=2.5353851952785095E-8 evalInputDelta=2.9830472277865283
END: th(6300000.000000003)=-123.9539227533029; dx=-2.2172897382981112E-7 evalInputDelta=2.0076682784860083
Fitness changed from -121.9462544748169 to -124.92930170260342
Iteration 9 complete. Error: -124.92930170260342 Total: 33.0078; Orientation: 2.4896; Line Search: 24.4901
Adding measurement 22540424 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.556e+04, gradient 6.213e-04, dot -0.542; [6c5840ed-ffb6-4889-b683-805bc712d5b5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -124.92930170260342, -88.7328033820338, -77.16191132963522, -65.45255569510667
LBFGS Accumulation History: 3 points
Removed measurement 22540424 to history. Total: 3
th(0)=-124.92930170260342;dx=-3.856472191013631E-7
New Minimum: -124.92930170260342 > -128.00587485065284
END: th(1.3572938547200873E7)=-128.00587485065284; dx=-4.7197142320889884E-8 evalInputDelta=3.0765731480494196
Fitness changed from -124.92930170260342 to -128.00587485065284
Iteration 10 complete. Error: -128.00587485065284 Total: 20.9549; Orientation: 2.4968; Line Search: 12.4977
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -128.00587485065284 (> -Infinity) after 330.634s (< 5400.000s)
Returns
-128.00587485065284