BasicOptimizer.scala:89 executed in 302.12 seconds (3.314 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 572538553911300
Reset training subject: 572545031065100
Adding measurement 6734080c to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-44.98431697997611;dx=-2.075432712433188E-6
New Minimum: -44.98431697997611 > -44.98431865894455
END: th(2.154434690031884)=-44.98431865894455; dx=-1.840815878136351E-6 evalInputDelta=1.6789684451623543E-6
Fitness changed from -44.98431697997611 to -44.98431865894455
Iteration 1 complete. Error: -44.98431865894455 Total: 31.0510; Orientation: 0.1536; Line Search: 12.3140
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 620b09cc to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-44.98431865894455;dx=-1.8397776217821127E-6
New Minimum: -44.98431865894455 > -44.98432873275391
WOLFE (weak): th(4.641588833612779)=-44.98432873275391; dx=-1.8383332338500812E-6 evalInputDelta=1.0073809356470065E-5
New Minimum: -44.98432873275391 > -44.98433880656101
WOLFE (weak): th(9.283177667225559)=-44.98433880656101; dx=-1.8384187654807355E-6 evalInputDelta=2.0147616460519657E-5
New Minimum: -44.98433880656101 > -44.98437574383442
WOLFE (weak): th(27.849533001676676)=-44.98437574383442; dx=-1.8366406382848222E-6 evalInputDelta=5.7084889867553557E-5
New Minimum: -44.98437574383442 > -44.98454196118942
WOLFE (weak): th(111.3981320067067)=-44.98454196118942; dx=-1.8368968093523322E-6 evalInputDelta=2.233022448692168E-4
New Minimum: -44.98454196118942 > -44.985441874790936
WOLFE (weak): th(556.9906600335335)=-44.985441874790936; dx=-1.8367587083337304E-6 evalInputDelta=0.0011232158463840847
New Minimum: -44.985441874790936 > -44.991045782381235
WOLFE (weak): th(3341.9439602012008)=-44.991045782381235; dx=-1.8360390459248308E-6 evalInputDelta=0.0067271234366828025
New Minimum: -44.991045782381235 > -45.031372324180445
WOLFE (weak): th(23393.607721408407)=-45.031372324180445; dx=-1.8340921480149665E-6 evalInputDelta=0.04705366523589305
New Minimum: -45.031372324180445 > -45.35891339539397
WOLFE (weak): th(187148.86177126726)=-45.35891339539397; dx=-1.8156954635443794E-6 evalInputDelta=0.3745947364494171
New Minimum: -45.35891339539397 > -48.18169884569156
END: th(1684339.7559414054)=-48.18169884569156; dx=-1.62065191349269E-6 evalInputDelta=3.1973801867470044
Fitness changed from -44.98431865894455 to -48.18169884569156
Iteration 2 complete. Error: -48.18169884569156 Total: 69.3367; Orientation: 0.1557; Line Search: 61.6682
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 6427ca06 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-48.18169884569156;dx=-1.5551527224883157E-6
New Minimum: -48.18169884569156 > -53.4371739093856
END: th(3628800.0000000005)=-53.4371739093856; dx=-1.1158318907528736E-6 evalInputDelta=5.255475063694043
Fitness changed from -48.18169884569156 to -53.4371739093856
Iteration 3 complete. Error: -53.4371739093856 Total: 19.2010; Orientation: 0.1396; Line Search: 11.8944
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4123c145 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.450e+04, gradient 1.015e-03, dot -0.865; [7217d61d-9ba3-400f-b5fd-246ab969804b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.4371739093856, -48.18169884569156, -44.98431865894455, -44.98431697997611
LBFGS Accumulation History: 3 points
Removed measurement 4123c145 to history. Total: 3
th(0)=-53.4371739093856;dx=-1.027680460105396E-6
New Minimum: -53.4371739093856 > -60.23964549537824
END: th(7818012.603187701)=-60.23964549537824; dx=-5.802111704622714E-7 evalInputDelta=6.802471585992642
Fitness changed from -53.4371739093856 to -60.23964549537824
Iteration 4 complete. Error: -60.23964549537824 Total: 22.0939; Orientation: 2.5492; Line Search: 12.1809
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3252319b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.044e+04, gradient 8.285e-04, dot -0.635; [7217d61d-9ba3-400f-b5fd-246ab969804b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -60.23964549537824, -48.18169884569156, -44.98431865894455, -44.98431697997611
LBFGS Accumulation History: 3 points
Removed measurement 3252319b to history. Total: 3
th(0)=-60.23964549537824;dx=-6.847847548361466E-7
New Minimum: -60.23964549537824 > -67.55781863455132
END: th(1.6843397559414055E7)=-67.55781863455132; dx=-2.121658454691451E-7 evalInputDelta=7.3181731391730835
Fitness changed from -60.23964549537824 to -67.55781863455132
Iteration 5 complete. Error: -67.55781863455132 Total: 22.1162; Orientation: 2.5229; Line Search: 12.3733
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7c2f1f54 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.283e+04, gradient 9.008e-04, dot -0.405; [7217d61d-9ba3-400f-b5fd-246ab969804b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.55781863455132, -48.18169884569156, -44.98431865894455, -44.98431697997611
LBFGS Accumulation History: 3 points
Removed measurement 7c2f1f54 to history. Total: 3
th(0)=-67.55781863455132;dx=-8.102890332774433E-7
Armijo: th(3.628800000000001E7)=-67.04238464812663; dx=1.9902990247222623E-7 evalInputDelta=-0.5154339864246964
New Minimum: -67.55781863455132 > -71.24653438148414
WOLF (strong): th(1.8144000000000004E7)=-71.24653438148414; dx=1.48671259638042E-7 evalInputDelta=3.6887157469328145
New Minimum: -71.24653438148414 > -71.29544678932615
END: th(6048000.000000001)=-71.29544678932615; dx=-3.1860182166640216E-7 evalInputDelta=3.737628154774825
Fitness changed from -67.55781863455132 to -71.29544678932615
Iteration 6 complete. Error: -71.29544678932615 Total: 34.8264; Orientation: 2.5834; Line Search: 24.9114
Adding measurement 32514306 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.714e+04, gradient 6.689e-04, dot -0.635; [7217d61d-9ba3-400f-b5fd-246ab969804b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -71.29544678932615, -48.18169884569156, -44.98431865894455, -44.98431697997611
LBFGS Accumulation History: 3 points
Removed measurement 32514306 to history. Total: 3
th(0)=-71.29544678932615;dx=-4.4509443165568085E-7
New Minimum: -71.29544678932615 > -75.47248923250301
END: th(1.3030021005312836E7)=-75.47248923250301; dx=-1.9584708487679748E-7 evalInputDelta=4.177042443176859
Fitness changed from -71.29544678932615 to -75.47248923250301
Iteration 7 complete. Error: -75.47248923250301 Total: 21.0803; Orientation: 2.5794; Line Search: 12.5695
Adding measurement 18df7f84 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.202e+04, gradient 7.501e-04, dot -0.531; [7217d61d-9ba3-400f-b5fd-246ab969804b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.47248923250301, -48.18169884569156, -44.98431865894455, -44.98431697997611
LBFGS Accumulation History: 3 points
Removed measurement 18df7f84 to history. Total: 3
th(0)=-75.47248923250301;dx=-5.61827345306896E-7
New Minimum: -75.47248923250301 > -77.31679629083281
WOLF (strong): th(2.8072329265690096E7)=-77.31679629083281; dx=1.0343875463522252E-7 evalInputDelta=1.8443070583298038
New Minimum: -77.31679629083281 > -78.62491737568659
WOLF (strong): th(1.4036164632845048E7)=-78.62491737568659; dx=6.4498927937067425E-9 evalInputDelta=3.1524281431835846
END: th(4678721.544281683)=-77.641831489559; dx=-2.9573218036972404E-7 evalInputDelta=2.1693422570559875
Fitness changed from -75.47248923250301 to -78.62491737568659
Iteration 8 complete. Error: -78.62491737568659 Total: 33.4810; Orientation: 2.5420; Line Search: 24.8072
Adding measurement 6d6a4778 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.281e+04, gradient 8.614e-04, dot -0.398; [7217d61d-9ba3-400f-b5fd-246ab969804b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -78.62491737568659, -48.18169884569156, -44.98431865894455, -44.98431697997611
LBFGS Accumulation History: 3 points
Removed measurement 6d6a4778 to history. Total: 3
th(0)=-78.62491737568659;dx=-7.407433151739467E-7
New Minimum: -78.62491737568659 > -82.70146352701501
WOLF (strong): th(1.0080000000000004E7)=-82.70146352701501; dx=7.178846042347428E-9 evalInputDelta=4.076546151328415
END: th(5040000.000000002)=-81.77169764378931; dx=-3.883903459596492E-7 evalInputDelta=3.1467802681027166
Fitness changed from -78.62491737568659 to -82.70146352701501
Iteration 9 complete. Error: -82.70146352701501 Total: 27.3266; Orientation: 2.6432; Line Search: 18.6591
Adding measurement 54c92c6b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.078e+04, gradient 7.081e-04, dot -0.522; [7217d61d-9ba3-400f-b5fd-246ab969804b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.70146352701501, -48.18169884569156, -44.98431865894455, -44.98431697997611
LBFGS Accumulation History: 3 points
Removed measurement 54c92c6b to history. Total: 3
th(0)=-82.70146352701501;dx=-4.9911562127645E-7
New Minimum: -82.70146352701501 > -85.56668482525929
END: th(1.0858350837760698E7)=-85.56668482525929; dx=-3.3452392618085547E-8 evalInputDelta=2.865221298244279
Fitness changed from -82.70146352701501 to -85.56668482525929
Iteration 10 complete. Error: -85.56668482525929 Total: 20.4962; Orientation: 2.4681; Line Search: 12.1980
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -85.56668482525929 (> -Infinity) after 302.116s (< 5400.000s)
Returns
-85.56668482525929