BasicOptimizer.scala:89 executed in 125.99 seconds (2.026 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 2462871911144
Reset training subject: 2463969606878
Adding measurement 5bc2a39 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1.640817513167489;dx=-1.129926874420087E-4
New Minimum: -1.640817513167489 > -1.6410805702019418
WOLFE (weak): th(2.154434690031884)=-1.6410805702019418; dx=-1.1302875083533999E-4 evalInputDelta=2.6305703445284045E-4
New Minimum: -1.6410805702019418 > -1.641344469701157
WOLFE (weak): th(4.308869380063768)=-1.641344469701157; dx=-1.1317135158164317E-4 evalInputDelta=5.26956533668077E-4
New Minimum: -1.641344469701157 > -1.642402243829534
WOLFE (weak): th(12.926608140191302)=-1.642402243829534; dx=-1.1309774627764445E-4 evalInputDelta=0.0015847306620451196
New Minimum: -1.642402243829534 > -1.6471597843906127
WOLFE (weak): th(51.70643256076521)=-1.6471597843906127; dx=-1.1210152911527101E-4 evalInputDelta=0.006342271223123808
New Minimum: -1.6471597843906127 > -1.672497843299724
WOLFE (weak): th(258.53216280382605)=-1.672497843299724; dx=-1.1010681477394256E-4 evalInputDelta=0.031680330132235035
New Minimum: -1.672497843299724 > -1.8142134627709574
END: th(1551.1929768229563)=-1.8142134627709574; dx=-9.401712224285956E-5 evalInputDelta=0.1733959496034685
Fitness changed from -1.640817513167489 to -1.8142134627709574
Iteration 1 complete. Error: -1.8142134627709574 Total: 12.1752; Orientation: 0.0200; Line Search: 8.9293
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4bc91913 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1.8142134627709574;dx=-9.012325650426624E-5
New Minimum: -1.8142134627709574 > -2.0985840562595257
END: th(3341.943960201201)=-2.0985840562595257; dx=-6.777483744327773E-5 evalInputDelta=0.2843705934885683
Fitness changed from -1.8142134627709574 to -2.0985840562595257
Iteration 2 complete. Error: -2.0985840562595257 Total: 3.3082; Orientation: 0.0206; Line Search: 2.2040
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 34667246 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-2.0985840562595257;dx=-6.760056531054947E-5
New Minimum: -2.0985840562595257 > -2.4925417662807203
END: th(7200.000000000001)=-2.4925417662807203; dx=-4.025686149880051E-5 evalInputDelta=0.3939577100211946
Fitness changed from -2.0985840562595257 to -2.4925417662807203
Iteration 3 complete. Error: -2.4925417662807203 Total: 3.2903; Orientation: 0.0186; Line Search: 2.1881
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3a956c27 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.001e+02, gradient 8.021e-03, dot -0.672; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.4925417662807203, -2.0985840562595257, -1.8142134627709574, -1.640817513167489
LBFGS Accumulation History: 3 points
Removed measurement 3a956c27 to history. Total: 3
th(0)=-2.4925417662807203;dx=-6.425708875003978E-5
New Minimum: -2.4925417662807203 > -2.893143430636693
END: th(15511.929768229566)=-2.893143430636693; dx=-1.6817135618527545E-5 evalInputDelta=0.4006016643559729
Fitness changed from -2.4925417662807203 to -2.893143430636693
Iteration 4 complete. Error: -2.893143430636693 Total: 3.7390; Orientation: 0.4560; Line Search: 2.2111
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4b317118 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.688e+02, gradient 9.094e-03, dot -0.394; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.893143430636693, -2.0985840562595257, -1.8142134627709574, -1.640817513167489
LBFGS Accumulation History: 3 points
Removed measurement 4b317118 to history. Total: 3
th(0)=-2.893143430636693;dx=-8.235893399730711E-5
New Minimum: -2.893143430636693 > -3.5048546687932065
END: th(33419.43960201202)=-3.5048546687932065; dx=-5.875761201170539E-6 evalInputDelta=0.6117112381565133
Fitness changed from -2.893143430636693 to -3.5048546687932065
Iteration 5 complete. Error: -3.5048546687932065 Total: 3.7573; Orientation: 0.4616; Line Search: 2.2076
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 3806fbf5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.311e+02, gradient 1.223e-02, dot -0.215; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -3.5048546687932065, -2.0985840562595257, -1.8142134627709574, -1.640817513167489
LBFGS Accumulation History: 3 points
Removed measurement 3806fbf5 to history. Total: 3
th(0)=-3.5048546687932065;dx=-1.493109173516614E-4
New Minimum: -3.5048546687932065 > -4.4295016414101855
END: th(72000.00000000003)=-4.4295016414101855; dx=-2.6125792357905853E-6 evalInputDelta=0.924646972616979
Fitness changed from -3.5048546687932065 to -4.4295016414101855
Iteration 6 complete. Error: -4.4295016414101855 Total: 3.8112; Orientation: 0.4610; Line Search: 2.2844
Adding measurement 65251e22 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.408e+03, gradient 2.186e-02, dot -0.085; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -4.4295016414101855, -2.0985840562595257, -1.8142134627709574, -1.640817513167489
LBFGS Accumulation History: 3 points
Removed measurement 65251e22 to history. Total: 3
th(0)=-4.4295016414101855;dx=-4.777096622009386E-4
New Minimum: -4.4295016414101855 > -6.802864249532263
WOLF (strong): th(155119.2976822957)=-6.802864249532263; dx=1.5777336347763078E-6 evalInputDelta=2.3733626081220773
New Minimum: -6.802864249532263 > -7.7999982658545
END: th(77559.64884114785)=-7.7999982658545; dx=-5.584655703577144E-6 evalInputDelta=3.370496624444314
Fitness changed from -4.4295016414101855 to -7.7999982658545
Iteration 7 complete. Error: -7.7999982658545 Total: 4.8491; Orientation: 0.4601; Line Search: 3.3343
Adding measurement 60b6ee52 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.246e+03, gradient 2.471e-02, dot -0.053; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -7.7999982658545, -2.0985840562595257, -1.8142134627709574, -1.640817513167489
LBFGS Accumulation History: 3 points
Removed measurement 60b6ee52 to history. Total: 3
th(0)=-7.7999982658545;dx=-6.105955528011442E-4
New Minimum: -7.7999982658545 > -10.473046419622284
WOLF (strong): th(167097.19801006012)=-10.473046419622284; dx=1.329258345455612E-6 evalInputDelta=2.673048153767784
New Minimum: -10.473046419622284 > -11.84441819938397
END: th(83548.59900503006)=-11.84441819938397; dx=-1.0886987387469074E-6 evalInputDelta=4.04441993352947
Fitness changed from -7.7999982658545 to -11.84441819938397
Iteration 8 complete. Error: -11.84441819938397 Total: 4.8465; Orientation: 0.4448; Line Search: 3.3532
Adding measurement 4d36ca75 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.165e+04, gradient 3.134e-02, dot -0.038; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -11.84441819938397, -2.0985840562595257, -1.8142134627709574, -1.640817513167489
LBFGS Accumulation History: 3 points
Removed measurement 4d36ca75 to history. Total: 3
th(0)=-11.84441819938397;dx=-9.81504652629218E-4
New Minimum: -11.84441819938397 > -13.204158013497265
WOLF (strong): th(180000.0000000001)=-13.204158013497265; dx=2.2362935610733467E-5 evalInputDelta=1.3597398141132953
New Minimum: -13.204158013497265 > -21.29995515527329
WOLF (strong): th(90000.00000000004)=-21.29995515527329; dx=2.1393031377852194E-5 evalInputDelta=9.455536955889322
New Minimum: -21.29995515527329 > -24.370385263747316
END: th(30000.000000000015)=-24.370385263747316; dx=-1.3825610127861978E-4 evalInputDelta=12.525967064363346
Fitness changed from -11.84441819938397 to -24.370385263747316
I
...skipping 1239 bytes...
=-3.5916546768746684
New Minimum: -24.370385263747316 > -25.63490630428967
END: th(0.17811133350131322)=-25.63490630428967; dx=-8.778978794585726 evalInputDelta=1.2645210405423555
Fitness changed from -24.370385263747316 to -25.63490630428967
Iteration 10 complete. Error: -25.63490630428967 Total: 12.7514; Orientation: 0.4522; Line Search: 11.2587
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Adding measurement 61a08883 to history. Total: 4
Accepted: LBFGS Orientation magnitude: 2.769e+03, gradient 3.218e-02, dot 0.066; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
th(0)=-25.63490630428967;dx=-5.895919965741866
New Minimum: -25.63490630428967 > -25.646151545321352
END: th(0.38372923558306726)=-25.646151545321352; dx=-2.022220260926723 evalInputDelta=0.011245241031680564
Fitness changed from -25.63490630428967 to -25.646151545321352
Iteration 11 complete. Error: -25.646151545321352 Total: 4.0425; Orientation: 0.5562; Line Search: 2.2429
Adding measurement 265b414e to history. Total: 5
Accepted: LBFGS Orientation magnitude: 1.867e+03, gradient 3.059e-02, dot 0.032; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
th(0)=-25.646151545321352;dx=-1.8428513585794817
Armijo: th(0.8267195767195772)=-23.930008476508302; dx=0.18398569142202392 evalInputDelta=-1.7161430688130501
Armijo: th(0.4133597883597886)=-24.88031364124545; dx=-0.07837848086743117 evalInputDelta=-0.7658379040759016
Armijo: th(0.13778659611992952)=-25.43504955072565; dx=-0.384865800634276 evalInputDelta=-0.21110199459570111
Armijo: th(0.03444664902998238)=-25.597136779318006; dx=-0.5655398457901097 evalInputDelta=-0.049014766003345756
Armijo: th(0.006889329805996476)=-25.636662445679534; dx=-0.6635762216007358 evalInputDelta=-0.009489099641818655
Armijo: th(0.0011482216343327459)=-25.644559756927386; dx=-0.6633925296447146 evalInputDelta=-0.0015917883939664534
Armijo: th(1.6403166204753512E-4)=-25.645919646572523; dx=-0.6726468814665876 evalInputDelta=-2.3189874882945105E-4
Armijo: th(2.050395775594189E-5)=-25.646120852960287; dx=-0.6796334486043614 evalInputDelta=-3.0692361065121077E-5
Armijo: th(2.2782175284379877E-6)=-25.646148987626; dx=-0.6721585352733328 evalInputDelta=-2.557695353289091E-6
Armijo: th(2.2782175284379878E-7)=-25.646151545321352; dx=-0.6740872759828676 evalInputDelta=0.0
Armijo: th(2.0711068440345342E-8)=-25.646151545321352; dx=-0.6700894730114002 evalInputDelta=0.0
New Minimum: -25.646151545321352 > -25.646153250451444
END: th(1.7259223700287784E-9)=-25.646153250451444; dx=-0.6821956982723183 evalInputDelta=1.7051300922332757E-6
Fitness changed from -25.646151545321352 to -25.646153250451444
Iteration 12 complete. Error: -25.646153250451444 Total: 17.5269; Orientation: 0.8153; Line Search: 15.6428
Adding measurement 61cc3a1f to history. Total: 6
Rejected: LBFGS Orientation magnitude: 6.938e+03, gradient 3.059e-02, dot -0.027; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -25.646153250451444, -25.646151545321352, -25.63490630428967, -24.370385263747316, -2.0985840562595257, -1.8142134627709574, -1.640817513167489
Rejected: LBFGS Orientation magnitude: 1.081e+04, gradient 3.059e-02, dot -0.037; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -25.646153250451444, -25.646151545321352, -25.63490630428967, -24.370385263747316, -2.0985840562595257, -1.8142134627709574
Accepted: LBFGS Orientation magnitude: 1.260e+04, gradient 3.059e-02, dot 0.067; [9de0a1ee-682d-4827-8dc9-f53c799e6c0c = 1.000/1.000e+00]
Overwriting history with 5 points
th(0)=-25.646153250451444;dx=-25.810187765646617
Armijo: th(3.7183870262920457E-9)=-25.646149840191143; dx=-19.51405201291055 evalInputDelta=-3.410260301706103E-6
Armijo: th(1.8591935131460228E-9)=-25.646151545321352; dx=-19.446113950994963 evalInputDelta=-1.7051300922332757E-6
Armijo: th(6.197311710486743E-10)=-25.646151545321352; dx=-19.470403066433313 evalInputDelta=-1.7051300922332757E-6
Armijo: th(1.5493279276216857E-10)=-25.646151545321352; dx=-19.412597531365105 evalInputDelta=-1.7051300922332757E-6
MIN ALPHA (3.0986558552433714E-11): th(0.0)=-25.646153250451444
Fitness changed from -25.646153250451444 to -25.646153250451444
Static Iteration Total: 10.3380; Orientation: 2.4850; Line Search: 6.7920
Iteration 13 failed. Error: -25.646153250451444
Previous Error: 0.0 -> -25.646153250451444
Retrying iteration 13
Reset training subject: 2553296716039
Adding measurement 7650522 to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-25.646153250451444;dx=-9.355404747433922E-4
WOLFE (weak): th(2.1544346900318838E-10)=-25.646153250451444; dx=-9.199847012879387E-4 evalInputDelta=0.0
WOLFE (weak): th(4.3088693800637676E-10)=-25.646153250451444; dx=-9.20153642079954E-4 evalInputDelta=0.0
WOLFE (weak): th(1.2926608140191302E-9)=-25.646153250451444; dx=-9.201303537413579E-4 evalInputDelta=0.0
WOLFE (weak): th(5.170643256076521E-9)=-25.646153250451444; dx=-9.204836344606023E-4 evalInputDelta=0.0
WOLFE (weak): th(2.5853216280382606E-8)=-25.646153250451444; dx=-9.20069245283683E-4 evalInputDelta=0.0
WOLFE (weak): th(1.5511929768229565E-7)=-25.646153250451444; dx=-9.200826918734657E-4 evalInputDelta=0.0
WOLFE (weak): th(1.0858350837760695E-6)=-25.646153250451444; dx=-9.202281504555388E-4 evalInputDelta=0.0
Armijo: th(8.686680670208556E-6)=-25.646148987626; dx=-9.202407877654452E-4 evalInputDelta=-4.262825445522367E-6
Armijo: th(4.886257876992313E-6)=-25.646151545321352; dx=-9.200318900787898E-4 evalInputDelta=-1.7051300922332757E-6
Armijo: th(2.986046480384191E-6)=-25.646151545321352; dx=-9.201992601806559E-4 evalInputDelta=-1.7051300922332757E-6
Armijo: th(2.0359407820801304E-6)=-25.646149840191143; dx=-9.199302599211684E-4 evalInputDelta=-3.410260301706103E-6
Armijo: th(1.5608879329281E-6)=-25.646149840191143; dx=-9.201487413553498E-4 evalInputDelta=-3.410260301706103E-6
Armijo: th(1.3233615083520847E-6)=-25.646149840191143; dx=-9.201684166168685E-4 evalInputDelta=-3.410260301706103E-6
WOLFE (weak): th(1.2045982960640772E-6)=-25.646153250451444; dx=-9.202010803479209E-4 evalInputDelta=0.0
Armijo: th(1.263979902208081E-6)=-25.646151545321352; dx=-9.202443816196522E-4 evalInputDelta=-1.7051300922332757E-6
Armijo: th(1.2342890991360792E-6)=-25.646151545321352; dx=-9.202496845776408E-4 evalInputDelta=-1.7051300922332757E-6
WOLFE (weak): th(1.219443697600078E-6)=-25.646153250451444; dx=-9.200372776872388E-4 evalInputDelta=0.0
WOLFE (weak): th(1.2268663983680785E-6)=-25.646153250451444; dx=-9.200178125237659E-4 evalInputDelta=0.0
WOLFE (weak): th(1.2305777487520787E-6)=-25.646153250451444; dx=-9.202413934056954E-4 evalInputDelta=0.0
Armijo: th(1.2324334239440788E-6)=-25.646151545321352; dx=-9.202283539739057E-4 evalInputDelta=-1.7051300922332757E-6
WOLFE (weak): th(1.2315055863480788E-6)=-25.646153250451444; dx=-9.20329954177269E-4 evalInputDelta=0.0
Armijo: th(1.231969505146079E-6)=-25.646151545321352; dx=-9.202333793985106E-4 evalInputDelta=-1.7051300922332757E-6
Armijo: th(1.231737545747079E-6)=-25.646151545321352; dx=-9.202126131699559E-4 evalInputDelta=-1.7051300922332757E-6
WOLFE (weak): th(1.231621566047579E-6)=-25.646153250451444; dx=-9.202439918109799E-4 evalInputDelta=0.0
Armijo: th(1.231679555897329E-6)=-25.646151545321352; dx=-9.199898179733473E-4 evalInputDelta=-1.7051300922332757E-6
WOLFE (weak): th(1.231650560972454E-6)=-25.646153250451444; dx=-9.20279057707046E-4 evalInputDelta=0.0
Armijo: th(1.2316650584348914E-6)=-25.646151545321352; dx=-9.202050350826366E-4 evalInputDelta=-1.7051300922332757E-6
Armijo: th(1.2316578097036728E-6)=-25.646151545321352; dx=-9.200888180646895E-4 evalInputDelta=-1.7051300922332757E-6
mu ~= nu (1.231650560972454E-6): th(0.0)=-25.646153250451444
Fitness changed from -25.646153250451444 to -25.646153250451444
Static Iteration Total: 35.5683; Orientation: 0.0194; Line Search: 33.4382
Iteration 14 failed. Error: -25.646153250451444
Previous Error: 0.0 -> -25.646153250451444
Optimization terminated 14
Final threshold in iteration 14: -25.646153250451444 (> -Infinity) after 125.994s (< 3600.000s)
Returns
-25.646153250451444