BasicOptimizer.scala:89 executed in 1794.22 seconds (234.195 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 454114741849000
Reset training subject: 454142193679400
Adding measurement 1f4b3fae to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-34.48740271545398;dx=-3.3493886894327377E-6
New Minimum: -34.48740271545398 > -34.48741479924476
WOLFE (weak): th(2.154434690031884)=-34.48741479924476; dx=-3.22383319376457E-6 evalInputDelta=1.2083790778660841E-5
New Minimum: -34.48741479924476 > -34.487424869067176
WOLFE (weak): th(4.308869380063768)=-34.487424869067176; dx=-3.2195129193041537E-6 evalInputDelta=2.2153613194575428E-5
New Minimum: -34.487424869067176 > -34.48747119021242
WOLFE (weak): th(12.926608140191302)=-34.48747119021242; dx=-3.2231481478541137E-6 evalInputDelta=6.847475843585471E-5
New Minimum: -34.48747119021242 > -34.48766855787311
WOLFE (weak): th(51.70643256076521)=-34.48766855787311; dx=-3.217828239968269E-6 evalInputDelta=2.6584241912530615E-4
New Minimum: -34.48766855787311 > -34.48873190705822
WOLFE (weak): th(258.53216280382605)=-34.48873190705822; dx=-3.2169608447059733E-6 evalInputDelta=0.0013291916042348362
New Minimum: -34.48873190705822 > -34.49537911032398
WOLFE (weak): th(1551.1929768229563)=-34.49537911032398; dx=-3.224068945131671E-6 evalInputDelta=0.007976394869999126
New Minimum: -34.49537911032398 > -34.54324504738368
WOLFE (weak): th(10858.350837760694)=-34.54324504738368; dx=-3.2261206100638903E-6 evalInputDelta=0.05584233192969634
New Minimum: -34.54324504738368 > -34.93473164967519
WOLFE (weak): th(86866.80670208555)=-34.93473164967519; dx=-3.230297637804758E-6 evalInputDelta=0.4473289342212112
New Minimum: -34.93473164967519 > -38.46670956689967
WOLFE (weak): th(781801.26031877)=-38.46670956689967; dx=-3.1420837753103597E-6 evalInputDelta=3.979306851445685
New Minimum: -38.46670956689967 > -64.94261341086481
END: th(7818012.6031877)=-64.94261341086481; dx=-1.5062410968970143E-6 evalInputDelta=30.455210695410827
Fitness changed from -34.48740271545398 to -64.94261341086481
Iteration 1 complete. Error: -64.94261341086481 Total: 356.0075; Orientation: 0.1098; Line Search: 276.8829
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4825e853 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-64.94261341086481;dx=-2.9740983576159275E-6
New Minimum: -64.94261341086481 > -103.29764639139317
END: th(1.684339755941405E7)=-103.29764639139317; dx=-4.4337775238554657E-7 evalInputDelta=38.355032980528364
Fitness changed from -64.94261341086481 to -103.29764639139317
Iteration 2 complete. Error: -103.29764639139317 Total: 74.0592; Orientation: 0.1129; Line Search: 49.6149
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 167e5142 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-103.29764639139317;dx=-2.6778989893079658E-6
New Minimum: -103.29764639139317 > -126.90363333160046
WOLF (strong): th(3.6288E7)=-126.90363333160046; dx=3.108138761553114E-7 evalInputDelta=23.605986940207288
New Minimum: -126.90363333160046 > -133.82006243689779
END: th(1.8144E7)=-133.82006243689779; dx=-3.570573673814119E-8 evalInputDelta=30.522416045504613
Fitness changed from -103.29764639139317 to -133.82006243689779
Iteration 3 complete. Error: -133.82006243689779 Total: 104.3028; Orientation: 0.1112; Line Search: 76.4691
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 911a616 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.477e+04, gradient 1.534e-03, dot -0.407; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -133.82006243689779, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 911a616 to history. Total: 3
th(0)=-133.82006243689779;dx=-2.331821797325379E-6
New Minimum: -133.82006243689779 > -143.69375250746492
WOLF (strong): th(3.90900630159385E7)=-143.69375250746492; dx=5.217072571845583E-7 evalInputDelta=9.873690070567136
New Minimum: -143.69375250746492 > -159.72442592201799
WOLF (strong): th(1.954503150796925E7)=-159.72442592201799; dx=2.2422250113313073E-7 evalInputDelta=25.9043634851202
END: th(6515010.502656416)=-152.78686700271982; dx=-1.1671185797208415E-6 evalInputDelta=18.96680456582203
Fitness changed from -133.82006243689779 to -159.72442592201799
Iteration 4 complete. Error: -159.72442592201799 Total: 132.2250; Orientation: 2.0245; Line Search: 104.1381
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4b0f0353 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.318e+04, gradient 1.434e-03, dot -0.352; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -159.72442592201799, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 4b0f0353 to history. Total: 3
th(0)=-159.72442592201799;dx=-2.0555220631131455E-6
New Minimum: -159.72442592201799 > -183.42151456544153
END: th(1.4036164632845044E7)=-183.42151456544153; dx=-1.1002180046518329E-7 evalInputDelta=23.69708864342354
Fitness changed from -159.72442592201799 to -183.42151456544153
Iteration 5 complete. Error: -183.42151456544153 Total: 79.2236; Orientation: 1.9810; Line Search: 52.0618
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4967f35d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.767e+04, gradient 1.098e-03, dot -0.425; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -183.42151456544153, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 4967f35d to history. Total: 3
th(0)=-183.42151456544153;dx=-1.2048056450419797E-6
New Minimum: -183.42151456544153 > -195.09448282404284
WOLF (strong): th(3.0240000000000004E7)=-195.09448282404284; dx=2.674586133440164E-7 evalInputDelta=11.672968258601315
New Minimum: -195.09448282404284 > -198.6815403641684
END: th(1.5120000000000002E7)=-198.6815403641684; dx=-1.2840843170332015E-7 evalInputDelta=15.260025798726872
Fitness changed from -183.42151456544153 to -198.6815403641684
Iteration 6 complete. Error: -198.6815403641684 Total: 107.9693; Orientation: 2.0136; Line Search: 77.7521
Adding measurement 462c48a4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.323e+04, gradient 1.044e-03, dot -0.420; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -198.6815403641684, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 462c48a4 to history. Total: 3
th(0)=-198.6815403641684;dx=-1.0836205562860487E-6
New Minimum: -198.6815403641684 > -204.3090999743779
WOLF (strong): th(3.2575052513282087E7)=-204.3090999743779; dx=3.19264424245482E-7 evalInputDelta=5.627559610209488
New Minimum: -204.3090999743779 > -210.9466595978792
WOLF (strong): th(1.6287526256641043E7)=-210.9466595978792; dx=1.9041727253501703E-8 evalInputDelta=12.265119233710806
END: th(5429175.418880348)=-206.48177270120786; dx=-6.208618841275056E-7 evalInputDelta=7.800232337039461
Fitness changed from -198.6815403641684 to -210.9466595978792
Iteration 7 complete. Error: -210.9466595978792 Total: 124.4653; Orientation: 1.9924; Line Search: 97.8171
Adding measurement 631c95eb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.619e+04, gradient 1.060e-03, dot -0.394; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -210.9466595978792, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 631c95eb to history. Total: 3
th(0)=-210.9466595978792;dx=-1.1191477097256647E-6
New Minimum: -210.9466595978792 > -222.59556944686395
END: th(1.1696803860704206E7)=-222.59556944686395; dx=-1.1267342599831586E-7 evalInputDelta=11.648909848984744
Fitness changed from -210.9466595978792 to -222.59556944686395
Iteration 8 complete. Error: -222.59556944686395 Total: 80.5093; Orientation: 1.9915; Line Search: 53.6425
Adding measurement 5f67521a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.745e+04, gradient 8.481e-04, dot -0.453; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -222.59556944686395, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 5f67521a to history. Total: 3
th(0)=-222.59556944686395;dx=-7.176387040021127E-7
New Minimum: -222.59556944686395 > -230.9934602279795
WOLF (strong): th(2.5200000000000007E7)=-230.9934602279795; dx=8.893550672559752E-8 evalInputDelta=8.397890781115564
New Minimum: -230.9934602279795 > -231.21376503374853
END: th(1.2600000000000004E7)=-231.21376503374853; dx=-1.6128399777850678E-7 evalInputDelta=8.618195586884582
Fitness changed from -222.59556944686395 to -231.21376503374853
Iteration 9 complete. Error: -231.21376503374853 Total: 105.2377; Orientation: 2.0502; Line Search: 76.3883
Adding measurement 12f022a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.117e+04, gradient 8.203e-04, dot -0.455; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -231.21376503374853, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 12f022a to history. Total: 3
th(0)=-231.21376503374853;dx=-6.679093907814589E-7
New Minimum: -231.21376503374853 > -237.37503691496215
WOLF (strong): th(2.7145877094401743E7)=-237.37503691496215; dx=1.184313760578106E-7 evalInputDelta=6.161271881213622
New Minimum: -237.37503691496215 > -238.81507469295067
END: th(1.3572938547200872E7)=-238.81507469295067; dx=-8.722396255180857E-8 evalInputDelta=7.601309659202144
Fitness changed from -231.21376503374853 to -238.81507469295067
Iteration 10 complete. Error: -238.81507469295067 Total: 99.3135; Orientation: 2.0680; Line Search: 74.3395
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Adding measurement 254ed596 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.078e+04, gradient 8.405e-04, dot -0.424; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -238.81507469295067, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 254ed596 to history. Total: 3
th(0)=-238.81507469295067;dx=-7.057899995571967E-7
New Minimum: -238.81507469295067 > -241.34111501342784
WOLF (strong): th(2.924200965176052E7)=-241.34111501342784; dx=2.3082086359111248E-7 evalInputDelta=2.526040320477165
New Minimum: -241.34111501342784 > -245.87274838881098
WOLF (strong): th(1.462100482588026E7)=-245.87274838881098; dx=1.311166201710419E-8 evalInputDelta=7.057673695860302
END: th(4873668.27529342)=-243.39472999193424; dx=-4.031379726950833E-7 evalInputDelta=4.5796552989835675
Fitness changed from -238.81507469295067 to -245.87274838881098
Iteration 11 complete. Error: -245.87274838881098 Total: 135.1294; Orientation: 1.9845; Line Search: 106.6770
Adding measurement 2d1db1b9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.231e+04, gradient 8.712e-04, dot -0.398; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -245.87274838881098, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 2d1db1b9 to history. Total: 3
th(0)=-245.87274838881098;dx=-7.579462269978577E-7
New Minimum: -245.87274838881098 > -253.06853168016212
END: th(1.0500000000000006E7)=-253.06853168016212; dx=-9.03139951562688E-8 evalInputDelta=7.195783291351148
Fitness changed from -245.87274838881098 to -253.06853168016212
Iteration 12 complete. Error: -253.06853168016212 Total: 78.2834; Orientation: 2.0972; Line Search: 50.4247
Adding measurement 77fa0c99 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.923e+04, gradient 7.025e-04, dot -0.455; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -253.06853168016212, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 77fa0c99 to history. Total: 3
th(0)=-253.06853168016212;dx=-4.933282208974885E-7
New Minimum: -253.06853168016212 > -258.83240420615766
WOLF (strong): th(2.2621564245334793E7)=-258.83240420615766; dx=3.654922805605675E-8 evalInputDelta=5.763872525995538
END: th(1.1310782122667396E7)=-258.57343529369706; dx=-1.3596174913621311E-7 evalInputDelta=5.504903613534935
Fitness changed from -253.06853168016212 to -258.83240420615766
Iteration 13 complete. Error: -258.83240420615766 Total: 104.4837; Orientation: 2.0850; Line Search: 78.8935
Adding measurement 6b0f0678 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.332e+04, gradient 9.533e-04, dot -0.340; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -258.83240420615766, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 6b0f0678 to history. Total: 3
th(0)=-258.83240420615766;dx=-9.084423337226936E-7
New Minimum: -258.83240420615766 > -260.85901643288327
WOLF (strong): th(2.4368341376467105E7)=-260.85901643288327; dx=4.030221226554906E-7 evalInputDelta=2.0266122267256037
New Minimum: -260.85901643288327 > -267.3764862850337
WOLF (strong): th(1.2184170688233553E7)=-267.3764862850337; dx=4.32827420022895E-8 evalInputDelta=8.544082078876045
END: th(4061390.2294111843)=-264.09884542659506; dx=-5.725445046153576E-7 evalInputDelta=5.2664412204374
Fitness changed from -258.83240420615766 to -267.3764862850337
Iteration 14 complete. Error: -267.3764862850337 Total: 137.2482; Orientation: 1.9805; Line Search: 107.8599
Adding measurement 678dea50 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.725e+04, gradient 7.178e-04, dot -0.402; [dd0c8116-9c18-413d-9a0d-f4f3bef4d867 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -267.3764862850337, -103.29764639139317, -64.94261341086481, -34.48740271545398
LBFGS Accumulation History: 3 points
Removed measurement 678dea50 to history. Total: 3
th(0)=-267.3764862850337;dx=-5.127485056521083E-7
New Minimum: -267.3764862850337 > -272.1261250199425
END: th(8750000.000000006)=-272.1261250199425; dx=-1.5966919533601775E-7 evalInputDelta=4.749638734908785
Fitness changed from -267.3764862850337 to -272.1261250199425
Iteration 15 complete. Error: -272.1261250199425 Total: 75.1528; Orientation: 1.8613; Line Search: 48.0362
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: -272.1261250199425 (> -Infinity) after 1794.221s (< 5400.000s)
Returns
-272.1261250199425