BasicOptimizer.scala:89 executed in 218.00 seconds (3.264 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 684058793355200
Reset training subject: 684063435871800
Adding measurement 76e23c01 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1067.7192397816946;dx=-0.00695994263888167
New Minimum: -1067.7192397816946 > -1067.7348687759522
WOLFE (weak): th(2.154434690031884)=-1067.7348687759522; dx=-0.0066138103763083815 evalInputDelta=0.015628994257667728
New Minimum: -1067.7348687759522 > -1067.750439007168
WOLFE (weak): th(4.308869380063768)=-1067.750439007168; dx=-0.006612852178144066 evalInputDelta=0.031199225473528713
New Minimum: -1067.750439007168 > -1067.8127176616695
WOLFE (weak): th(12.926608140191302)=-1067.8127176616695; dx=-0.006612217951102559 evalInputDelta=0.09347787997489831
New Minimum: -1067.8127176616695 > -1068.0931607308419
WOLFE (weak): th(51.70643256076521)=-1068.0931607308419; dx=-0.00660683169134877 evalInputDelta=0.3739209491473048
New Minimum: -1068.0931607308419 > -1069.5870698545305
WOLFE (weak): th(258.53216280382605)=-1069.5870698545305; dx=-0.006592814784551596 evalInputDelta=1.8678300728358863
New Minimum: -1069.5870698545305 > -1078.8661872540079
WOLFE (weak): th(1551.1929768229563)=-1078.8661872540079; dx=-0.006525284049627259 evalInputDelta=11.146947472313286
New Minimum: -1078.8661872540079 > -1142.2975203509811
END: th(10858.350837760694)=-1142.2975203509811; dx=-0.005910030864997102 evalInputDelta=74.57828056928656
Fitness changed from -1067.7192397816946 to -1142.2975203509811
Iteration 1 complete. Error: -1142.2975203509811 Total: 49.9751; Orientation: 0.0988; Line Search: 36.2254
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement bfb4e6c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1142.2975203509811;dx=-0.005545413221632595
New Minimum: -1142.2975203509811 > -1268.8924304289942
END: th(23393.607721408407)=-1268.8924304289942; dx=-0.004333792700026411 evalInputDelta=126.59491007801307
Fitness changed from -1142.2975203509811 to -1268.8924304289942
Iteration 2 complete. Error: -1268.8924304289942 Total: 15.1584; Orientation: 0.0995; Line Search: 9.4481
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 753370fb to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1268.8924304289942;dx=-0.003979998386767448
New Minimum: -1268.8924304289942 > -1449.6067570206756
END: th(50400.00000000001)=-1449.6067570206756; dx=-0.002618399908793908 evalInputDelta=180.71432659168136
Fitness changed from -1268.8924304289942 to -1449.6067570206756
Iteration 3 complete. Error: -1449.6067570206756 Total: 14.5248; Orientation: 0.0980; Line Search: 9.1347
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5551d9f1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.134e+04, gradient 5.157e-02, dot -0.842; [f43f8f0f-9754-44e7-a82c-7b1334fd9c79 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1449.6067570206756, -1268.8924304289942, -1142.2975203509811, -1067.7192397816946
LBFGS Accumulation History: 3 points
Removed measurement 5551d9f1 to history. Total: 3
th(0)=-1449.6067570206756;dx=-0.0026550545407166013
New Minimum: -1449.6067570206756 > -1670.343976550938
END: th(108583.50837760697)=-1670.343976550938; dx=-0.0013027200007173414 evalInputDelta=220.73721953026234
Fitness changed from -1449.6067570206756 to -1670.343976550938
Iteration 4 complete. Error: -1670.343976550938 Total: 16.4755; Orientation: 1.7364; Line Search: 9.1627
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 28a1ea12 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.098e+04, gradient 5.096e-02, dot -0.614; [f43f8f0f-9754-44e7-a82c-7b1334fd9c79 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1670.343976550938, -1268.8924304289942, -1142.2975203509811, -1067.7192397816946
LBFGS Accumulation History: 3 points
Removed measurement 28a1ea12 to history. Total: 3
th(0)=-1670.343976550938;dx=-0.0025957221448935806
New Minimum: -1670.343976550938 > -1866.8675635941613
END: th(233936.07721408413)=-1866.8675635941613; dx=-3.0338236079162053E-4 evalInputDelta=196.52358704322342
Fitness changed from -1670.343976550938 to -1866.8675635941613
Iteration 5 complete. Error: -1866.8675635941613 Total: 16.1612; Orientation: 1.6537; Line Search: 9.2419
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 74852572 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.033e+04, gradient 5.802e-02, dot -0.359; [f43f8f0f-9754-44e7-a82c-7b1334fd9c79 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1866.8675635941613, -1268.8924304289942, -1142.2975203509811, -1067.7192397816946
LBFGS Accumulation History: 3 points
Removed measurement 74852572 to history. Total: 3
th(0)=-1866.8675635941613;dx=-0.00335902314929367
New Minimum: -1866.8675635941613 > -1893.1298819679541
WOLF (strong): th(504000.0000000002)=-1893.1298819679541; dx=4.6656762580790456E-4 evalInputDelta=26.262318373792823
New Minimum: -1893.1298819679541 > -2032.712227542305
WOLF (strong): th(252000.0000000001)=-2032.712227542305; dx=3.5419378151864303E-4 evalInputDelta=165.84466394814376
New Minimum: -2032.712227542305 > -2042.749862317949
END: th(84000.00000000003)=-2042.749862317949; dx=-7.773648613508947E-4 evalInputDelta=175.8822987237877
Fitness changed from -1866.8675635941613 to -2042.749862317949
Iteration 6 complete. Error: -2042.749862317949 Total: 25.4531; Orientation: 1.6221; Line Search: 18.3854
Adding measurement 790a7e47 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.512e+04, gradient 4.624e-02, dot -0.460; [f43f8f0f-9754-44e7-a82c-7b1334fd9c79 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2042.749862317949, -1268.8924304289942, -1142.2975203509811, -1067.7192397816946
LBFGS Accumulation History: 3 points
Removed measurement 790a7e47 to history. Total: 3
th(0)=-2042.749862317949;dx=-0.0021342609091243906
New Minimum: -2042.749862317949 > -2205.7439787971766
END: th(180972.5139626783)=-2205.7439787971766; dx=-2.3082516628492787E-4 evalInputDelta=162.9941164792276
Fitness changed from -2042.749862317949 to -2205.7439787971766
Iteration 7 complete. Error: -2205.7439787971766 Total: 15.1094; Orientation: 1.5971; Line Search: 9.1141
Adding measurement 19cad14d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.138e+04, gradient 5.680e-02, dot -0.382; [f43f8f0f-9754-44e7-a82c-7b1334fd9c79 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2205.7439787971766, -1268.8924304289942, -1142.2975203509811, -1067.7192397816946
LBFGS Accumulation History: 3 points
Removed measurement 19cad14d to history. Total: 3
th(0)=-2205.7439787971766;dx=-0.003224425241355094
Armijo: th(389893.4620234736)=-2180.2720013796443; dx=5.667706718569508E-4 evalInputDelta=-25.471977417532344
New Minimum: -2205.7439787971766 > -2314.4940051769413
WOLF (strong): th(194946.7310117368)=-2314.4940051769413; dx=4.6894430314975703E-4 evalInputDelta=108.75002637976468
New Minimum: -2314.4940051769413 > -2336.553765698534
END: th(64982.24367057893)=-2336.553765698534; dx=-6.955253184840387E-4 evalInputDelta=130.80978690135726
Fitness changed from -2205.7439787971766 to -2336.553765698534
Iteration 8 complete. Error: -2336.553765698534 Total: 24.7154; Orientation: 1.5904; Line Search: 18.4710
Adding measurement 47ad7747 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.663e+04, gradient 4.156e-02, dot -0.528; [f43f8f0f-9754-44e7-a82c-7b1334fd9c79 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2336.553765698534, -1268.8924304289942, -1142.2975203509811, -1067.7192397816946
LBFGS Accumulation History: 3 points
Removed measurement 47ad7747 to history. Total: 3
th(0)=-2336.553765698534;dx=-0.0017234967458624516
New Minimum: -2336.553765698534 > -2459.4550209345157
END: th(140000.00000000006)=-2459.4550209345157; dx=-4.052406914147478E-4 evalInputDelta=122.90125523598181
Fitness changed from -2336.553765698534 to -2459.4550209345157
Iteration 9 complete. Error: -2459.4550209345157 Total: 14.9800; Orientation: 1.7040; Line Search: 8.9198
Adding measurement c2820ed to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.363e+04, gradient 5.008e-02, dot -0.445; [f43f8f0f-9754-44e7-a82c-7b1334fd9c79 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2459.4550209345157, -1268.8924304289942, -1142.2975203509811, -1067.7192397816946
LBFGS Accumulation History: 3 points
Removed measurement c2820ed to history. Total: 3
th(0)=-2459.4550209345157;dx=-0.0025081930951388236
New Minimum: -2459.4550209345157 > -2485.227152595915
WOLF (strong): th(301620.8566044639)=-2485.227152595915; dx=3.803462995553867E-4 evalInputDelta=25.77213166139927
New Minimum: -2485.227152595915 > -2548.083691718151
WOLF (strong): th(150810.42830223194)=-2548.083691718151; dx=1.8133771987768812E-4 evalInputDelta=88.62867078363524
END: th(50270.142767410645)=-2543.879517587262; dx=-7.069301689405989E-4 evalInputDelta=84.42449665274626
Fitness changed from -2459.4550209345157 to -2548.083691718151
Iteration 10 complete. Error: -2548.083691718151 Total: 24.5826; Orientation: 1.5973; Line Search: 18.2765
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2548.083691718151 (> -Infinity) after 218.001s (< 5400.000s)
Returns
-2548.083691718151