BasicOptimizer.scala:89 executed in 218.48 seconds (3.907 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 688150522103800
Reset training subject: 688155139693900
Adding measurement 754b873d to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-991.2452080590352;dx=-0.007611556060223986
New Minimum: -991.2452080590352 > -991.2620743274707
WOLFE (weak): th(2.154434690031884)=-991.2620743274707; dx=-0.007157207539839369 evalInputDelta=0.01686626843547856
New Minimum: -991.2620743274707 > -991.2789087840011
WOLFE (weak): th(4.308869380063768)=-991.2789087840011; dx=-0.007157145857149942 evalInputDelta=0.03370072496591092
New Minimum: -991.2789087840011 > -991.346369842549
WOLFE (weak): th(12.926608140191302)=-991.346369842549; dx=-0.007152827761390902 evalInputDelta=0.10116178351381677
New Minimum: -991.346369842549 > -991.6497617606732
WOLFE (weak): th(51.70643256076521)=-991.6497617606732; dx=-0.007154598916457339 evalInputDelta=0.40455370163795124
New Minimum: -991.6497617606732 > -993.2657625228003
WOLFE (weak): th(258.53216280382605)=-993.2657625228003; dx=-0.007134961259412292 evalInputDelta=2.020554463765052
New Minimum: -993.2657625228003 > -1003.2787498995481
WOLFE (weak): th(1551.1929768229563)=-1003.2787498995481; dx=-0.007033808519276361 evalInputDelta=12.03354184051284
New Minimum: -1003.2787498995481 > -1070.6324065709948
END: th(10858.350837760694)=-1070.6324065709948; dx=-0.006164140883456977 evalInputDelta=79.38719851195958
Fitness changed from -991.2452080590352 to -1070.6324065709948
Iteration 1 complete. Error: -1070.6324065709948 Total: 50.0582; Orientation: 0.0962; Line Search: 36.2499
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 28951a7f to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1070.6324065709948;dx=-0.005700120063412497
New Minimum: -1070.6324065709948 > -1197.596447055518
END: th(23393.607721408407)=-1197.596447055518; dx=-0.004210919921590273 evalInputDelta=126.96404048452314
Fitness changed from -1070.6324065709948 to -1197.596447055518
Iteration 2 complete. Error: -1197.596447055518 Total: 14.5653; Orientation: 0.1014; Line Search: 9.0714
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 376c73e8 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1197.596447055518;dx=-0.0039046225918266653
New Minimum: -1197.596447055518 > -1368.9841580529703
END: th(50400.00000000001)=-1368.9841580529703; dx=-0.0023978015595100283 evalInputDelta=171.38771099745236
Fitness changed from -1197.596447055518 to -1368.9841580529703
Iteration 3 complete. Error: -1368.9841580529703 Total: 14.7667; Orientation: 0.0846; Line Search: 9.3129
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 689ef531 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.881e+03, gradient 5.308e-02, dot -0.795; [490e5790-5e51-48bc-87d5-99eb030db3df = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1368.9841580529703, -1197.596447055518, -1070.6324065709948, -991.2452080590352
LBFGS Accumulation History: 3 points
Removed measurement 689ef531 to history. Total: 3
th(0)=-1368.9841580529703;dx=-0.0028109905393711443
New Minimum: -1368.9841580529703 > -1565.0801896388568
END: th(108583.50837760697)=-1565.0801896388568; dx=-0.0010339777741305031 evalInputDelta=196.09603158588652
Fitness changed from -1368.9841580529703 to -1565.0801896388568
Iteration 4 complete. Error: -1565.0801896388568 Total: 16.5879; Orientation: 1.7292; Line Search: 9.2627
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 6ab7dbe6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.951e+03, gradient 5.883e-02, dot -0.528; [490e5790-5e51-48bc-87d5-99eb030db3df = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1565.0801896388568, -1197.596447055518, -1070.6324065709948, -991.2452080590352
LBFGS Accumulation History: 3 points
Removed measurement 6ab7dbe6 to history. Total: 3
th(0)=-1565.0801896388568;dx=-0.0034524948351415344
New Minimum: -1565.0801896388568 > -1676.2772742001844
WOLF (strong): th(233936.07721408413)=-1676.2772742001844; dx=9.94044201412538E-5 evalInputDelta=111.19708456132753
New Minimum: -1676.2772742001844 > -1683.8503496451222
END: th(116968.03860704206)=-1683.8503496451222; dx=-1.5799217052123637E-4 evalInputDelta=118.77016000626531
Fitness changed from -1565.0801896388568 to -1683.8503496451222
Iteration 5 complete. Error: -1683.8503496451222 Total: 20.8926; Orientation: 1.7330; Line Search: 13.7594
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 675b9ee to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.123e+04, gradient 6.250e-02, dot -0.411; [490e5790-5e51-48bc-87d5-99eb030db3df = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1683.8503496451222, -1197.596447055518, -1070.6324065709948, -991.2452080590352
LBFGS Accumulation History: 3 points
Removed measurement 675b9ee to history. Total: 3
th(0)=-1683.8503496451222;dx=-0.0039023764078787494
New Minimum: -1683.8503496451222 > -1743.8196581068812
WOLF (strong): th(252000.0000000001)=-1743.8196581068812; dx=5.008608778848983E-4 evalInputDelta=59.969308461759056
New Minimum: -1743.8196581068812 > -1814.5350644173288
WOLF (strong): th(126000.00000000004)=-1814.5350644173288; dx=2.6733009083960947E-4 evalInputDelta=130.6847147722067
END: th(42000.000000000015)=-1797.4223209919253; dx=-0.0012507146691918057 evalInputDelta=113.57197134680314
Fitness changed from -1683.8503496451222 to -1814.5350644173288
Iteration 6 complete. Error: -1814.5350644173288 Total: 25.9410; Orientation: 1.8140; Line Search: 18.4598
Adding measurement 679f60aa to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.256e+04, gradient 6.405e-02, dot -0.354; [490e5790-5e51-48bc-87d5-99eb030db3df = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1814.5350644173288, -1197.596447055518, -1070.6324065709948, -991.2452080590352
LBFGS Accumulation History: 3 points
Removed measurement 679f60aa to history. Total: 3
th(0)=-1814.5350644173288;dx=-0.004096561677152888
New Minimum: -1814.5350644173288 > -1970.1010760872143
WOLF (strong): th(90486.25698133915)=-1970.1010760872143; dx=5.474334530052983E-5 evalInputDelta=155.56601166988548
END: th(45243.12849066957)=-1947.409818194414; dx=-0.0013409532552900493 evalInputDelta=132.87475377708506
Fitness changed from -1814.5350644173288 to -1970.1010760872143
Iteration 7 complete. Error: -1970.1010760872143 Total: 19.6216; Orientation: 1.5752; Line Search: 13.6477
Adding measurement 58b7abc5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.941e+04, gradient 5.819e-02, dot -0.404; [490e5790-5e51-48bc-87d5-99eb030db3df = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1970.1010760872143, -1197.596447055518, -1070.6324065709948, -991.2452080590352
LBFGS Accumulation History: 3 points
Removed measurement 58b7abc5 to history. Total: 3
th(0)=-1970.1010760872143;dx=-0.003384768219132986
New Minimum: -1970.1010760872143 > -2086.8682277518146
WOLF (strong): th(97473.3655058684)=-2086.8682277518146; dx=1.2098508561992087E-4 evalInputDelta=116.7671516646003
END: th(48736.6827529342)=-2075.6195460632953; dx=-8.257256482033255E-4 evalInputDelta=105.51846997608095
Fitness changed from -1970.1010760872143 to -2086.8682277518146
Iteration 8 complete. Error: -2086.8682277518146 Total: 19.6159; Orientation: 1.5895; Line Search: 13.4702
Adding measurement 436164f8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.481e+04, gradient 5.824e-02, dot -0.403; [490e5790-5e51-48bc-87d5-99eb030db3df = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2086.8682277518146, -1197.596447055518, -1070.6324065709948, -991.2452080590352
LBFGS Accumulation History: 3 points
Removed measurement 436164f8 to history. Total: 3
th(0)=-2086.8682277518146;dx=-0.003388370437238386
New Minimum: -2086.8682277518146 > -2192.2789512286067
WOLF (strong): th(105000.00000000004)=-2192.2789512286067; dx=3.780179798370104E-4 evalInputDelta=105.4107234767921
New Minimum: -2192.2789512286067 > -2193.284067329173
END: th(52500.00000000002)=-2193.284067329173; dx=-6.411205409853974E-4 evalInputDelta=106.41583957735838
Fitness changed from -2086.8682277518146 to -2193.284067329173
Iteration 9 complete. Error: -2193.284067329173 Total: 19.9676; Orientation: 1.5812; Line Search: 13.2610
Adding measurement 4632b82 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.198e+04, gradient 4.522e-02, dot -0.534; [490e5790-5e51-48bc-87d5-99eb030db3df = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2193.284067329173, -1197.596447055518, -1070.6324065709948, -991.2452080590352
LBFGS Accumulation History: 3 points
Removed measurement 4632b82 to history. Total: 3
th(0)=-2193.284067329173;dx=-0.002041375808186025
New Minimum: -2193.284067329173 > -2291.7521681019525
END: th(113107.82122667394)=-2291.7521681019525; dx=-2.697586172066553E-4 evalInputDelta=98.46810077277951
Fitness changed from -2193.284067329173 to -2291.7521681019525
Iteration 10 complete. Error: -2291.7521681019525 Total: 15.5721; Orientation: 1.6381; Line Search: 9.3653
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2291.7521681019525 (> -Infinity) after 218.483s (< 5400.000s)
Returns
-2291.7521681019525