BasicOptimizer.scala:89 executed in 83.23 seconds (1.280 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 1471611560548
Reset training subject: 1472556534836
Adding measurement 3d327e15 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-0.3756113407584336;dx=-5.527984535896188E-5
New Minimum: -0.3756113407584336 > -0.37573282930686197
WOLFE (weak): th(2.154434690031884)=-0.37573282930686197; dx=-5.470324596388986E-5 evalInputDelta=1.2148854842836121E-4
New Minimum: -0.37573282930686197 > -0.3758533532404099
WOLFE (weak): th(4.308869380063768)=-0.3758533532404099; dx=-5.563785171363034E-5 evalInputDelta=2.4201248197630587E-4
New Minimum: -0.3758533532404099 > -0.3763383062616074
WOLFE (weak): th(12.926608140191302)=-0.3763383062616074; dx=-5.7132019726700424E-5 evalInputDelta=7.269655031738043E-4
New Minimum: -0.3763383062616074 > -0.3785413891683693
WOLFE (weak): th(51.70643256076521)=-0.3785413891683693; dx=-5.555395710465658E-5 evalInputDelta=0.002930048409935715
New Minimum: -0.3785413891683693 > -0.3903474321343492
WOLFE (weak): th(258.53216280382605)=-0.3903474321343492; dx=-5.646603343619424E-5 evalInputDelta=0.014736091375915583
New Minimum: -0.3903474321343492 > -0.4647984175183079
WOLFE (weak): th(1551.1929768229563)=-0.4647984175183079; dx=-5.985228211783044E-5 evalInputDelta=0.0891870767598743
New Minimum: -0.4647984175183079 > -1.0325988753021715
WOLFE (weak): th(10858.350837760694)=-1.0325988753021715; dx=-5.572042677391568E-5 evalInputDelta=0.6569875345437379
New Minimum: -1.0325988753021715 > -3.6395806886834214
END: th(86866.80670208555)=-3.6395806886834214; dx=-2.09411313579892E-5 evalInputDelta=3.263969347924988
Fitness changed from -0.3756113407584336 to -3.6395806886834214
Iteration 1 complete. Error: -3.6395806886834214 Total: 11.1806; Orientation: 0.0200; Line Search: 8.4967
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 29879ca1 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-3.6395806886834214;dx=-2.0548343158061975E-4
New Minimum: -3.6395806886834214 > -13.331979153351057
END: th(187148.86177126726)=-13.331979153351057; dx=-1.0373751597263898E-5 evalInputDelta=9.692398464667635
Fitness changed from -3.6395806886834214 to -13.331979153351057
Iteration 2 complete. Error: -13.331979153351057 Total: 2.6838; Orientation: 0.0226; Line Search: 1.7896
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 8dcf722 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-13.331979153351057;dx=-4.047588930403207E-4
New Minimum: -13.331979153351057 > -18.118087585365036
WOLF (strong): th(403200.00000000006)=-18.118087585365036; dx=3.807939652569542E-6 evalInputDelta=4.786108432013979
New Minimum: -18.118087585365036 > -24.153595856917555
WOLF (strong): th(201600.00000000003)=-24.153595856917555; dx=1.8270968091533634E-6 evalInputDelta=10.821616703566498
New Minimum: -24.153595856917555 > -26.19043850392574
END: th(67200.00000000001)=-26.19043850392574; dx=-7.518634367533802E-5 evalInputDelta=12.858459350574684
Fitness changed from -13.331979153351057 to -26.19043850392574
Iteration 3 complete. Error: -26.19043850392574 Total: 4.5397; Orientation: 0.0205; Line Search: 3.6558
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 67ab318f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.821e+03, gradient 2.184e-02, dot -0.141; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -26.19043850392574, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 67ab318f to history. Total: 3
th(0)=-26.19043850392574;dx=-4.728060482532813E-4
New Minimum: -26.19043850392574 > -37.44955451805934
END: th(144778.01117014262)=-37.44955451805934; dx=-1.2718022503190015E-5 evalInputDelta=11.259116014133596
Fitness changed from -26.19043850392574 to -37.44955451805934
Iteration 4 complete. Error: -37.44955451805934 Total: 3.1691; Orientation: 0.4961; Line Search: 1.8064
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 137a9399 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.354e+04, gradient 2.803e-02, dot -0.120; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -37.44955451805934, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 137a9399 to history. Total: 3
th(0)=-37.44955451805934;dx=-7.828714751847228E-4
Armijo: th(311914.76961877884)=-36.561086489155116; dx=2.9488225061861955E-5 evalInputDelta=-0.8884680289042208
New Minimum: -37.44955451805934 > -51.82332014591889
WOLF (strong): th(155957.38480938942)=-51.82332014591889; dx=1.6183544405272565E-5 evalInputDelta=14.373765627859555
New Minimum: -51.82332014591889 > -55.12570730725522
END: th(51985.79493646314)=-55.12570730725522; dx=-1.5517870633835845E-4 evalInputDelta=17.676152789195882
Fitness changed from -37.44955451805934 to -55.12570730725522
Iteration 5 complete. Error: -55.12570730725522 Total: 4.9726; Orientation: 0.5028; Line Search: 3.5947
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 3ba7f41f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.246e+04, gradient 2.351e-02, dot -0.146; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -55.12570730725522, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 3ba7f41f to history. Total: 3
th(0)=-55.12570730725522;dx=-5.501498233654521E-4
New Minimum: -55.12570730725522 > -67.68094447822548
END: th(112000.00000000004)=-67.68094447822548; dx=-3.842985716082945E-5 evalInputDelta=12.555237170970265
Fitness changed from -55.12570730725522 to -67.68094447822548
Iteration 6 complete. Error: -67.68094447822548 Total: 3.1056; Orientation: 0.4707; Line Search: 1.7732
Adding measurement 5720410a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.724e+04, gradient 3.034e-02, dot -0.138; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.68094447822548, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 5720410a to history. Total: 3
th(0)=-67.68094447822548;dx=-9.171541729023154E-4
Armijo: th(241296.68528357107)=-59.103973590291346; dx=5.7459546281242525E-5 evalInputDelta=-8.576970887934138
New Minimum: -67.68094447822548 > -78.8378188807571
WOLF (strong): th(120648.34264178554)=-78.8378188807571; dx=2.7584174010644106E-5 evalInputDelta=11.156874402531614
New Minimum: -78.8378188807571 > -83.25701946170923
END: th(40216.114213928515)=-83.25701946170923; dx=-2.1680351180631378E-4 evalInputDelta=15.57607498348375
Fitness changed from -67.68094447822548 to -83.25701946170923
Iteration 7 complete. Error: -83.25701946170923 Total: 4.8566; Orientation: 0.4731; Line Search: 3.5596
Adding measurement 6c8da048 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.564e+05, gradient 2.366e-02, dot -0.185; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -83.25701946170923, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 6c8da048 to history. Total: 3
th(0)=-83.25701946170923;dx=-5.566434798170625E-4
New Minimum: -83.25701946170923 > -94.01182520129909
END: th(86642.99156077192)=-94.01182520129909; dx=-8.908625570896013E-5 evalInputDelta=10.754805739589855
Fitness changed from -83.25701946170923 to -94.01182520129909
Iteration 8 complete. Error: -94.01182520129909 Total: 3.1093; Orientation: 0.4816; Line Search: 1.8013
Adding measurement 443a23c6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.937e+05, gradient 2.838e-02, dot -0.154; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.01182520129909, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 443a23c6 to history. Total: 3
th(0)=-94.01182520129909;dx=-8.019791877498089E-4
Armijo: th(186666.66666666677)=-85.65055554591584; dx=6.21752037679466E-5 evalInputDelta=-8.361269655383254
New Minimum: -94.01182520129909 > -101.5258979156529
WOLF (strong): th(93333.33333333339)=-101.5258979156529; dx=1.5095562300468276E-5 evalInputDelta=7.514072714353816
New Minimum: -101.5258979156529 > -104.02997138546958
END: th(31111.111111111128)=-104.02997138546958; dx=-2.5867221570252533E-4 evalInputDelta=10.01814618417049
Fitness changed from -94.01182520129909 to -104.02997138546958
Iteration 9 complete. Error: -104.02997138546958 Total: 4.8501; Orientation: 0.4529; Line Search: 3.5799
Adding measurement 3f69fe01 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.505e+05, gradient 2.272e-02, dot -0.184; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.02997138546958, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 3f69fe01 to history. Total: 3
th(0)=-104.02997138546958;dx=-5.137486574835748E-4
New Minimum: -104.02997138546958 > -112.04664304228295
END: th(67026.8570232142)=-112.04664304228295; dx=-1.43896014121076E-4 evalInputDelta=8.016671656813372
Fitness changed from -104.02997138546958 to -112.04664304228295
Iteration 10 complete. Error: -112.04664304228295 Total: 3.0560; Orientation: 0.4386; Line Search: 1.7902
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Adding measurement 30558708 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.670e+04, gradient 2.615e-02, dot -0.135; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -112.04664304228295, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 30558708 to history. Total: 3
th(0)=-112.04664304228295;dx=-6.806014625329225E-4
Armijo: th(144404.98593461988)=-111.10268256014594; dx=3.056330973250175E-5 evalInputDelta=-0.9439604821370153
New Minimum: -112.04664304228295 > -119.47136752617645
END: th(72202.49296730994)=-119.47136752617645; dx=-3.72195286205835E-5 evalInputDelta=7.424724483893499
Fitness changed from -112.04664304228295 to -119.47136752617645
Iteration 11 complete. Error: -119.47136752617645 Total: 3.9865; Orientation: 0.4436; Line Search: 2.6838
Adding measurement 3fe40b14 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.986e+04, gradient 2.882e-02, dot -0.038; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -119.47136752617645, -13.331979153351057, -3.6395806886834214, -0.3756113407584336
LBFGS Accumulation History: 3 points
Removed measurement 3fe40b14 to history. Total: 3
th(0)=-119.47136752617645;dx=-8.271248783668759E-4
Armijo: th(155555.55555555565)=-109.41106651041663; dx=1.1801624320829465E-4 evalInputDelta=-10.06030101575982
New Minimum: -119.47136752617645 > -125.89005512872505
WOLF (strong): th(77777.77777777782)=-125.89005512872505; dx=4.780172727918561E-5 evalInputDelta=6.4186876025486015
New Minimum: -125.89005512872505 > -127.91349561804886
END: th(25925.92592592594)=-127.91349561804886; dx=-3.0408357584784003E-4 evalInputDelta=8.442128091872405
Fitness changed from -119.47136752617645 to -127.91349561804886
Iteration 12 complete. Error: -127.91349561804886 Total: 4.8665; Orientation: 0.4406; Line Search: 3.5933
Adding measurement 29158ccd to history. Total: 3
Accepted: LBFGS Orientation magnitude: 1.695e+04, gradient 2.295e-02, dot 0.339; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
Constructing line search parameters: LBFGS+Trust
th(0)=-127.91349561804886;dx=-132.03747365979785
Armijo: th(55855.714186011835)=-52.019433667229855; dx=7.242246040175971E-4 evalInputDelta=-75.89406195081901
Armijo: th(27927.857093005918)=-52.0196961519812; dx=0.001448702979121808 evalInputDelta=-75.89379946606766
Armijo: th(9309.28569766864)=-52.03788497959324; dx=0.004341081444532425 evalInputDelta=-75.87561063845561
Armijo: th(2327.32142441716)=-51.99965049276369; dx=0.017262191808057332 evalInputDelta=-75.91384512528516
Armijo: th(465.464284883432)=-52.009675321727606; dx=0.08509177277233473 evalInputDelta=-75.90382029632124
Armijo: th(77.57738081390534)=-53.231229461852415; dx=0.4945106913754915 evalInputDelta=-74.68226615619645
Armijo: th(11.082482973415049)=-60.643782584448616; dx=3.676126076418002 evalInputDelta=-67.26971303360024
Armijo: th(1.385310371676881)=-109.08993567848385; dx=10.880915694051577 evalInputDelta=-18.823559939565
New Minimum: -127.91349561804886 > -135.58206707384878
END: th(0.15392337463076455)=-135.58206707384878; dx=-41.278813184482665 evalInputDelta=7.6685714557999205
Fitness changed from -127.91349561804886 to -135.58206707384878
Iteration 13 complete. Error: -135.58206707384878 Total: 10.3122; Orientation: 0.4489; Line Search: 9.0234
Adding measurement 3de57b78 to history. Total: 4
Accepted: LBFGS Orientation magnitude: 1.686e+04, gradient 2.525e-02, dot 0.114; [ae9c79e7-b53b-40fe-aac4-3ab3ed63a1a5 = 1.000/1.000e+00]
th(0)=-135.58206707384878;dx=-48.59467199484959
Armijo: th(0.3316178579112928)=-123.42378768777505; dx=19.680493172880944 evalInputDelta=-12.15827938607373
Armijo: th(0.1658089289556464)=-130.92598803681577; dx=14.879068136038448 evalInputDelta=-4.65607903703301
Armijo: th(0.055269642985215466)=-134.6571020829915; dx=2.0923198503940545 evalInputDelta=-0.9249649908572621
Armijo: th(0.013817410746303866)=-135.44406190283146; dx=-6.00188708048465 evalInputDelta=-0.13800517101731202
Armijo: th(0.0027634821492607733)=-135.560229687818; dx=-8.200459048901003 evalInputDelta=-0.021837386030767902
Armijo: th(4.6058035821012886E-4)=-135.57859058423807; dx=-8.777907465791008 evalInputDelta=-0.0034764896107049026
Armijo: th(6.57971940300184E-5)=-135.58157225047663; dx=-8.642774024903787 evalInputDelta=-4.948233721506767E-4
Armijo: th(8.2246492537523E-6)=-135.58200997893647; dx=-8.835573808160834 evalInputDelta=-5.7094912307320556E-5
Armijo: th(9.13849917083589E-7)=-135.58205438609255; dx=-8.792436816772376 evalInputDelta=-1.2687756225204794E-5
Armijo: th(9.13849917083589E-8)=-135.5820607299708; dx=-8.76212789253483 evalInputDelta=-6.34387797049385E-6
Armijo: th(8.307726518941718E-9)=-135.58206707384878; dx=-8.849802674020681 evalInputDelta=0.0
Armijo: th(6.923105432451432E-10)=-135.58206707384878; dx=-8.711789848996192 evalInputDelta=0.0
MIN ALPHA (5.325465717270332E-11): th(0.0)=-135.58206707384878
Fitness changed from -135.58206707384878 to -135.58206707384878
Static Iteration Total: 15.0483; Orientation: 0.5480; Line Search: 13.6743
Iteration 14 failed. Error: -135.58206707384878
Previous Error: 0.0 -> -135.58206707384878
Retrying iteration 14
Reset training subject: 1551348728738
Adding measurement 11946523 to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-135.58206707384878;dx=-6.353022826130285E-4
END: th(2.1544346900318838E-10)=-135.58206707384878; dx=-5.078618871971664E-4 evalInputDelta=0.0
Fitness changed from -135.58206707384878 to -135.58206707384878
Static Iteration Total: 3.4929; Orientation: 0.0195; Line Search: 1.7945
Iteration 15 failed. Error: -135.58206707384878
Previous Error: 0.0 -> -135.58206707384878
Optimization terminated 15
Final threshold in iteration 15: -135.58206707384878 (> -Infinity) after 83.230s (< 3600.000s)
Returns
-135.58206707384878