BasicOptimizer.scala:89 executed in 162.59 seconds (1.397 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 5473534071268
Reset training subject: 5474513243789
Adding measurement 3ecaecd3 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-71.98582488500774;dx=-4.672612333050504E-5
New Minimum: -71.98582488500774 > -71.98583845104535
WOLFE (weak): th(2.154434690031884)=-71.98583845104535; dx=-4.6537009947521056E-5 evalInputDelta=1.3566037608825354E-5
New Minimum: -71.98583845104535 > -71.98585540858878
WOLFE (weak): th(4.308869380063768)=-71.98585540858878; dx=-4.688390985945661E-5 evalInputDelta=3.052358103161623E-5
New Minimum: -71.98585540858878 > -71.98590967270088
WOLFE (weak): th(12.926608140191302)=-71.98590967270088; dx=-4.661380434558435E-5 evalInputDelta=8.478769314024248E-5
New Minimum: -71.98590967270088 > -71.98618099264782
WOLFE (weak): th(51.70643256076521)=-71.98618099264782; dx=-4.654005865676303E-5 evalInputDelta=3.56107640072878E-4
New Minimum: -71.98618099264782 > -71.98761218844358
WOLFE (weak): th(258.53216280382605)=-71.98761218844358; dx=-4.702987917056431E-5 evalInputDelta=0.0017873034358331097
New Minimum: -71.98761218844358 > -71.99657516811129
WOLFE (weak): th(1551.1929768229563)=-71.99657516811129; dx=-4.6549472206641205E-5 evalInputDelta=0.010750283103547531
New Minimum: -71.99657516811129 > -72.06155138144058
WOLFE (weak): th(10858.350837760694)=-72.06155138144058; dx=-4.548517068869102E-5 evalInputDelta=0.07572649643283569
New Minimum: -72.06155138144058 > -72.59749976863012
END: th(86866.80670208555)=-72.59749976863012; dx=-3.6673934637832846E-5 evalInputDelta=0.6116748836223707
Fitness changed from -71.98582488500774 to -72.59749976863012
Iteration 1 complete. Error: -72.59749976863012 Total: 11.8157; Orientation: 0.0200; Line Search: 8.9107
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3eb3cf2b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-72.59749976863012;dx=-4.055908080423444E-5
New Minimum: -72.59749976863012 > -73.70633307359857
END: th(187148.86177126726)=-73.70633307359857; dx=-2.3773490875347325E-5 evalInputDelta=1.1088333049684564
Fitness changed from -72.59749976863012 to -73.70633307359857
Iteration 2 complete. Error: -73.70633307359857 Total: 3.2578; Orientation: 0.0182; Line Search: 1.9764
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 23a42d51 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-73.70633307359857;dx=-2.6215060389865525E-5
New Minimum: -73.70633307359857 > -74.5703972138073
END: th(403200.00000000006)=-74.5703972138073; dx=-1.2038148143659553E-5 evalInputDelta=0.8640641402087255
Fitness changed from -73.70633307359857 to -74.5703972138073
Iteration 3 complete. Error: -74.5703972138073 Total: 3.2455; Orientation: 0.0197; Line Search: 2.0036
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 36f30b30 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.555e+03, gradient 3.589e-03, dot -0.631; [33c6ed40-745b-4fdf-b577-915f7ddcd94c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.5703972138073, -73.70633307359857, -72.59749976863012, -71.98582488500774
LBFGS Accumulation History: 3 points
Removed measurement 36f30b30 to history. Total: 3
th(0)=-74.5703972138073;dx=-1.2722738387366344E-5
New Minimum: -74.5703972138073 > -74.70703196486927
END: th(868668.0670208557)=-74.70703196486927; dx=-5.702181343561982E-6 evalInputDelta=0.1366347510619761
Fitness changed from -74.5703972138073 to -74.70703196486927
Iteration 4 complete. Error: -74.70703196486927 Total: 3.7334; Orientation: 0.4923; Line Search: 1.9632
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7a2d08d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.735e+03, gradient 2.495e-03, dot -0.586; [33c6ed40-745b-4fdf-b577-915f7ddcd94c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.70703196486927, -73.70633307359857, -72.59749976863012, -71.98582488500774
LBFGS Accumulation History: 3 points
Removed measurement 7a2d08d to history. Total: 3
th(0)=-74.70703196486927;dx=-6.134186935450551E-6
Armijo: th(1871488.617712673)=-74.46287154200576; dx=-2.7428685657887264E-6 evalInputDelta=-0.2441604228635157
New Minimum: -74.70703196486927 > -74.71406431355479
END: th(935744.3088563365)=-74.71406431355479; dx=-3.913242259223014E-6 evalInputDelta=0.007032348685513057
Fitness changed from -74.70703196486927 to -74.71406431355479
Iteration 5 complete. Error: -74.71406431355479 Total: 4.6773; Orientation: 0.4966; Line Search: 2.9250
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1def8aaa to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.033e+03, gradient 2.047e-03, dot -0.623; [33c6ed40-745b-4fdf-b577-915f7ddcd94c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.71406431355479, -73.70633307359857, -72.59749976863012, -71.98582488500774
LBFGS Accumulation History: 3 points
Removed measurement 1def8aaa to history. Total: 3
th(0)=-74.71406431355479;dx=-4.1424758032796625E-6
Armijo: th(2016000.0000000007)=-74.5757597702665; dx=-2.245421540378065E-6 evalInputDelta=-0.13830454328828523
Armijo: th(1008000.0000000003)=-74.71203833302235; dx=-2.9589380628540455E-6 evalInputDelta=-0.0020259805324371882
New Minimum: -74.71406431355479 > -74.73529132565986
END: th(336000.0000000001)=-74.73529132565986; dx=-3.657744748570186E-6 evalInputDelta=0.021227012105072163
Fitness changed from -74.71406431355479 to -74.73529132565986
Iteration 6 complete. Error: -74.73529132565986 Total: 5.6542; Orientation: 0.4777; Line Search: 3.9751
Adding measurement 122fe18 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.153e+03, gradient 1.942e-03, dot -0.638; [33c6ed40-745b-4fdf-b577-915f7ddcd94c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.73529132565986, -73.70633307359857, -72.59749976863012, -71.98582488500774
LBFGS Accumulation History: 3 points
Removed measurement 122fe18 to history. Total: 3
th(0)=-74.73529132565986;dx=-3.6887922958387886E-6
Armijo: th(723890.0558507132)=-74.73243940886715; dx=-2.9748273082518913E-6 evalInputDelta=-0.002851916792707243
New Minimum: -74.73529132565986 > -74.7449145165994
END: th(361945.0279253566)=-74.7449145165994; dx=-3.27908699031152E-6 evalInputDelta=0.009623190939535675
Fitness changed from -74.73529132565986 to -74.7449145165994
Iteration 7 complete. Error: -74.7449145165994 Total: 4.4467; Orientation: 0.4763; Line Search: 3.0728
Adding measurement 22e60287 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.251e+03, gradient 1.838e-03, dot -0.652; [33c6ed40-745b-4fdf-b577-915f7ddcd94c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.7449145165994, -73.70633307359857, -72.59749976863012, -71.98582488500774
LBFGS Accumulation History: 3 points
Removed measurement 22e60287 to history. Total: 3
th(0)=-74.7449145165994;dx=-3.3185245509910395E-6
Armijo: th(779786.9240469472)=-74.7340303541081; dx=-2.68673882644363E-6 evalInputDelta=-0.010884162491294092
New Minimum: -74.7449145165994 > -74.74852044417835
END: th(389893.4620234736)=-74.74852044417835; dx=-2.9515044805799793E-6 evalInputDelta=0.0036059275789597223
Fitness changed from -74.7449145165994 to -74.74852044417835
Iteration 8 complete. Error: -74.74852044417835 Total: 4.4010; Orientation: 0.5069; Line Search: 2.9656
Adding measurement 69965600 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.312e+03, gradient 1.746e-03, dot -0.661; [33c6ed40-745b-4fdf-b577-915f7ddcd94c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.74852044417835, -73.70633307359857, -72.59749976863012, -71.98582488500774
LBFGS Accumulation History: 3 points
Removed measurement 69965600 to history. Total: 3
th(0)=-74.74852044417835;dx=-2.9803444280319635E-6
Armijo: th(840000.0000000003)=-74.73854819259938
...skipping 6147 bytes...
E-6 evalInputDelta=6.531769969342349E-6
Armijo: th(151735.23790306522)=-74.75473895408739; dx=-2.4224543909836768E-6 evalInputDelta=-7.184950739258511E-5
Armijo: th(144838.18163474408)=-74.75478141062283; dx=-2.4097798359602965E-6 evalInputDelta=-2.9392971953257074E-5
Armijo: th(141389.6535005835)=-74.75480100593875; dx=-2.4283303069276956E-6 evalInputDelta=-9.797656034038482E-6
Armijo: th(139665.3894335032)=-74.75480753770957; dx=-2.417462284887983E-6 evalInputDelta=-3.26588521204485E-6
Armijo: th(138803.25739996307)=-74.75481080359478; dx=-2.4085645598536614E-6 evalInputDelta=0.0
WOLFE (weak): th(138372.191383193)=-74.75481406947983; dx=-2.426706957448607E-6 evalInputDelta=3.265885055725448E-6
WOLFE (weak): th(138587.72439157806)=-74.75481406947983; dx=-2.415081427567582E-6 evalInputDelta=3.265885055725448E-6
Armijo: th(138695.49089577055)=-74.75481080359478; dx=-2.414779350078071E-6 evalInputDelta=0.0
Armijo: th(138641.6076436743)=-74.75481080359478; dx=-2.4104029844981672E-6 evalInputDelta=0.0
Armijo: th(138614.66601762618)=-74.75481080359478; dx=-2.426776166556324E-6 evalInputDelta=0.0
WOLFE (weak): th(138601.19520460212)=-74.75481406947983; dx=-2.3939116070586167E-6 evalInputDelta=3.265885055725448E-6
WOLFE (weak): th(138607.93061111413)=-74.75481406947983; dx=-2.387534291387413E-6 evalInputDelta=3.265885055725448E-6
WOLFE (weak): th(138611.29831437016)=-74.75481406947983; dx=-2.415579879686272E-6 evalInputDelta=3.265885055725448E-6
WOLFE (weak): th(138612.98216599817)=-74.75481406947983; dx=-2.4214101734946695E-6 evalInputDelta=3.265885055725448E-6
Armijo: th(138613.8240918122)=-74.75481080359478; dx=-2.4079926597406763E-6 evalInputDelta=0.0
mu ~= nu (138612.98216599817): th(110352.90029313834)=-74.75491857772637
Fitness changed from -74.75481080359478 to -74.75491857772637
Iteration 12 complete. Error: -74.75491857772637 Total: 24.4836; Orientation: 0.4824; Line Search: 23.0673
Adding measurement 64bb642c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.541e+03, gradient 1.584e-03, dot -0.684; [33c6ed40-745b-4fdf-b577-915f7ddcd94c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.75491857772637, -73.70633307359857, -72.59749976863012, -71.98582488500774
LBFGS Accumulation History: 3 points
Removed measurement 64bb642c to history. Total: 3
th(0)=-74.75491857772637;dx=-2.464543340303132E-6
Armijo: th(298633.5242042873)=-74.74525747915382; dx=-2.2957560549128645E-6 evalInputDelta=-0.009661098572550486
Armijo: th(149316.76210214366)=-74.75085244601729; dx=-2.3634460227664703E-6 evalInputDelta=-0.004066131709080878
Armijo: th(49772.25403404789)=-74.753762447117; dx=-2.352912249864517E-6 evalInputDelta=-0.0011561306093739177
Armijo: th(12443.063508511972)=-74.75464424326759; dx=-2.4428915098716057E-6 evalInputDelta=-2.7433445877989016E-4
Armijo: th(2488.6127017023946)=-74.75486305773859; dx=-2.457676755997996E-6 evalInputDelta=-5.551998778230427E-5
Armijo: th(414.76878361706576)=-74.75490878008446; dx=-2.451861491102255E-6 evalInputDelta=-9.797641908448895E-6
Armijo: th(59.25268337386654)=-74.75491857772637; dx=-2.4402508130525172E-6 evalInputDelta=0.0
Armijo: th(7.406585421733317)=-74.75491857772637; dx=-2.4561031197236517E-6 evalInputDelta=0.0
Armijo: th(0.8229539357481463)=-74.75491857772637; dx=-2.415285951538867E-6 evalInputDelta=0.0
Armijo: th(0.08229539357481463)=-74.75491857772637; dx=-2.453391870843214E-6 evalInputDelta=0.0
WOLFE (weak): th(0.00748139941589224)=-74.75491857772637; dx=-2.4527356151662865E-6 evalInputDelta=0.0
WOLFE (weak): th(0.044888396495353436)=-74.75491857772637; dx=-2.447788381310814E-6 evalInputDelta=0.0
WOLFE (weak): th(0.06359189503508403)=-74.75491857772637; dx=-2.459884715605891E-6 evalInputDelta=0.0
Armijo: th(0.07294364430494933)=-74.75491857772637; dx=-2.3985292168599334E-6 evalInputDelta=0.0
WOLFE (weak): th(0.06826776967001669)=-74.75491857772637; dx=-2.456503174334805E-6 evalInputDelta=0.0
WOLFE (weak): th(0.070605706987483)=-74.75491857772637; dx=-2.4418746451260856E-6 evalInputDelta=0.0
WOLFE (weak): th(0.07177467564621617)=-74.75491857772637; dx=-2.4034149749740384E-6 evalInputDelta=0.0
Armijo: th(0.07235915997558276)=-74.75491857772637; dx=-2.436386025375703E-6 evalInputDelta=0.0
WOLFE (weak): th(0.07206691781089947)=-74.75491857772637; dx=-2.4355540420607322E-6 evalInputDelta=0.0
Armijo: th(0.07221303889324111)=-74.75491857772637; dx=-2.443832805942609E-6 evalInputDelta=0.0
Armijo: th(0.07213997835207028)=-74.75491857772637; dx=-2.4444855261996663E-6 evalInputDelta=0.0
Armijo: th(0.07210344808148487)=-74.75491857772637; dx=-2.4427894004471333E-6 evalInputDelta=0.0
Armijo: th(0.07208518294619218)=-74.75491857772637; dx=-2.454971123342756E-6 evalInputDelta=0.0
WOLFE (weak): th(0.07207605037854582)=-74.75491857772637; dx=-2.42396631280383E-6 evalInputDelta=0.0
Armijo: th(0.07208061666236901)=-74.75491857772637; dx=-2.454617623506493E-6 evalInputDelta=0.0
Armijo: th(0.07207833352045742)=-74.75491857772637; dx=-2.4398518379472884E-6 evalInputDelta=0.0
Armijo: th(0.07207719194950163)=-74.75491857772637; dx=-2.4490224026219025E-6 evalInputDelta=0.0
Armijo: th(0.07207662116402372)=-74.75491857772637; dx=-2.444412155558187E-6 evalInputDelta=0.0
mu ~= nu (0.07207605037854582): th(0.0)=-74.75491857772637
Fitness changed from -74.75491857772637 to -74.75491857772637
Static Iteration Total: 31.4038; Orientation: 0.4872; Line Search: 29.9900
Iteration 13 failed. Error: -74.75491857772637
Previous Error: 0.0 -> -74.75491857772637
Retrying iteration 13
Reset training subject: 5609229300469
Adding measurement 486b6ed3 to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-74.75491857772637;dx=-2.433450492861536E-6
WOLFE (weak): th(0.1552837581160419)=-74.75491857772637; dx=-2.435256892047077E-6 evalInputDelta=0.0
WOLFE (weak): th(0.3105675162320838)=-74.75491857772637; dx=-2.4307790972237784E-6 evalInputDelta=0.0
Armijo: th(0.9317025486962514)=-74.75491857772637; dx=-2.4363501745537694E-6 evalInputDelta=0.0
Armijo: th(0.6211350324641676)=-74.75491857772637; dx=-2.4314646902839534E-6 evalInputDelta=0.0
Armijo: th(0.4658512743481257)=-74.75491857772637; dx=-2.422234049609877E-6 evalInputDelta=0.0
Armijo: th(0.38820939529010473)=-74.75491857772637; dx=-2.412340410367599E-6 evalInputDelta=0.0
WOLFE (weak): th(0.34938845576109423)=-74.75491857772637; dx=-2.41993404132051E-6 evalInputDelta=0.0
Armijo: th(0.36879892552559945)=-74.75491857772637; dx=-2.4256294920830913E-6 evalInputDelta=0.0
WOLFE (weak): th(0.35909369064334684)=-74.75491857772637; dx=-2.4077291610053033E-6 evalInputDelta=0.0
WOLFE (weak): th(0.36394630808447315)=-74.75491857772637; dx=-2.429767410701613E-6 evalInputDelta=0.0
Armijo: th(0.3663726168050363)=-74.75491857772637; dx=-2.4359063153012015E-6 evalInputDelta=0.0
Armijo: th(0.3651594624447547)=-74.75491857772637; dx=-2.4204228453912076E-6 evalInputDelta=0.0
WOLFE (weak): th(0.36455288526461394)=-74.75491857772637; dx=-2.4129138123671383E-6 evalInputDelta=0.0
WOLFE (weak): th(0.36485617385468433)=-74.75491857772637; dx=-2.4081730907280342E-6 evalInputDelta=0.0
Armijo: th(0.3650078181497195)=-74.75491857772637; dx=-2.419025284830779E-6 evalInputDelta=0.0
WOLFE (weak): th(0.36493199600220194)=-74.75491857772637; dx=-2.4325475202867596E-6 evalInputDelta=0.0
WOLFE (weak): th(0.3649699070759607)=-74.75491857772637; dx=-2.424873291728428E-6 evalInputDelta=0.0
Armijo: th(0.36498886261284014)=-74.75491857772637; dx=-2.4260553164074953E-6 evalInputDelta=0.0
WOLFE (weak): th(0.3649793848444004)=-74.75491857772637; dx=-2.424259832830785E-6 evalInputDelta=0.0
WOLFE (weak): th(0.36498412372862027)=-74.75491857772637; dx=-2.432706514893696E-6 evalInputDelta=0.0
WOLFE (weak): th(0.3649864931707302)=-74.75491857772637; dx=-2.4065392926708183E-6 evalInputDelta=0.0
mu ~= nu (0.3649864931707302): th(0.0)=-74.75491857772637
Fitness changed from -74.75491857772637 to -74.75491857772637
Static Iteration Total: 26.8912; Orientation: 0.0197; Line Search: 24.9895
Iteration 14 failed. Error: -74.75491857772637
Previous Error: 0.0 -> -74.75491857772637
Optimization terminated 14
Final threshold in iteration 14: -74.75491857772637 (> -Infinity) after 162.587s (< 3600.000s)
Returns
-74.75491857772637