BasicOptimizer.scala:89 executed in 327.59 seconds (4.241 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 583450635483600
Reset training subject: 583456600594700
Adding measurement 4f71a217 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-39.802726434578055;dx=-2.534416482128898E-6
New Minimum: -39.802726434578055 > -39.8027302296571
WOLFE (weak): th(2.154434690031884)=-39.8027302296571; dx=-2.528144411552405E-6 evalInputDelta=3.795079045687544E-6
New Minimum: -39.8027302296571 > -39.80273781981411
WOLFE (weak): th(4.308869380063768)=-39.80273781981411; dx=-2.5281985568184024E-6 evalInputDelta=1.1385236057037673E-5
New Minimum: -39.80273781981411 > -39.802760590276456
WOLFE (weak): th(12.926608140191302)=-39.802760590276456; dx=-2.5281904958712044E-6 evalInputDelta=3.41556984011504E-5
New Minimum: -39.802760590276456 > -39.80286874979471
WOLFE (weak): th(51.70643256076521)=-39.80286874979471; dx=-2.5282156949593713E-6 evalInputDelta=1.4231521665664104E-4
New Minimum: -39.80286874979471 > -39.80344180058411
WOLFE (weak): th(258.53216280382605)=-39.80344180058411; dx=-2.528186903526139E-6 evalInputDelta=7.153660060552625E-4
New Minimum: -39.80344180058411 > -39.80702033511332
WOLFE (weak): th(1551.1929768229563)=-39.80702033511332; dx=-2.5279288325567323E-6 evalInputDelta=0.004293900535266459
New Minimum: -39.80702033511332 > -39.83277591406635
WOLFE (weak): th(10858.350837760694)=-39.83277591406635; dx=-2.526371666599091E-6 evalInputDelta=0.030049479488297948
New Minimum: -39.83277591406635 > -40.04248520780502
WOLFE (weak): th(86866.80670208555)=-40.04248520780502; dx=-2.512545089690212E-6 evalInputDelta=0.23975877322696704
New Minimum: -40.04248520780502 > -41.90283634068957
WOLFE (weak): th(781801.26031877)=-41.90283634068957; dx=-2.373812358285296E-6 evalInputDelta=2.1001099061115127
New Minimum: -41.90283634068957 > -53.56604916238309
END: th(7818012.6031877)=-53.56604916238309; dx=-7.142134045397461E-7 evalInputDelta=13.763322727805033
Fitness changed from -39.802726434578055 to -53.56604916238309
Iteration 1 complete. Error: -53.56604916238309 Total: 85.5836; Orientation: 0.1436; Line Search: 67.9079
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 54eea9a to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-53.56604916238309;dx=-1.3230137985057457E-6
New Minimum: -53.56604916238309 > -62.54856544249876
END: th(1.684339755941405E7)=-62.54856544249876; dx=-1.8679595481045872E-8 evalInputDelta=8.982516280115675
Fitness changed from -53.56604916238309 to -62.54856544249876
Iteration 2 complete. Error: -62.54856544249876 Total: 19.9765; Orientation: 0.1438; Line Search: 12.4610
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 71cb7a1b to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-62.54856544249876;dx=-1.5166113945457593E-6
Armijo: th(3.6288E7)=-58.734207677342795; dx=4.2935094411981493E-7 evalInputDelta=-3.814357765155968
New Minimum: -62.54856544249876 > -68.98012427782642
WOLF (strong): th(1.8144E7)=-68.98012427782642; dx=4.468498297709198E-7 evalInputDelta=6.431558835327657
New Minimum: -68.98012427782642 > -69.93409942760061
END: th(6048000.0)=-69.93409942760061; dx=-6.595380092919451E-7 evalInputDelta=7.385533985101851
Fitness changed from -62.54856544249876 to -69.93409942760061
Iteration 3 complete. Error: -69.93409942760061 Total: 31.3823; Orientation: 0.1362; Line Search: 23.9817
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 73bdf17c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.188e+04, gradient 8.238e-04, dot -0.754; [2b5b0ed4-e49b-4441-92b5-0866bdf538b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.93409942760061, -62.54856544249876, -53.56604916238309, -39.802726434578055
LBFGS Accumulation History: 3 points
Removed measurement 73bdf17c to history. Total: 3
th(0)=-69.93409942760061;dx=-6.783251418272916E-7
New Minimum: -69.93409942760061 > -75.8907583131849
END: th(1.3030021005312834E7)=-75.8907583131849; dx=-2.132126744360227E-7 evalInputDelta=5.9566588855842895
Fitness changed from -69.93409942760061 to -75.8907583131849
Iteration 4 complete. Error: -75.8907583131849 Total: 22.1015; Orientation: 2.5742; Line Search: 12.4903
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7782fca to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.535e+04, gradient 8.307e-04, dot -0.678; [2b5b0ed4-e49b-4441-92b5-0866bdf538b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.8907583131849, -62.54856544249876, -53.56604916238309, -39.802726434578055
LBFGS Accumulation History: 3 points
Removed measurement 7782fca to history. Total: 3
th(0)=-75.8907583131849;dx=-6.878901325258357E-7
New Minimum: -75.8907583131849 > -78.83229529553711
WOLF (strong): th(2.8072329265690092E7)=-78.83229529553711; dx=1.2886019707819912E-7 evalInputDelta=2.941536982352204
New Minimum: -78.83229529553711 > -80.23603527479061
END: th(1.4036164632845046E7)=-80.23603527479061; dx=-1.6783419451677914E-8 evalInputDelta=4.345276961605705
Fitness changed from -75.8907583131849 to -80.23603527479061
Iteration 5 complete. Error: -80.23603527479061 Total: 27.6332; Orientation: 2.5281; Line Search: 17.9551
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 49a6650f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.495e+04, gradient 9.053e-04, dot -0.578; [2b5b0ed4-e49b-4441-92b5-0866bdf538b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.23603527479061, -62.54856544249876, -53.56604916238309, -39.802726434578055
LBFGS Accumulation History: 3 points
Removed measurement 49a6650f to history. Total: 3
th(0)=-80.23603527479061;dx=-8.192063217289435E-7
Armijo: th(3.0240000000000007E7)=-79.19227675698127; dx=3.2867617292881126E-7 evalInputDelta=-1.0437585178093371
New Minimum: -80.23603527479061 > -84.35504663819235
WOLF (strong): th(1.5120000000000004E7)=-84.35504663819235; dx=1.8133433326995836E-7 evalInputDelta=4.119011363401739
END: th(5040000.000000001)=-83.73226690099153; dx=-4.448314080262812E-7 evalInputDelta=3.496231626200924
Fitness changed from -80.23603527479061 to -84.35504663819235
Iteration 6 complete. Error: -84.35504663819235 Total: 33.2652; Orientation: 2.4930; Line Search: 23.9646
Adding measurement 2d001563 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.813e+04, gradient 9.638e-04, dot -0.507; [2b5b0ed4-e49b-4441-92b5-0866bdf538b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -84.35504663819235, -62.54856544249876, -53.56604916238309, -39.802726434578055
LBFGS Accumulation History: 3 points
Removed measurement 2d001563 to history. Total: 3
th(0)=-84.35504663819235;dx=-9.285061786558068E-7
New Minimum: -84.35504663819235 > -89.60267709490891
WOLF (strong): th(1.0858350837760696E7)=-89.60267709490891; dx=4.714591289600559E-8 evalInputDelta=5.247630456716564
END: th(5429175.418880348)=-88.54148082658556; dx=-4.56539514614534E-7 evalInputDelta=4.186434188393207
Fitness changed from -84.35504663819235 to -89.60267709490891
Iteration 7 complete. Error: -89.60267709490891 Total: 27.2763; Orientation: 2.5567; Line Search: 18.6370
Adding measurement 21662b61 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.771e+04, gradient 7.174e-04, dot -0.621; [2b5b0ed4-e49b-4441-92b5-0866bdf538b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -89.60267709490891, -62.54856544249876, -53.56604916238309, -39.802726434578055
LBFGS Accumulation History: 3 points
Removed measurement 21662b61 to history. Total: 3
th(0)=-89.60267709490891;dx=-5.136466788767659E-7
New Minimum: -89.60267709490891 > -93.00724076102118
END: th(1.1696803860704206E7)=-93.00724076102118; dx=-5.578612657252768E-8 evalInputDelta=3.404563666112267
Fitness changed from -89.60267709490891 to -93.00724076102118
Iteration 8 complete. Error: -93.00724076102118 Total: 20.5665; Orientation: 2.4822; Line Search: 12.0458
Adding measurement 681d7378 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.936e+04, gradient 6.853e-04, dot -0.616; [2b5b0ed4-e49b-4441-92b5-0866bdf538b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.00724076102118, -62.54856544249876, -53.56604916238309, -39.802726434578055
LBFGS Accumulation History: 3 points
Removed measurement 681d7378 to history. Total: 3
th(0)=-93.00724076102118;dx=-4.6927750926569417E-7
New Minimum: -93.00724076102118 > -94.77161441643514
WOLF (strong): th(2.5200000000000007E7)=-94.77161441643514; dx=1.349583196247627E-7 evalInputDelta=1.7643736554139622
New Minimum: -94.77161441643514 > -95.99278696610392
END: th(1.2600000000000004E7)=-95.99278696610392; dx=-2.3627927679849738E-8 evalInputDelta=2.9855462050827413
Fitness changed from -93.00724076102118 to -95.99278696610392
Iteration 9 complete. Error: -95.99278696610392 Total: 26.6357; Orientation: 2.5009; Line Search: 18.1040
Adding measurement 31bf2dc8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.766e+04, gradient 6.967e-04, dot -0.583; [2b5b0ed4-e49b-4441-92b5-0866bdf538b9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -95.99278696610392, -62.54856544249876, -53.56604916238309, -39.802726434578055
LBFGS Accumulation History: 3 points
Removed measurement 31bf2dc8 to history. Total: 3
th(0)=-95.99278696610392;dx=-4.842283927781703E-7
New Minimum: -95.99278696610392 > -96.66611783628578
WOLF (strong): th(2.7145877094401743E7)=-96.66611783628578; dx=1.9381710751161471E-7 evalInputDelta=0.6733308701818572
New Minimum: -96.66611783628578 > -98.89793045751443
WOLF (strong): th(1.3572938547200872E7)=-98.89793045751443; dx=3.320583376930697E-8 evalInputDelta=2.905143491410513
END: th(4524312.849066957)=-97.89860444668446; dx=-2.970145733047759E-7 evalInputDelta=1.905817480580538
Fitness changed from -95.99278696610392 to -98.89793045751443
Iteration 10 complete. Error: -98.89793045751443 Total: 32.0965; Orientation: 2.4559; Line Search: 23.8899
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -98.89793045751443 (> -Infinity) after 327.590s (< 5400.000s)
Returns
-98.89793045751443