BasicOptimizer.scala:89 executed in 217.46 seconds (3.157 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 684371745647300
Reset training subject: 684376305423300
Adding measurement 5ef6ad4b to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1003.6925575095195;dx=-0.006159897246005199
New Minimum: -1003.6925575095195 > -1003.7060700224941
WOLFE (weak): th(2.154434690031884)=-1003.7060700224941; dx=-0.0057198414223867886 evalInputDelta=0.013512512974671154
New Minimum: -1003.7060700224941 > -1003.7195512193632
WOLFE (weak): th(4.308869380063768)=-1003.7195512193632; dx=-0.005726203246453348 evalInputDelta=0.026993709843736724
New Minimum: -1003.7195512193632 > -1003.7734741962452
WOLFE (weak): th(12.926608140191302)=-1003.7734741962452; dx=-0.005726193723468205 evalInputDelta=0.0809166867256863
New Minimum: -1003.7734741962452 > -1004.0161228785123
WOLFE (weak): th(51.70643256076521)=-1004.0161228785123; dx=-0.005721080500038102 evalInputDelta=0.3235653689928313
New Minimum: -1004.0161228785123 > -1005.3091564290062
WOLFE (weak): th(258.53216280382605)=-1005.3091564290062; dx=-0.00571579847820991 evalInputDelta=1.6165989194867052
New Minimum: -1005.3091564290062 > -1013.3444318197046
WOLFE (weak): th(1551.1929768229563)=-1013.3444318197046; dx=-0.005657387525263829 evalInputDelta=9.651874310185121
New Minimum: -1013.3444318197046 > -1068.5813024753895
END: th(10858.350837760694)=-1068.5813024753895; dx=-0.005180049531067736 evalInputDelta=64.88874496587005
Fitness changed from -1003.6925575095195 to -1068.5813024753895
Iteration 1 complete. Error: -1068.5813024753895 Total: 50.1595; Orientation: 0.1381; Line Search: 36.4476
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement e6f9d2b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1068.5813024753895;dx=-0.0049024331078505595
New Minimum: -1068.5813024753895 > -1182.2150290873483
END: th(23393.607721408407)=-1182.2150290873483; dx=-0.00394990441420401 evalInputDelta=113.63372661195876
Fitness changed from -1068.5813024753895 to -1182.2150290873483
Iteration 2 complete. Error: -1182.2150290873483 Total: 14.4922; Orientation: 0.0994; Line Search: 8.9365
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 13b5845a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1182.2150290873483;dx=-0.003670614903156455
New Minimum: -1182.2150290873483 > -1352.0472902232377
END: th(50400.00000000001)=-1352.0472902232377; dx=-0.002502886980455317 evalInputDelta=169.83226113588944
Fitness changed from -1182.2150290873483 to -1352.0472902232377
Iteration 3 complete. Error: -1352.0472902232377 Total: 14.5194; Orientation: 0.0987; Line Search: 8.9816
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 40db11b5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.225e+04, gradient 5.074e-02, dot -0.844; [00aac06b-e154-4502-91b9-14378f1ba32b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1352.0472902232377, -1182.2150290873483, -1068.5813024753895, -1003.6925575095195
LBFGS Accumulation History: 3 points
Removed measurement 40db11b5 to history. Total: 3
th(0)=-1352.0472902232377;dx=-0.002570727687529824
New Minimum: -1352.0472902232377 > -1573.820669580877
END: th(108583.50837760697)=-1573.820669580877; dx=-0.0013547399815911979 evalInputDelta=221.77337935763921
Fitness changed from -1352.0472902232377 to -1573.820669580877
Iteration 4 complete. Error: -1573.820669580877 Total: 16.4186; Orientation: 1.7337; Line Search: 9.2877
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 33ec6d35 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.234e+04, gradient 4.882e-02, dot -0.635; [00aac06b-e154-4502-91b9-14378f1ba32b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1573.820669580877, -1182.2150290873483, -1068.5813024753895, -1003.6925575095195
LBFGS Accumulation History: 3 points
Removed measurement 33ec6d35 to history. Total: 3
th(0)=-1573.820669580877;dx=-0.0023795407246362706
New Minimum: -1573.820669580877 > -1792.6776062638814
END: th(233936.07721408413)=-1792.6776062638814; dx=-3.60547606972134E-4 evalInputDelta=218.8569366830045
Fitness changed from -1573.820669580877 to -1792.6776062638814
Iteration 5 complete. Error: -1792.6776062638814 Total: 16.2343; Orientation: 1.6673; Line Search: 9.2294
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7c72f62a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.168e+04, gradient 5.779e-02, dot -0.358; [00aac06b-e154-4502-91b9-14378f1ba32b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1792.6776062638814, -1182.2150290873483, -1068.5813024753895, -1003.6925575095195
LBFGS Accumulation History: 3 points
Removed measurement 7c72f62a to history. Total: 3
th(0)=-1792.6776062638814;dx=-0.0033359005731620267
New Minimum: -1792.6776062638814 > -1819.2994530862698
WOLF (strong): th(504000.0000000002)=-1819.2994530862698; dx=4.0332744116204525E-4 evalInputDelta=26.621846822388306
New Minimum: -1819.2994530862698 > -1945.7026365814484
WOLF (strong): th(252000.0000000001)=-1945.7026365814484; dx=3.2604590018763663E-4 evalInputDelta=153.02503031756692
New Minimum: -1945.7026365814484 > -1956.4875414885728
END: th(84000.00000000003)=-1956.4875414885728; dx=-6.597394684844204E-4 evalInputDelta=163.80993522469134
Fitness changed from -1792.6776062638814 to -1956.4875414885728
Iteration 6 complete. Error: -1956.4875414885728 Total: 25.7680; Orientation: 1.6209; Line Search: 18.6615
Adding measurement 3e628f91 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.633e+04, gradient 4.734e-02, dot -0.450; [00aac06b-e154-4502-91b9-14378f1ba32b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1956.4875414885728, -1182.2150290873483, -1068.5813024753895, -1003.6925575095195
LBFGS Accumulation History: 3 points
Removed measurement 3e628f91 to history. Total: 3
th(0)=-1956.4875414885728;dx=-0.0022401375414480154
New Minimum: -1956.4875414885728 > -2099.3177463166458
END: th(180972.5139626783)=-2099.3177463166458; dx=-9.406082313722534E-5 evalInputDelta=142.83020482807297
Fitness changed from -1956.4875414885728 to -2099.3177463166458
Iteration 7 complete. Error: -2099.3177463166458 Total: 14.9317; Orientation: 1.6117; Line Search: 9.0453
Adding measurement 2ceb7ea9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.158e+04, gradient 5.852e-02, dot -0.359; [00aac06b-e154-4502-91b9-14378f1ba32b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2099.3177463166458, -1182.2150290873483, -1068.5813024753895, -1003.6925575095195
LBFGS Accumulation History: 3 points
Removed measurement 2ceb7ea9 to history. Total: 3
th(0)=-2099.3177463166458;dx=-0.003423959776594293
Armijo: th(389893.4620234736)=-2054.882356729942; dx=5.950727181738142E-4 evalInputDelta=-44.43538958670388
New Minimum: -2099.3177463166458 > -2203.628371572666
WOLF (strong): th(194946.7310117368)=-2203.628371572666; dx=5.675224926658644E-4 evalInputDelta=104.3106252560201
New Minimum: -2203.628371572666 > -2236.722155297792
END: th(64982.24367057893)=-2236.722155297792; dx=-6.850890067661255E-4 evalInputDelta=137.4044089811464
Fitness changed from -2099.3177463166458 to -2236.722155297792
Iteration 8 complete. Error: -2236.722155297792 Total: 24.4984; Orientation: 1.6160; Line Search: 18.3121
Adding measurement 7934010f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.736e+04, gradient 4.234e-02, dot -0.507; [00aac06b-e154-4502-91b9-14378f1ba32b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2236.722155297792, -1182.2150290873483, -1068.5813024753895, -1003.6925575095195
LBFGS Accumulation History: 3 points
Removed measurement 7934010f to history. Total: 3
th(0)=-2236.722155297792;dx=-0.001790841451791806
New Minimum: -2236.722155297792 > -2356.9892872051837
END: th(140000.00000000006)=-2356.9892872051837; dx=-3.166793921899936E-4 evalInputDelta=120.26713190739156
Fitness changed from -2236.722155297792 to -2356.9892872051837
Iteration 9 complete. Error: -2356.9892872051837 Total: 15.1044; Orientation: 1.5827; Line Search: 8.9342
Adding measurement 603a5a74 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.299e+04, gradient 5.094e-02, dot -0.419; [00aac06b-e154-4502-91b9-14378f1ba32b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2356.9892872051837, -1182.2150290873483, -1068.5813024753895, -1003.6925575095195
LBFGS Accumulation History: 3 points
Removed measurement 603a5a74 to history. Total: 3
th(0)=-2356.9892872051837;dx=-0.0025904093639288915
New Minimum: -2356.9892872051837 > -2363.411728836091
WOLF (strong): th(301620.8566044639)=-2363.411728836091; dx=4.768045057331557E-4 evalInputDelta=6.4224416309070875
New Minimum: -2363.411728836091 > -2444.486653675982
WOLF (strong): th(150810.42830223194)=-2444.486653675982; dx=2.768062252847272E-4 evalInputDelta=87.49736647079817
END: th(50270.142767410645)=-2444.005319143148; dx=-7.339382109248989E-4 evalInputDelta=87.01603193796427
Fitness changed from -2356.9892872051837 to -2444.486653675982
Iteration 10 complete. Error: -2444.486653675982 Total: 24.5007; Orientation: 1.6254; Line Search: 18.1634
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2444.486653675982 (> -Infinity) after 217.455s (< 5400.000s)
Returns
-2444.486653675982