BasicOptimizer.scala:89 executed in 223.24 seconds (3.518 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 690921967318300
Reset training subject: 690926446420900
Adding measurement 29d444a2 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-850.80212153003;dx=-0.007685992074074693
New Minimum: -850.80212153003 > -850.8185397016217
WOLFE (weak): th(2.154434690031884)=-850.8185397016217; dx=-0.006996426530558085 evalInputDelta=0.01641817159168113
New Minimum: -850.8185397016217 > -850.8349575563994
WOLFE (weak): th(4.308869380063768)=-850.8349575563994; dx=-0.006988642393833261 evalInputDelta=0.03283602636940941
New Minimum: -850.8349575563994 > -850.9006992593202
WOLFE (weak): th(12.926608140191302)=-850.9006992593202; dx=-0.006993246498823255 evalInputDelta=0.09857772929012754
New Minimum: -850.9006992593202 > -851.1962170968571
WOLFE (weak): th(51.70643256076521)=-851.1962170968571; dx=-0.006993549459324885 evalInputDelta=0.39409556682710445
New Minimum: -851.1962170968571 > -852.7711812086523
WOLFE (weak): th(258.53216280382605)=-852.7711812086523; dx=-0.006979174599897506 evalInputDelta=1.9690596786222159
New Minimum: -852.7711812086523 > -862.5355065155289
END: th(1551.1929768229563)=-862.5355065155289; dx=-0.006873609208278384 evalInputDelta=11.733384985498901
Fitness changed from -850.80212153003 to -862.5355065155289
Iteration 1 complete. Error: -862.5355065155289 Total: 45.2695; Orientation: 0.0967; Line Search: 31.8056
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 78e1526 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-862.5355065155289;dx=-0.006789284533338939
New Minimum: -862.5355065155289 > -886.784077439373
WOLFE (weak): th(3341.943960201201)=-886.784077439373; dx=-0.006526705403426008 evalInputDelta=24.248570923844113
New Minimum: -886.784077439373 > -910.034408690133
WOLFE (weak): th(6683.887920402402)=-910.034408690133; dx=-0.006244356339111471 evalInputDelta=47.49890217460404
New Minimum: -910.034408690133 > -991.78469185605
END: th(20051.663761207208)=-991.78469185605; dx=-0.004979371962180383 evalInputDelta=129.24918534052108
Fitness changed from -862.5355065155289 to -991.78469185605
Iteration 2 complete. Error: -991.78469185605 Total: 24.6378; Orientation: 0.0994; Line Search: 18.5383
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 49ea4d6d to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-991.78469185605;dx=-0.004620229319844973
New Minimum: -991.78469185605 > -1165.6974307254864
END: th(43200.00000000001)=-1165.6974307254864; dx=-0.002805733173012275 evalInputDelta=173.91273886943634
Fitness changed from -991.78469185605 to -1165.6974307254864
Iteration 3 complete. Error: -1165.6974307254864 Total: 14.6552; Orientation: 0.0984; Line Search: 8.9412
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 53664f45 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.707e+03, gradient 5.549e-02, dot -0.732; [095a6375-6096-46c2-bafd-b572ab9c7c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1165.6974307254864, -991.78469185605, -862.5355065155289, -850.80212153003
LBFGS Accumulation History: 3 points
Removed measurement 53664f45 to history. Total: 3
th(0)=-1165.6974307254864;dx=-0.00307461118161921
New Minimum: -1165.6974307254864 > -1369.5576384365866
END: th(93071.5786093774)=-1369.5576384365866; dx=-0.0012821390059277124 evalInputDelta=203.8602077111002
Fitness changed from -1165.6974307254864 to -1369.5576384365866
Iteration 4 complete. Error: -1369.5576384365866 Total: 16.2058; Orientation: 1.7267; Line Search: 9.1073
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 316ec369 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.340e+03, gradient 5.580e-02, dot -0.472; [095a6375-6096-46c2-bafd-b572ab9c7c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1369.5576384365866, -991.78469185605, -862.5355065155289, -850.80212153003
LBFGS Accumulation History: 3 points
Removed measurement 316ec369 to history. Total: 3
th(0)=-1369.5576384365866;dx=-0.003110687154701893
New Minimum: -1369.5576384365866 > -1526.7466227242817
END: th(200516.63761207208)=-1526.7466227242817; dx=-9.299874572480936E-5 evalInputDelta=157.18898428769512
Fitness changed from -1369.5576384365866 to -1526.7466227242817
Iteration 5 complete. Error: -1526.7466227242817 Total: 16.6933; Orientation: 1.6596; Line Search: 9.5928
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 46b9a26e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.286e+03, gradient 6.510e-02, dot -0.205; [095a6375-6096-46c2-bafd-b572ab9c7c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1526.7466227242817, -991.78469185605, -862.5355065155289, -850.80212153003
LBFGS Accumulation History: 3 points
Removed measurement 46b9a26e to history. Total: 3
th(0)=-1526.7466227242817;dx=-0.004234476873294477
Armijo: th(432000.0000000001)=-1462.0954996169025; dx=6.60255355234666E-4 evalInputDelta=-64.65112310737914
New Minimum: -1526.7466227242817 > -1653.0151239477514
WOLF (strong): th(216000.00000000006)=-1653.0151239477514; dx=7.449927141532035E-4 evalInputDelta=126.26850122346968
New Minimum: -1653.0151239477514 > -1709.0904013538898
END: th(72000.00000000001)=-1709.0904013538898; dx=-7.736384905359417E-4 evalInputDelta=182.3437786296081
Fitness changed from -1526.7466227242817 to -1709.0904013538898
Iteration 6 complete. Error: -1709.0904013538898 Total: 25.4233; Orientation: 1.6203; Line Search: 18.2174
Adding measurement 62d60155 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.009e+04, gradient 5.067e-02, dot -0.355; [095a6375-6096-46c2-bafd-b572ab9c7c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1709.0904013538898, -991.78469185605, -862.5355065155289, -850.80212153003
LBFGS Accumulation History: 3 points
Removed measurement 62d60155 to history. Total: 3
th(0)=-1709.0904013538898;dx=-0.0025604531484049982
New Minimum: -1709.0904013538898 > -1851.1209441849012
END: th(155119.29768229567)=-1851.1209441849012; dx=-4.157566677838432E-5 evalInputDelta=142.03054283101142
Fitness changed from -1709.0904013538898 to -1851.1209441849012
Iteration 7 complete. Error: -1851.1209441849012 Total: 15.6227; Orientation: 1.6309; Line Search: 9.2589
Adding measurement 7e288f1c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.298e+04, gradient 6.227e-02, dot -0.276; [095a6375-6096-46c2-bafd-b572ab9c7c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1851.1209441849012, -991.78469185605, -862.5355065155289, -850.80212153003
LBFGS Accumulation History: 3 points
Removed measurement 7e288f1c to history. Total: 3
th(0)=-1851.1209441849012;dx=-0.0038674703121130555
Armijo: th(334194.3960201202)=-1757.7409507660677; dx=8.60355592012583E-4 evalInputDelta=-93.37999341883346
New Minimum: -1851.1209441849012 > -1941.1652428374045
WOLF (strong): th(167097.1980100601)=-1941.1652428374045; dx=8.730965376783386E-4 evalInputDelta=90.04429865250336
New Minimum: -1941.1652428374045 > -1986.324872723493
END: th(55699.066003353364)=-1986.324872723493; dx=-8.076938949530732E-4 evalInputDelta=135.20392853859175
Fitness changed from -1851.1209441849012 to -1986.324872723493
Iteration 8 complete. Error: -1986.324872723493 Total: 24.3250; Orientation: 1.6306; Line Search: 18.4479
Adding measurement 5e379fbf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.928e+04, gradient 4.548e-02, dot -0.448; [095a6375-6096-46c2-bafd-b572ab9c7c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1986.324872723493, -991.78469185605, -862.5355065155289, -850.80212153003
LBFGS Accumulation History: 3 points
Removed measurement 5e379fbf to history. Total: 3
th(0)=-1986.324872723493;dx=-0.002065180502231881
New Minimum: -1986.324872723493 > -2096.931806235005
END: th(120000.00000000004)=-2096.931806235005; dx=-2.383750007647331E-4 evalInputDelta=110.6069335115119
Fitness changed from -1986.324872723493 to -2096.931806235005
Iteration 9 complete. Error: -2096.931806235005 Total: 15.3008; Orientation: 1.6463; Line Search: 9.3235
Adding measurement 39ae901d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.216e+04, gradient 5.499e-02, dot -0.355; [095a6375-6096-46c2-bafd-b572ab9c7c8a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2096.931806235005, -991.78469185605, -862.5355065155289, -850.80212153003
LBFGS Accumulation History: 3 points
Removed measurement 39ae901d to history. Total: 3
th(0)=-2096.931806235005;dx=-0.003013457160471053
Armijo: th(258532.16280382616)=-2065.4993343015144; dx=7.052554912743179E-4 evalInputDelta=-31.432471933490433
New Minimum: -2096.931806235005 > -2169.914514445212
WOLF (strong): th(129266.08140191308)=-2169.914514445212; dx=4.928809340127414E-4 evalInputDelta=72.98270821020697
New Minimum: -2169.914514445212 > -2183.151849963717
END: th(43088.693800637695)=-2183.151849963717; dx=-7.989942788800509E-4 evalInputDelta=86.22004372871197
Fitness changed from -2096.931806235005 to -2183.151849963717
Iteration 10 complete. Error: -2183.151849963717 Total: 24.0977; Orientation: 1.5956; Line Search: 17.8907
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2183.151849963717 (> -Infinity) after 223.244s (< 5400.000s)
Returns
-2183.151849963717