BasicOptimizer.scala:89 executed in 216.83 seconds (3.538 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 693142262857200
Reset training subject: 693146803952500
Adding measurement 14fec53 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1069.7232118637046;dx=-0.006112338655695983
New Minimum: -1069.7232118637046 > -1069.736825111672
WOLFE (weak): th(2.154434690031884)=-1069.736825111672; dx=-0.005778320791090495 evalInputDelta=0.013613247967441566
New Minimum: -1069.736825111672 > -1069.7504381864023
WOLFE (weak): th(4.308869380063768)=-1069.7504381864023; dx=-0.005779363626808682 evalInputDelta=0.027226322697742944
New Minimum: -1069.7504381864023 > -1069.8050055968145
WOLFE (weak): th(12.926608140191302)=-1069.8050055968145; dx=-0.005772965169328914 evalInputDelta=0.08179373310986193
New Minimum: -1069.8050055968145 > -1070.0504076911518
WOLFE (weak): th(51.70643256076521)=-1070.0504076911518; dx=-0.005774629630188977 evalInputDelta=0.32719582744721265
New Minimum: -1070.0504076911518 > -1071.3585417590136
WOLFE (weak): th(258.53216280382605)=-1071.3585417590136; dx=-0.005766226505790293 evalInputDelta=1.6353298953090416
New Minimum: -1071.3585417590136 > -1079.4874362399962
WOLFE (weak): th(1551.1929768229563)=-1079.4874362399962; dx=-0.005713474561319664 evalInputDelta=9.764224376291622
New Minimum: -1079.4874362399962 > -1135.399929540248
END: th(10858.350837760694)=-1135.399929540248; dx=-0.005243612887152362 evalInputDelta=65.67671767654338
Fitness changed from -1069.7232118637046 to -1135.399929540248
Iteration 1 complete. Error: -1135.399929540248 Total: 49.5510; Orientation: 0.0988; Line Search: 36.1189
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2d8c97c1 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1135.399929540248;dx=-0.00496772990158089
New Minimum: -1135.399929540248 > -1250.6075523520558
END: th(23393.607721408407)=-1250.6075523520558; dx=-0.0040147377092024945 evalInputDelta=115.20762281180782
Fitness changed from -1135.399929540248 to -1250.6075523520558
Iteration 2 complete. Error: -1250.6075523520558 Total: 14.9686; Orientation: 0.0975; Line Search: 9.2214
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3c88a7fa to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1250.6075523520558;dx=-0.003704386834979173
New Minimum: -1250.6075523520558 > -1423.067812860652
END: th(50400.00000000001)=-1423.067812860652; dx=-0.002570304265811364 evalInputDelta=172.46026050859632
Fitness changed from -1250.6075523520558 to -1423.067812860652
Iteration 3 complete. Error: -1423.067812860652 Total: 14.6143; Orientation: 0.0838; Line Search: 9.1391
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 12303374 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.268e+04, gradient 5.054e-02, dot -0.859; [faa82865-1fee-46d3-bfdf-78ca94df7ae0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1423.067812860652, -1250.6075523520558, -1135.399929540248, -1069.7232118637046
LBFGS Accumulation History: 3 points
Removed measurement 12303374 to history. Total: 3
th(0)=-1423.067812860652;dx=-0.0025527640023376534
New Minimum: -1423.067812860652 > -1647.7386018419304
END: th(108583.50837760697)=-1647.7386018419304; dx=-0.0013880480746018933 evalInputDelta=224.6707889812783
Fitness changed from -1423.067812860652 to -1647.7386018419304
Iteration 4 complete. Error: -1647.7386018419304 Total: 15.7502; Orientation: 1.7365; Line Search: 8.9112
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 10b9e893 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.258e+04, gradient 4.822e-02, dot -0.642; [faa82865-1fee-46d3-bfdf-78ca94df7ae0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1647.7386018419304, -1250.6075523520558, -1135.399929540248, -1069.7232118637046
LBFGS Accumulation History: 3 points
Removed measurement 10b9e893 to history. Total: 3
th(0)=-1647.7386018419304;dx=-0.0023229291036534084
New Minimum: -1647.7386018419304 > -1871.8253123622408
END: th(233936.07721408413)=-1871.8253123622408; dx=-4.1720230529304435E-4 evalInputDelta=224.08671052031036
Fitness changed from -1647.7386018419304 to -1871.8253123622408
Iteration 5 complete. Error: -1871.8253123622408 Total: 16.9149; Orientation: 1.7541; Line Search: 9.5411
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 22576c43 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.191e+04, gradient 5.575e-02, dot -0.378; [faa82865-1fee-46d3-bfdf-78ca94df7ae0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1871.8253123622408, -1250.6075523520558, -1135.399929540248, -1069.7232118637046
LBFGS Accumulation History: 3 points
Removed measurement 22576c43 to history. Total: 3
th(0)=-1871.8253123622408;dx=-0.0031029533924058165
New Minimum: -1871.8253123622408 > -1913.2714130514782
WOLF (strong): th(504000.0000000002)=-1913.2714130514782; dx=3.8512073458353443E-4 evalInputDelta=41.44610068923748
New Minimum: -1913.2714130514782 > -2029.5153362317812
WOLF (strong): th(252000.0000000001)=-2029.5153362317812; dx=2.639735690493335E-4 evalInputDelta=157.69002386954048
New Minimum: -2029.5153362317812 > -2030.0439650411515
END: th(84000.00000000003)=-2030.0439650411515; dx=-6.998377923933315E-4 evalInputDelta=158.21865267891076
Fitness changed from -1871.8253123622408 to -2030.0439650411515
Iteration 6 complete. Error: -2030.0439650411515 Total: 25.1616; Orientation: 1.7361; Line Search: 18.0182
Adding measurement 61403d9f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.667e+04, gradient 4.552e-02, dot -0.474; [faa82865-1fee-46d3-bfdf-78ca94df7ae0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2030.0439650411515, -1250.6075523520558, -1135.399929540248, -1069.7232118637046
LBFGS Accumulation History: 3 points
Removed measurement 61403d9f to history. Total: 3
th(0)=-2030.0439650411515;dx=-0.0020706442312519134
New Minimum: -2030.0439650411515 > -2178.2778748359906
END: th(180972.5139626783)=-2178.2778748359906; dx=-2.2569984446981563E-4 evalInputDelta=148.23390979483906
Fitness changed from -2030.0439650411515 to -2178.2778748359906
Iteration 7 complete. Error: -2178.2778748359906 Total: 15.0444; Orientation: 1.6805; Line Search: 9.0495
Adding measurement 6867d44c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.232e+04, gradient 5.570e-02, dot -0.383; [faa82865-1fee-46d3-bfdf-78ca94df7ae0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2178.2778748359906, -1250.6075523520558, -1135.399929540248, -1069.7232118637046
LBFGS Accumulation History: 3 points
Removed measurement 6867d44c to history. Total: 3
th(0)=-2178.2778748359906;dx=-0.003101172663424908
Armijo: th(389893.4620234736)=-2170.844536119526; dx=4.951898663434913E-4 evalInputDelta=-7.433338716464732
New Minimum: -2178.2778748359906 > -2287.1978488972045
WOLF (strong): th(194946.7310117368)=-2287.1978488972045; dx=3.9681578204549744E-4 evalInputDelta=108.9199740612139
New Minimum: -2287.1978488972045 > -2306.076538192087
END: th(64982.24367057893)=-2306.076538192087; dx=-7.019064100707716E-4 evalInputDelta=127.79866335609631
Fitness changed from -2178.2778748359906 to -2306.076538192087
Iteration 8 complete. Error: -2306.076538192087 Total: 24.4341; Orientation: 1.6351; Line Search: 18.0937
Adding measurement 4080efac to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.906e+04, gradient 4.062e-02, dot -0.543; [faa82865-1fee-46d3-bfdf-78ca94df7ae0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2306.076538192087, -1250.6075523520558, -1135.399929540248, -1069.7232118637046
LBFGS Accumulation History: 3 points
Removed measurement 4080efac to history. Total: 3
th(0)=-2306.076538192087;dx=-0.0016473616582534031
New Minimum: -2306.076538192087 > -2429.6542963969173
END: th(140000.00000000006)=-2429.6542963969173; dx=-4.2081895486528655E-4 evalInputDelta=123.57775820483039
Fitness changed from -2306.076538192087 to -2429.6542963969173
Iteration 9 complete. Error: -2429.6542963969173 Total: 15.1278; Orientation: 1.5957; Line Search: 8.9030
Adding measurement 41ea0bb2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.447e+04, gradient 4.829e-02, dot -0.451; [faa82865-1fee-46d3-bfdf-78ca94df7ae0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2429.6542963969173, -1250.6075523520558, -1135.399929540248, -1069.7232118637046
LBFGS Accumulation History: 3 points
Removed measurement 41ea0bb2 to history. Total: 3
th(0)=-2429.6542963969173;dx=-0.0023239999396027712
New Minimum: -2429.6542963969173 > -2471.221357952379
WOLF (strong): th(301620.8566044639)=-2471.221357952379; dx=2.9747549854066877E-4 evalInputDelta=41.567061555461805
New Minimum: -2471.221357952379 > -2520.607863194908
WOLF (strong): th(150810.42830223194)=-2520.607863194908; dx=1.0443245901158263E-4 evalInputDelta=90.95356679799079
END: th(50270.142767410645)=-2509.505329741302; dx=-7.298460323495581E-4 evalInputDelta=79.85103334438463
Fitness changed from -2429.6542963969173 to -2520.607863194908
Iteration 10 complete. Error: -2520.607863194908 Total: 24.2642; Orientation: 1.7214; Line Search: 18.2540
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2520.607863194908 (> -Infinity) after 216.826s (< 5400.000s)
Returns
-2520.607863194908