BasicOptimizer.scala:89 executed in 217.28 seconds (3.371 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 688516718083100
Reset training subject: 688521332023400
Adding measurement 364346d9 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-857.6210555950687;dx=-0.008494816341172863
New Minimum: -857.6210555950687 > -857.6398573993632
WOLFE (weak): th(2.154434690031884)=-857.6398573993632; dx=-0.007977195474313512 evalInputDelta=0.018801804294525937
New Minimum: -857.6398573993632 > -857.6586587914799
WOLFE (weak): th(4.308869380063768)=-857.6586587914799; dx=-0.00796950067173939 evalInputDelta=0.03760319641116894
New Minimum: -857.6586587914799 > -857.7337873722826
WOLFE (weak): th(12.926608140191302)=-857.7337873722826; dx=-0.007973236484681083 evalInputDelta=0.11273177721386674
New Minimum: -857.7337873722826 > -858.0720759353494
WOLFE (weak): th(51.70643256076521)=-858.0720759353494; dx=-0.007963776886028662 evalInputDelta=0.4510203402807065
New Minimum: -858.0720759353494 > -859.8733555006806
WOLFE (weak): th(258.53216280382605)=-859.8733555006806; dx=-0.007952975740582041 evalInputDelta=2.252299905611949
New Minimum: -859.8733555006806 > -871.0117680031653
WOLFE (weak): th(1551.1929768229563)=-871.0117680031653; dx=-0.007802436133532474 evalInputDelta=13.390712408096647
New Minimum: -871.0117680031653 > -944.0700781721662
END: th(10858.350837760694)=-944.0700781721662; dx=-0.006494212690110404 evalInputDelta=86.44902257709748
Fitness changed from -857.6210555950687 to -944.0700781721662
Iteration 1 complete. Error: -944.0700781721662 Total: 50.4794; Orientation: 0.1008; Line Search: 37.0327
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 93dedf1 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-944.0700781721662;dx=-0.005976266790755284
New Minimum: -944.0700781721662 > -1074.116264656671
END: th(23393.607721408407)=-1074.116264656671; dx=-0.004212366846227033 evalInputDelta=130.04618648450491
Fitness changed from -944.0700781721662 to -1074.116264656671
Iteration 2 complete. Error: -1074.116264656671 Total: 14.6319; Orientation: 0.0865; Line Search: 9.2679
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 8303438 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1074.116264656671;dx=-0.0040666432182563505
New Minimum: -1074.116264656671 > -1248.4837804312879
END: th(50400.00000000001)=-1248.4837804312879; dx=-0.002372129419557124 evalInputDelta=174.36751577461678
Fitness changed from -1074.116264656671 to -1248.4837804312879
Iteration 3 complete. Error: -1248.4837804312879 Total: 14.6085; Orientation: 0.0968; Line Search: 8.8641
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4945e3ce to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.016e+04, gradient 5.630e-02, dot -0.757; [ed09b8c7-cb50-4632-9885-3241f6e66bd2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1248.4837804312879, -1074.116264656671, -944.0700781721662, -857.6210555950687
LBFGS Accumulation History: 3 points
Removed measurement 4945e3ce to history. Total: 3
th(0)=-1248.4837804312879;dx=-0.0031682952710016454
New Minimum: -1248.4837804312879 > -1438.9907053209204
END: th(108583.50837760697)=-1438.9907053209204; dx=-9.379317582653588E-4 evalInputDelta=190.5069248896325
Fitness changed from -1248.4837804312879 to -1438.9907053209204
Iteration 4 complete. Error: -1438.9907053209204 Total: 16.5806; Orientation: 1.7167; Line Search: 9.3912
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 1647a369 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.570e+03, gradient 6.438e-02, dot -0.487; [ed09b8c7-cb50-4632-9885-3241f6e66bd2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1438.9907053209204, -1074.116264656671, -944.0700781721662, -857.6210555950687
LBFGS Accumulation History: 3 points
Removed measurement 1647a369 to history. Total: 3
th(0)=-1438.9907053209204;dx=-0.004138855756867831
New Minimum: -1438.9907053209204 > -1543.5970976909746
WOLF (strong): th(233936.07721408413)=-1543.5970976909746; dx=1.3702676515491534E-4 evalInputDelta=104.60639237005421
New Minimum: -1543.5970976909746 > -1563.3347370285098
END: th(116968.03860704206)=-1563.3347370285098; dx=-1.780431820688703E-5 evalInputDelta=124.34403170758947
Fitness changed from -1438.9907053209204 to -1563.3347370285098
Iteration 5 complete. Error: -1563.3347370285098 Total: 20.7034; Orientation: 1.6754; Line Search: 13.5140
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement d42834b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.115e+04, gradient 6.655e-02, dot -0.382; [ed09b8c7-cb50-4632-9885-3241f6e66bd2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1563.3347370285098, -1074.116264656671, -944.0700781721662, -857.6210555950687
LBFGS Accumulation History: 3 points
Removed measurement d42834b to history. Total: 3
th(0)=-1563.3347370285098;dx=-0.004415613276140991
New Minimum: -1563.3347370285098 > -1626.24905841633
WOLF (strong): th(252000.0000000001)=-1626.24905841633; dx=5.422367339518099E-4 evalInputDelta=62.91432138782011
New Minimum: -1626.24905841633 > -1714.2568360662879
WOLF (strong): th(126000.00000000004)=-1714.2568360662879; dx=3.92612493436932E-4 evalInputDelta=150.92209903777803
END: th(42000.000000000015)=-1695.476924054114; dx=-0.001475001480132927 evalInputDelta=132.14218702560424
Fitness changed from -1563.3347370285098 to -1714.2568360662879
Iteration 6 complete. Error: -1714.2568360662879 Total: 25.0028; Orientation: 1.6203; Line Search: 18.0583
Adding measurement 3681ea0a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.326e+04, gradient 6.700e-02, dot -0.338; [ed09b8c7-cb50-4632-9885-3241f6e66bd2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1714.2568360662879, -1074.116264656671, -944.0700781721662, -857.6210555950687
LBFGS Accumulation History: 3 points
Removed measurement 3681ea0a to history. Total: 3
th(0)=-1714.2568360662879;dx=-0.00448746806288825
New Minimum: -1714.2568360662879 > -1887.1308248237588
WOLF (strong): th(90486.25698133915)=-1887.1308248237588; dx=2.2507096375087672E-5 evalInputDelta=172.8739887574709
END: th(45243.12849066957)=-1859.5867148374662; dx=-0.001512468295902751 evalInputDelta=145.3298787711783
Fitness changed from -1714.2568360662879 to -1887.1308248237588
Iteration 7 complete. Error: -1887.1308248237588 Total: 19.5500; Orientation: 1.5794; Line Search: 13.6880
Adding measurement 54ffa45b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.024e+04, gradient 5.966e-02, dot -0.392; [ed09b8c7-cb50-4632-9885-3241f6e66bd2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1887.1308248237588, -1074.116264656671, -944.0700781721662, -857.6210555950687
LBFGS Accumulation History: 3 points
Removed measurement 54ffa45b to history. Total: 3
th(0)=-1887.1308248237588;dx=-0.003558472939960515
New Minimum: -1887.1308248237588 > -2010.3900119131113
WOLF (strong): th(97473.3655058684)=-2010.3900119131113; dx=2.1295944170450027E-4 evalInputDelta=123.25918708935251
END: th(48736.6827529342)=-1999.2302268623291; dx=-9.267474490618433E-4 evalInputDelta=112.09940203857036
Fitness changed from -1887.1308248237588 to -2010.3900119131113
Iteration 8 complete. Error: -2010.3900119131113 Total: 19.9364; Orientation: 1.6163; Line Search: 13.7883
Adding measurement 227b82d4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.544e+04, gradient 6.202e-02, dot -0.377; [ed09b8c7-cb50-4632-9885-3241f6e66bd2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2010.3900119131113, -1074.116264656671, -944.0700781721662, -857.6210555950687
LBFGS Accumulation History: 3 points
Removed measurement 227b82d4 to history. Total: 3
th(0)=-2010.3900119131113;dx=-0.0038371468694503317
New Minimum: -2010.3900119131113 > -2109.6736714477906
WOLF (strong): th(105000.00000000004)=-2109.6736714477906; dx=6.340909971494432E-4 evalInputDelta=99.28365953467937
New Minimum: -2109.6736714477906 > -2122.4893403737037
END: th(52500.00000000002)=-2122.4893403737037; dx=-5.417429418532662E-4 evalInputDelta=112.09932846059246
Fitness changed from -2010.3900119131113 to -2122.4893403737037
Iteration 9 complete. Error: -2122.4893403737037 Total: 19.2819; Orientation: 1.5918; Line Search: 13.4576
Adding measurement 4de76c60 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.273e+04, gradient 4.733e-02, dot -0.507; [ed09b8c7-cb50-4632-9885-3241f6e66bd2 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2122.4893403737037, -1074.116264656671, -944.0700781721662, -857.6210555950687
LBFGS Accumulation History: 3 points
Removed measurement 4de76c60 to history. Total: 3
th(0)=-2122.4893403737037;dx=-0.0022377794302829352
New Minimum: -2122.4893403737037 > -2215.3033652301438
END: th(113107.82122667394)=-2215.3033652301438; dx=-7.558051753736925E-5 evalInputDelta=92.81402485644003
Fitness changed from -2122.4893403737037 to -2215.3033652301438
Iteration 10 complete. Error: -2215.3033652301438 Total: 15.6054; Orientation: 1.6571; Line Search: 9.3761
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2215.3033652301438 (> -Infinity) after 217.276s (< 5400.000s)
Returns
-2215.3033652301438