BasicOptimizer.scala:89 executed in 219.30 seconds (3.693 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 696347440714300
Reset training subject: 696352402667300
Adding measurement 15099ab2 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-989.911770058322;dx=-0.005812496125718025
New Minimum: -989.911770058322 > -989.9239869808187
END: th(2.154434690031884)=-989.9239869808187; dx=-0.005163293274107892 evalInputDelta=0.01221692249669104
Fitness changed from -989.911770058322 to -989.9239869808187
Iteration 1 complete. Error: -989.9239869808187 Total: 22.9394; Orientation: 0.0970; Line Search: 8.9150
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6672e20a to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-989.9239869808187;dx=-0.005158069909586114
New Minimum: -989.9239869808187 > -989.9502828425274
WOLFE (weak): th(4.641588833612779)=-989.9502828425274; dx=-0.005157854860837625 evalInputDelta=0.026295861708717894
New Minimum: -989.9502828425274 > -989.976514872954
WOLFE (weak): th(9.283177667225559)=-989.976514872954; dx=-0.005155699967498255 evalInputDelta=0.0525278921353447
New Minimum: -989.976514872954 > -990.0814991706491
WOLFE (weak): th(27.849533001676676)=-990.0814991706491; dx=-0.005151144847562757 evalInputDelta=0.15751218983041326
New Minimum: -990.0814991706491 > -990.5532229516998
WOLFE (weak): th(111.3981320067067)=-990.5532229516998; dx=-0.0051481024294403824 evalInputDelta=0.6292359708811546
New Minimum: -990.5532229516998 > -993.0639455745032
WOLFE (weak): th(556.9906600335335)=-993.0639455745032; dx=-0.005130567887154662 evalInputDelta=3.1399585936845824
New Minimum: -993.0639455745032 > -1008.5557743625287
WOLFE (weak): th(3341.9439602012008)=-1008.5557743625287; dx=-0.005016898955520233 evalInputDelta=18.63178738171007
New Minimum: -1008.5557743625287 > -1108.0376798647237
END: th(23393.607721408407)=-1108.0376798647237; dx=-0.004024660454448517 evalInputDelta=118.11369288390506
Fitness changed from -989.9239869808187 to -1108.0376798647237
Iteration 2 complete. Error: -1108.0376798647237 Total: 42.4121; Orientation: 0.0977; Line Search: 36.8723
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 46b8009 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1108.0376798647237;dx=-0.0038114470635023127
New Minimum: -1108.0376798647237 > -1278.902459142213
END: th(50400.00000000001)=-1278.902459142213; dx=-0.0024763582031295905 evalInputDelta=170.86477927748933
Fitness changed from -1108.0376798647237 to -1278.902459142213
Iteration 3 complete. Error: -1278.902459142213 Total: 14.7495; Orientation: 0.0904; Line Search: 9.0666
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement c729b85 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.631e+03, gradient 5.115e-02, dot -0.756; [b8a2569d-8ce4-49f0-a5e9-fbccde5ec859 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1278.902459142213, -1108.0376798647237, -989.9239869808187, -989.911770058322
LBFGS Accumulation History: 3 points
Removed measurement c729b85 to history. Total: 3
th(0)=-1278.902459142213;dx=-0.002613210545214956
New Minimum: -1278.902459142213 > -1505.0426904244277
END: th(108583.50837760697)=-1505.0426904244277; dx=-0.0013504100508056442 evalInputDelta=226.1402312822147
Fitness changed from -1278.902459142213 to -1505.0426904244277
Iteration 4 complete. Error: -1505.0426904244277 Total: 16.2879; Orientation: 1.6911; Line Search: 9.1500
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 62956308 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.129e+03, gradient 4.800e-02, dot -0.568; [b8a2569d-8ce4-49f0-a5e9-fbccde5ec859 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1505.0426904244277, -1108.0376798647237, -989.9239869808187, -989.911770058322
LBFGS Accumulation History: 3 points
Removed measurement 62956308 to history. Total: 3
th(0)=-1505.0426904244277;dx=-0.0023023478589367513
New Minimum: -1505.0426904244277 > -1741.2929104547575
END: th(233936.07721408413)=-1741.2929104547575; dx=-4.333054371983431E-4 evalInputDelta=236.25022003032973
Fitness changed from -1505.0426904244277 to -1741.2929104547575
Iteration 5 complete. Error: -1741.2929104547575 Total: 16.8119; Orientation: 1.7399; Line Search: 9.4767
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement f554279 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.808e+03, gradient 5.431e-02, dot -0.277; [b8a2569d-8ce4-49f0-a5e9-fbccde5ec859 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1741.2929104547575, -1108.0376798647237, -989.9239869808187, -989.911770058322
LBFGS Accumulation History: 3 points
Removed measurement f554279 to history. Total: 3
th(0)=-1741.2929104547575;dx=-0.0029469013015427517
New Minimum: -1741.2929104547575 > -1805.802037876799
WOLF (strong): th(504000.0000000002)=-1805.802037876799; dx=3.321459856635067E-4 evalInputDelta=64.5091274220415
New Minimum: -1805.802037876799 > -1913.280624999898
WOLF (strong): th(252000.0000000001)=-1913.280624999898; dx=2.517579860538705E-4 evalInputDelta=171.98771454514053
END: th(84000.00000000003)=-1901.608135237121; dx=-8.279805410359456E-4 evalInputDelta=160.31522478236343
Fitness changed from -1741.2929104547575 to -1913.280624999898
Iteration 6 complete. Error: -1913.280624999898 Total: 25.7893; Orientation: 1.6685; Line Search: 18.6248
Adding measurement 9796242 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.672e+03, gradient 5.947e-02, dot -0.191; [b8a2569d-8ce4-49f0-a5e9-fbccde5ec859 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1913.280624999898, -1108.0376798647237, -989.9239869808187, -989.911770058322
LBFGS Accumulation History: 3 points
Removed measurement 9796242 to history. Total: 3
th(0)=-1913.280624999898;dx=-0.0035352159837100947
New Minimum: -1913.280624999898 > -2159.8245299097794
WOLF (strong): th(180972.5139626783)=-2159.8245299097794; dx=2.0750488316613827E-4 evalInputDelta=246.54390490988135
END: th(90486.25698133915)=-2133.6916365773195; dx=-0.0010108287767762274 evalInputDelta=220.4110115774215
Fitness changed from -1913.280624999898 to -2159.8245299097794
Iteration 7 complete. Error: -2159.8245299097794 Total: 19.8063; Orientation: 1.6590; Line Search: 13.8937
Adding measurement 32723330 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.548e+04, gradient 5.440e-02, dot -0.252; [b8a2569d-8ce4-49f0-a5e9-fbccde5ec859 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2159.8245299097794, -1108.0376798647237, -989.9239869808187, -989.911770058322
LBFGS Accumulation History: 3 points
Removed measurement 32723330 to history. Total: 3
th(0)=-2159.8245299097794;dx=-0.002954428272564694
New Minimum: -2159.8245299097794 > -2337.054128598651
WOLF (strong): th(194946.7310117368)=-2337.054128598651; dx=4.474417805407372E-4 evalInputDelta=177.22959868887165
New Minimum: -2337.054128598651 > -2341.6094892189003
END: th(97473.3655058684)=-2341.6094892189003; dx=-6.499463256772154E-4 evalInputDelta=181.78495930912095
Fitness changed from -2159.8245299097794 to -2341.6094892189003
Iteration 8 complete. Error: -2341.6094892189003 Total: 19.7012; Orientation: 1.6029; Line Search: 13.7552
Adding measurement 4d40b214 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.645e+04, gradient 4.202e-02, dot -0.424; [b8a2569d-8ce4-49f0-a5e9-fbccde5ec859 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2341.6094892189003, -1108.0376798647237, -989.9239869808187, -989.911770058322
LBFGS Accumulation History: 3 points
Removed measurement 4d40b214 to history. Total: 3
th(0)=-2341.6094892189003;dx=-0.0017638746437554382
New Minimum: -2341.6094892189003 > -2494.4178679603783
END: th(210000.0000000001)=-2494.4178679603783; dx=-1.5996714926669797E-4 evalInputDelta=152.808378741478
Fitness changed from -2341.6094892189003 to -2494.4178679603783
Iteration 9 complete. Error: -2494.4178679603783 Total: 15.4720; Orientation: 1.6333; Line Search: 9.1879
Adding measurement 4cbcf6d9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.798e+04, gradient 5.142e-02, dot -0.307; [b8a2569d-8ce4-49f0-a5e9-fbccde5ec859 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2494.4178679603783, -1108.0376798647237, -989.9239869808187, -989.911770058322
LBFGS Accumulation History: 3 points
Removed measurement 4cbcf6d9 to history. Total: 3
th(0)=-2494.4178679603783;dx=-0.002644237154810462
Armijo: th(452431.2849066958)=-2393.2949045197083; dx=6.716981166002055E-4 evalInputDelta=-101.12296344066999
New Minimum: -2494.4178679603783 > -2579.9399217811256
WOLF (strong): th(226215.6424533479)=-2579.9399217811256; dx=5.583271953828848E-4 evalInputDelta=85.52205382074726
New Minimum: -2579.9399217811256 > -2621.742741002633
END: th(75405.21415111596)=-2621.742741002633; dx=-6.113600498789407E-4 evalInputDelta=127.3248730422547
Fitness changed from -2494.4178679603783 to -2621.742741002633
Iteration 10 complete. Error: -2621.742741002633 Total: 24.4580; Orientation: 1.6228; Line Search: 18.4987
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2621.742741002633 (> -Infinity) after 219.301s (< 5400.000s)
Returns
-2621.742741002633