BasicOptimizer.scala:89 executed in 152.60 seconds (2.638 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 459515062568100
Reset training subject: 459517973841800
Adding measurement 14a83457 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-99.42588746158874;dx=-1.3197940390552064E-5
New Minimum: -99.42588746158874 > -99.42592099318277
END: th(2.154434690031884)=-99.42592099318277; dx=-1.0804474789545333E-5 evalInputDelta=3.353159402763595E-5
Fitness changed from -99.42588746158874 to -99.42592099318277
Iteration 1 complete. Error: -99.42592099318277 Total: 14.4988; Orientation: 0.1117; Line Search: 5.8063
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6a3090ff to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-99.42592099318277;dx=-1.0759437232104275E-5
New Minimum: -99.42592099318277 > -99.42597687914767
WOLFE (weak): th(4.641588833612779)=-99.42597687914767; dx=-1.0745379628244889E-5 evalInputDelta=5.588596489758402E-5
New Minimum: -99.42597687914767 > -99.42602158789698
WOLFE (weak): th(9.283177667225559)=-99.42602158789698; dx=-1.0763340837500676E-5 evalInputDelta=1.0059471421186572E-4
New Minimum: -99.42602158789698 > -99.42623395418164
WOLFE (weak): th(27.849533001676676)=-99.42623395418164; dx=-1.0748960024516151E-5 evalInputDelta=3.129609988690163E-4
New Minimum: -99.42623395418164 > -99.42717841979527
WOLFE (weak): th(111.3981320067067)=-99.42717841979527; dx=-1.0710070192204738E-5 evalInputDelta=0.00125742661249717
New Minimum: -99.42717841979527 > -99.43222473196292
WOLFE (weak): th(556.9906600335335)=-99.43222473196292; dx=-1.0745393895708583E-5 evalInputDelta=0.006303738780147228
New Minimum: -99.43222473196292 > -99.46375977904935
WOLFE (weak): th(3341.9439602012008)=-99.46375977904935; dx=-1.0740470103645273E-5 evalInputDelta=0.03783878586658318
New Minimum: -99.46375977904935 > -99.69033482314524
WOLFE (weak): th(23393.607721408407)=-99.69033482314524; dx=-1.0703743634541412E-5 evalInputDelta=0.2644138299624643
New Minimum: -99.69033482314524 > -101.51092717303219
WOLFE (weak): th(187148.86177126726)=-101.51092717303219; dx=-1.0334180183551266E-5 evalInputDelta=2.0850061798494153
New Minimum: -101.51092717303219 > -115.43582639726999
END: th(1684339.7559414054)=-115.43582639726999; dx=-7.263135572523512E-6 evalInputDelta=16.00990540408722
Fitness changed from -99.42592099318277 to -115.43582639726999
Iteration 2 complete. Error: -115.43582639726999 Total: 32.8615; Orientation: 0.1101; Line Search: 29.3131
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 64fe19f2 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-115.43582639726999;dx=-7.387210580709835E-6
New Minimum: -115.43582639726999 > -135.06163236610254
END: th(3628800.0000000005)=-135.06163236610254; dx=-3.5057680869868535E-6 evalInputDelta=19.62580596883255
Fitness changed from -115.43582639726999 to -135.06163236610254
Iteration 3 complete. Error: -135.06163236610254 Total: 9.4224; Orientation: 0.0913; Line Search: 5.5855
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1c58b5d2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.087e+04, gradient 2.164e-03, dot -0.587; [8ffcddfe-c104-4b12-b737-4edb77769456 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -135.06163236610254, -115.43582639726999, -99.42592099318277, -99.42588746158874
LBFGS Accumulation History: 3 points
Removed measurement 1c58b5d2 to history. Total: 3
th(0)=-135.06163236610254;dx=-4.680537458207431E-6
New Minimum: -135.06163236610254 > -155.95443796343915
END: th(7818012.603187701)=-155.95443796343915; dx=-1.2301696534346264E-6 evalInputDelta=20.892805597336604
Fitness changed from -135.06163236610254 to -155.95443796343915
Iteration 4 complete. Error: -155.95443796343915 Total: 11.5825; Orientation: 1.9720; Line Search: 5.8853
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2d01b681 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.283e+04, gradient 2.217e-03, dot -0.360; [8ffcddfe-c104-4b12-b737-4edb77769456 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -155.95443796343915, -115.43582639726999, -99.42592099318277, -99.42588746158874
LBFGS Accumulation History: 3 points
Removed measurement 2d01b681 to history. Total: 3
th(0)=-155.95443796343915;dx=-4.892228545995002E-6
New Minimum: -155.95443796343915 > -163.05633709851293
WOLF (strong): th(1.6843397559414055E7)=-163.05633709851293; dx=9.128470471259094E-7 evalInputDelta=7.101899135073779
New Minimum: -163.05633709851293 > -170.09826826587872
WOLF (strong): th(8421698.779707028)=-170.09826826587872; dx=2.3655302060961137E-7 evalInputDelta=14.143830302439568
END: th(2807232.926569009)=-166.36328878511597; dx=-2.2585044370631907E-6 evalInputDelta=10.408850821676822
Fitness changed from -155.95443796343915 to -170.09826826587872
Iteration 5 complete. Error: -170.09826826587872 Total: 17.2503; Orientation: 2.0230; Line Search: 11.8510
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 502756b4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.528e+04, gradient 2.330e-03, dot -0.277; [8ffcddfe-c104-4b12-b737-4edb77769456 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -170.09826826587872, -115.43582639726999, -99.42592099318277, -99.42588746158874
LBFGS Accumulation History: 3 points
Removed measurement 502756b4 to history. Total: 3
th(0)=-170.09826826587872;dx=-5.401210050448845E-6
New Minimum: -170.09826826587872 > -186.25531944619453
END: th(6048000.000000001)=-186.25531944619453; dx=-8.139062447184597E-8 evalInputDelta=16.15705118031582
Fitness changed from -170.09826826587872 to -186.25531944619453
Iteration 6 complete. Error: -186.25531944619453 Total: 11.6062; Orientation: 1.8397; Line Search: 6.0229
Adding measurement 746c887c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.499e+04, gradient 1.846e-03, dot -0.417; [8ffcddfe-c104-4b12-b737-4edb77769456 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -186.25531944619453, -115.43582639726999, -99.42592099318277, -99.42588746158874
LBFGS Accumulation History: 3 points
Removed measurement 746c887c to history. Total: 3
th(0)=-186.25531944619453;dx=-3.406862777083765E-6
New Minimum: -186.25531944619453 > -193.05103595467418
WOLF (strong): th(1.3030021005312836E7)=-193.05103595467418; dx=8.819314341131159E-7 evalInputDelta=6.795716508479643
New Minimum: -193.05103595467418 > -196.95388293115636
END: th(6515010.502656418)=-196.95388293115636; dx=-1.5872520353983957E-7 evalInputDelta=10.698563484961824
Fitness changed from -186.25531944619453 to -196.95388293115636
Iteration 7 complete. Error: -196.95388293115636 Total: 14.0424; Orientation: 1.9631; Line Search: 9.2421
Adding measurement 3638e459 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.947e+04, gradient 1.778e-03, dot -0.423; [8ffcddfe-c104-4b12-b737-4edb77769456 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -196.95388293115636, -115.43582639726999, -99.42592099318277, -99.42588746158874
LBFGS Accumulation History: 3 points
Removed measurement 3638e459 to history. Total: 3
th(0)=-196.95388293115636;dx=-3.1581999584126784E-6
New Minimum: -196.95388293115636 > -200.1988819435737
WOLF (strong): th(1.4036164632845048E7)=-200.1988819435737; dx=1.0029811740895937E-6 evalInputDelta=3.2449990124173382
New Minimum: -200.1988819435737 > -206.0563971847891
WOLF (strong): th(7018082.316422524)=-206.0563971847891; dx=1.714956080174138E-7 evalInputDelta=9.102514253632734
END: th(2339360.7721408415)=-202.98480422055022; dx=-1.7944010479379363E-6 evalInputDelta=6.030921289393859
Fitness changed from -196.95388293115636 to -206.0563971847891
Iteration 8 complete. Error: -206.0563971847891 Total: 16.5185; Orientation: 2.0551; Line Search: 11.6861
Adding measurement 497b1f92 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.312e+04, gradient 1.807e-03, dot -0.388; [8ffcddfe-c104-4b12-b737-4edb77769456 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -206.0563971847891, -115.43582639726999, -99.42592099318277, -99.42588746158874
LBFGS Accumulation History: 3 points
Removed measurement 497b1f92 to history. Total: 3
th(0)=-206.0563971847891;dx=-3.258841055977391E-6
New Minimum: -206.0563971847891 > -215.15136358104613
END: th(5040000.000000002)=-215.15136358104613; dx=-3.3683662853688653E-7 evalInputDelta=9.094966396257036
Fitness changed from -206.0563971847891 to -215.15136358104613
Iteration 9 complete. Error: -215.15136358104613 Total: 10.6244; Orientation: 1.8449; Line Search: 5.9704
Adding measurement 74ed4178 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.918e+04, gradient 1.431e-03, dot -0.509; [8ffcddfe-c104-4b12-b737-4edb77769456 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -215.15136358104613, -115.43582639726999, -99.42592099318277, -99.42588746158874
LBFGS Accumulation History: 3 points
Removed measurement 74ed4178 to history. Total: 3
th(0)=-215.15136358104613;dx=-2.0401906337834193E-6
New Minimum: -215.15136358104613 > -222.20409467423994
WOLF (strong): th(1.0858350837760698E7)=-222.20409467423994; dx=1.8054909108466703E-7 evalInputDelta=7.052731093193813
END: th(5429175.418880349)=-221.8761193017033; dx=-5.248015627644642E-7 evalInputDelta=6.7247557206571855
Fitness changed from -215.15136358104613 to -222.20409467423994
Iteration 10 complete. Error: -222.20409467423994 Total: 13.4875; Orientation: 1.9132; Line Search: 8.8960
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -222.20409467423994 (> -Infinity) after 152.599s (< 5400.000s)
Returns
-222.20409467423994