BasicOptimizer.scala:89 executed in 110.01 seconds (1.447 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 44252680573400
Reset training subject: 44255140172600
Adding measurement 193062f1 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-45.56159531655367;dx=-1.6449362282286729E-6
New Minimum: -45.56159531655367 > -45.56159915539774
END: th(2.154434690031884)=-45.56159915539774; dx=-1.3088766217690389E-6 evalInputDelta=3.838844065739977E-6
Fitness changed from -45.56159531655367 to -45.56159915539774
Iteration 1 complete. Error: -45.56159915539774 Total: 11.5680; Orientation: 0.0621; Line Search: 4.6561
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 64693960 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-45.56159915539774;dx=-1.295852409283318E-6
New Minimum: -45.56159915539774 > -45.56160491366324
WOLFE (weak): th(4.641588833612779)=-45.56160491366324; dx=-1.2929457418685477E-6 evalInputDelta=5.758265501754067E-6
New Minimum: -45.56160491366324 > -45.561610671928
WOLFE (weak): th(9.283177667225559)=-45.561610671928; dx=-1.291482831952435E-6 evalInputDelta=1.151653026454369E-5
New Minimum: -45.561610671928 > -45.561637543820645
WOLFE (weak): th(27.849533001676676)=-45.561637543820645; dx=-1.2913685368795531E-6 evalInputDelta=3.838842290804223E-5
New Minimum: -45.561637543820645 > -45.56175462831074
WOLFE (weak): th(111.3981320067067)=-45.56175462831074; dx=-1.2897039479678636E-6 evalInputDelta=1.554729130006649E-4
New Minimum: -45.56175462831074 > -45.562378434046686
WOLFE (weak): th(556.9906600335335)=-45.562378434046686; dx=-1.2897745442950757E-6 evalInputDelta=7.79278648948889E-4
New Minimum: -45.562378434046686 > -45.56628422350604
WOLFE (weak): th(3341.9439602012008)=-45.56628422350604; dx=-1.2898618071417332E-6 evalInputDelta=0.004685068108301493
New Minimum: -45.56628422350604 > -45.59437493221254
WOLFE (weak): th(23393.607721408407)=-45.59437493221254; dx=-1.287286154255163E-6 evalInputDelta=0.032775776814801816
New Minimum: -45.59437493221254 > -45.82229968336838
WOLFE (weak): th(187148.86177126726)=-45.82229968336838; dx=-1.270568474072162E-6 evalInputDelta=0.26070052797064136
New Minimum: -45.82229968336838 > -47.772983468003524
END: th(1684339.7559414054)=-47.772983468003524; dx=-1.1314905893657928E-6 evalInputDelta=2.2113843126057873
Fitness changed from -45.56159915539774 to -47.772983468003524
Iteration 2 complete. Error: -47.772983468003524 Total: 25.4538; Orientation: 0.0626; Line Search: 22.8878
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4247f9c5 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-47.772983468003524;dx=-1.1395484320703797E-6
New Minimum: -47.772983468003524 > -51.55863864236089
END: th(3628800.0000000005)=-51.55863864236089; dx=-8.501735964333114E-7 evalInputDelta=3.785655174357366
Fitness changed from -47.772983468003524 to -51.55863864236089
Iteration 3 complete. Error: -51.55863864236089 Total: 7.2157; Orientation: 0.0606; Line Search: 4.5243
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 585c7a42 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.599e+04, gradient 9.047e-04, dot -0.882; [7e453f7c-a9fb-4388-9dbb-ff19b4b4fc5b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -51.55863864236089, -47.772983468003524, -45.56159915539774, -45.56159531655367
LBFGS Accumulation History: 3 points
Removed measurement 585c7a42 to history. Total: 3
th(0)=-51.55863864236089;dx=-8.165750778187278E-7
New Minimum: -51.55863864236089 > -57.288095626993496
END: th(7818012.603187701)=-57.288095626993496; dx=-5.643837669854883E-7 evalInputDelta=5.7294569846326056
Fitness changed from -51.55863864236089 to -57.288095626993496
Iteration 4 complete. Error: -57.288095626993496 Total: 8.3519; Orientation: 1.1067; Line Search: 4.6553
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 449e10c6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.536e+04, gradient 7.710e-04, dot -0.768; [7e453f7c-a9fb-4388-9dbb-ff19b4b4fc5b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -57.288095626993496, -47.772983468003524, -45.56159915539774, -45.56159531655367
LBFGS Accumulation History: 3 points
Removed measurement 449e10c6 to history. Total: 3
th(0)=-57.288095626993496;dx=-5.916865253677532E-7
New Minimum: -57.288095626993496 > -65.32102389728475
END: th(1.6843397559414055E7)=-65.32102389728475; dx=-3.329168423045242E-7 evalInputDelta=8.03292827029125
Fitness changed from -57.288095626993496 to -65.32102389728475
Iteration 5 complete. Error: -65.32102389728475 Total: 8.1596; Orientation: 1.0383; Line Search: 4.4879
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7881ab34 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.002e+04, gradient 6.973e-04, dot -0.612; [7e453f7c-a9fb-4388-9dbb-ff19b4b4fc5b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.32102389728475, -47.772983468003524, -45.56159915539774, -45.56159531655367
LBFGS Accumulation History: 3 points
Removed measurement 7881ab34 to history. Total: 3
th(0)=-65.32102389728475;dx=-4.843623439784383E-7
New Minimum: -65.32102389728475 > -74.01089131059285
END: th(3.628800000000001E7)=-74.01089131059285; dx=-9.824141664158051E-8 evalInputDelta=8.689867413308107
Fitness changed from -65.32102389728475 to -74.01089131059285
Iteration 6 complete. Error: -74.01089131059285 Total: 8.3365; Orientation: 1.0551; Line Search: 4.6345
Adding measurement 357c7fef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.040e+04, gradient 8.264e-04, dot -0.301; [7e453f7c-a9fb-4388-9dbb-ff19b4b4fc5b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.01089131059285, -47.772983468003524, -45.56159915539774, -45.56159531655367
LBFGS Accumulation History: 3 points
Removed measurement 357c7fef to history. Total: 3
th(0)=-74.01089131059285;dx=-6.824932631599836E-7
Armijo: th(7.818012603187701E7)=-70.03688041058028; dx=1.389747258340898E-7 evalInputDelta=-3.9740109000125727
New Minimum: -74.01089131059285 > -77.65550537687737
WOLF (strong): th(3.9090063015938506E7)=-77.65550537687737; dx=1.5891104869665355E-7 evalInputDelta=3.644614066284518
New Minimum: -77.65550537687737 > -79.86563382081673
END: th(1.3030021005312836E7)=-79.86563382081673; dx=-1.7576126033565078E-7 evalInputDelta=5.854742510223872
Fitness changed from -74.01089131059285 to -79.86563382081673
Iteration 7 complete. Error: -79.86563382081673 Total: 12.5037; Orientation: 1.1842; Line Search: 9.1305
Adding measurement 62dab393 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.314e+04, gradient 5.854e-04, dot -0.535; [7e453f7c-a9fb-4388-9dbb-ff19b4b4fc5b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -79.86563382081673, -47.772983468003524, -45.56159915539774, -45.56159531655367
LBFGS Accumulation History: 3 points
Removed measurement 62dab393 to history. Total: 3
th(0)=-79.86563382081673;dx=-3.417915167780598E-7
New Minimum: -79.86563382081673 > -85.0646669818633
END: th(2.8072329265690096E7)=-85.0646669818633; dx=-6.836132553094343E-8 evalInputDelta=5.199033161046572
Fitness changed from -79.86563382081673 to -85.0646669818633
Iteration 8 complete. Error: -85.0646669818633 Total: 7.6472; Orientation: 1.0285; Line Search: 4.4093
Adding measurement 5bbfc5f7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.692e+04, gradient 6.954e-04, dot -0.394; [7e453f7c-a9fb-4388-9dbb-ff19b4b4fc5b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.0646669818633, -47.772983468003524, -45.56159915539774, -45.56159531655367
LBFGS Accumulation History: 3 points
Removed measurement 5bbfc5f7 to history. Total: 3
th(0)=-85.0646669818633;dx=-4.829700072912303E-7
Armijo: th(6.048000000000002E7)=-82.94536257620057; dx=1.287854210600191E-7 evalInputDelta=-2.1193044056627315
New Minimum: -85.0646669818633 > -87.96677536459386
WOLF (strong): th(3.024000000000001E7)=-87.96677536459386; dx=1.0915710248081906E-7 evalInputDelta=2.9021083827305603
New Minimum: -87.96677536459386 > -88.57381478544396
END: th(1.0080000000000004E7)=-88.57381478544396; dx=-1.7895813616841797E-7 evalInputDelta=3.5091478035806603
Fitness changed from -85.0646669818633 to -88.57381478544396
Iteration 9 complete. Error: -88.57381478544396 Total: 12.4338; Orientation: 1.0457; Line Search: 9.1516
Adding measurement 3d8db751 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.597e+04, gradient 4.825e-04, dot -0.616; [7e453f7c-a9fb-4388-9dbb-ff19b4b4fc5b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -88.57381478544396, -47.772983468003524, -45.56159915539774, -45.56159531655367
LBFGS Accumulation History: 3 points
Removed measurement 3d8db751 to history. Total: 3
th(0)=-88.57381478544396;dx=-2.3134642451258378E-7
New Minimum: -88.57381478544396 > -92.35270803592995
END: th(2.1716701675521396E7)=-92.35270803592995; dx=-1.2663598289481515E-7 evalInputDelta=3.778893250485993
Fitness changed from -88.57381478544396 to -92.35270803592995
Iteration 10 complete. Error: -92.35270803592995 Total: 7.8459; Orientation: 0.9886; Line Search: 4.4317
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -92.35270803592995 (> -Infinity) after 110.008s (< 5400.000s)
Returns
-92.35270803592995