BasicOptimizer.scala:89 executed in 86.75 seconds (1.106 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 308699267119600
Reset training subject: 308701012416900
Adding measurement 424f262b to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-137.93346854940427;dx=-2.4826755819349116E-5
New Minimum: -137.93346854940427 > -137.93349839218857
END: th(2.154434690031884)=-137.93349839218857; dx=-1.6539106381005898E-5 evalInputDelta=2.984278430062659E-5
Fitness changed from -137.93346854940427 to -137.93349839218857
Iteration 1 complete. Error: -137.93349839218857 Total: 8.3392; Orientation: 0.0615; Line Search: 3.2101
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement a0bfcf2 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-137.93349839218857;dx=-1.643098244586717E-5
New Minimum: -137.93349839218857 > -137.93358792050284
WOLFE (weak): th(4.641588833612779)=-137.93358792050284; dx=-1.64224605604174E-5 evalInputDelta=8.952831427677665E-5
New Minimum: -137.93358792050284 > -137.93366998807318
WOLFE (weak): th(9.283177667225559)=-137.93366998807318; dx=-1.6406656374919503E-5 evalInputDelta=1.7159588460913255E-4
New Minimum: -137.93366998807318 > -137.934013179202
WOLFE (weak): th(27.849533001676676)=-137.934013179202; dx=-1.6407163925372544E-5 evalInputDelta=5.147870134294408E-4
New Minimum: -137.934013179202 > -137.93552768637596
WOLFE (weak): th(111.3981320067067)=-137.93552768637596; dx=-1.6377196559267536E-5 evalInputDelta=0.0020292941873947257
New Minimum: -137.93552768637596 > -137.94363710444853
WOLFE (weak): th(556.9906600335335)=-137.94363710444853; dx=-1.639179184887958E-5 evalInputDelta=0.010138712259958993
New Minimum: -137.94363710444853 > -137.99426729022497
WOLFE (weak): th(3341.9439602012008)=-137.99426729022497; dx=-1.6375152477472602E-5 evalInputDelta=0.06076889803640029
New Minimum: -137.99426729022497 > -138.35812679552086
WOLFE (weak): th(23393.607721408407)=-138.35812679552086; dx=-1.631425175811351E-5 evalInputDelta=0.42462840333229224
New Minimum: -138.35812679552086 > -141.27424402762898
WOLFE (weak): th(187148.86177126726)=-141.27424402762898; dx=-1.5764668715805325E-5 evalInputDelta=3.3407456354404133
New Minimum: -141.27424402762898 > -162.45687876309998
END: th(1684339.7559414054)=-162.45687876309998; dx=-9.468540949111861E-6 evalInputDelta=24.52338037091141
Fitness changed from -137.93349839218857 to -162.45687876309998
Iteration 2 complete. Error: -162.45687876309998 Total: 18.5622; Orientation: 0.0638; Line Search: 16.5976
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4b143473 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-162.45687876309998;dx=-1.1329389577096419E-5
New Minimum: -162.45687876309998 > -190.30196288326133
END: th(3628800.0000000005)=-190.30196288326133; dx=-3.836000711982541E-6 evalInputDelta=27.845084120161346
Fitness changed from -162.45687876309998 to -190.30196288326133
Iteration 3 complete. Error: -190.30196288326133 Total: 5.2125; Orientation: 0.0566; Line Search: 3.2039
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 62f3bf9b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.166e+04, gradient 3.031e-03, dot -0.398; [89518e52-9df8-4d02-a287-2eac14986b1d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -190.30196288326133, -162.45687876309998, -137.93349839218857, -137.93346854940427
LBFGS Accumulation History: 3 points
Removed measurement 62f3bf9b to history. Total: 3
th(0)=-190.30196288326133;dx=-9.180366601229825E-6
New Minimum: -190.30196288326133 > -210.02321792370364
WOLF (strong): th(7818012.603187701)=-210.02321792370364; dx=4.6746080877703875E-7 evalInputDelta=19.721255040442315
END: th(3909006.3015938504)=-209.2170289768401; dx=-1.4733247896246713E-6 evalInputDelta=18.915066093578787
Fitness changed from -190.30196288326133 to -210.02321792370364
Iteration 4 complete. Error: -210.02321792370364 Total: 7.9120; Orientation: 1.0722; Line Search: 5.0322
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5cbc132 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.758e+03, gradient 3.835e-03, dot -0.143; [89518e52-9df8-4d02-a287-2eac14986b1d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -210.02321792370364, -162.45687876309998, -137.93349839218857, -137.93346854940427
LBFGS Accumulation History: 3 points
Removed measurement 5cbc132 to history. Total: 3
th(0)=-210.02321792370364;dx=-1.4696160666652401E-5
New Minimum: -210.02321792370364 > -215.90765869386226
WOLF (strong): th(8421698.779707028)=-215.90765869386226; dx=5.14848660230202E-6 evalInputDelta=5.884440770158619
New Minimum: -215.90765869386226 > -237.38967707578675
WOLF (strong): th(4210849.389853514)=-237.38967707578675; dx=1.6510539519517219E-6 evalInputDelta=27.36645915208311
END: th(1403616.4632845046)=-228.46151536333818; dx=-8.822567063778747E-6 evalInputDelta=18.43829743963454
Fitness changed from -210.02321792370364 to -237.38967707578675
Iteration 5 complete. Error: -237.38967707578675 Total: 9.4208; Orientation: 1.0506; Line Search: 6.5684
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 21564363 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.710e+04, gradient 3.164e-03, dot -0.230; [89518e52-9df8-4d02-a287-2eac14986b1d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -237.38967707578675, -162.45687876309998, -137.93349839218857, -137.93346854940427
LBFGS Accumulation History: 3 points
Removed measurement 21564363 to history. Total: 3
th(0)=-237.38967707578675;dx=-9.992275300341826E-6
New Minimum: -237.38967707578675 > -255.18579707897734
END: th(3024000.0000000005)=-255.18579707897734; dx=-9.859165182202402E-7 evalInputDelta=17.796120003190595
Fitness changed from -237.38967707578675 to -255.18579707897734
Iteration 6 complete. Error: -255.18579707897734 Total: 6.2948; Orientation: 1.0523; Line Search: 3.4242
Adding measurement 47a5aa8c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.098e+04, gradient 2.366e-03, dot -0.416; [89518e52-9df8-4d02-a287-2eac14986b1d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -255.18579707897734, -162.45687876309998, -137.93349839218857, -137.93346854940427
LBFGS Accumulation History: 3 points
Removed measurement 47a5aa8c to history. Total: 3
th(0)=-255.18579707897734;dx=-5.580487559755506E-6
New Minimum: -255.18579707897734 > -266.1141402470163
WOLF (strong): th(6515010.502656418)=-266.1141402470163; dx=9.834709047187198E-7 evalInputDelta=10.928343168038936
New Minimum: -266.1141402470163 > -266.7679224178887
END: th(3257505.251328209)=-266.7679224178887; dx=-1.3007300226285636E-6 evalInputDelta=11.582125338911368
Fitness changed from -255.18579707897734 to -266.7679224178887
Iteration 7 complete. Error: -266.7679224178887 Total: 7.4729; Orientation: 1.0389; Line Search: 4.8911
Adding measurement aed6e6a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.428e+04, gradient 2.223e-03, dot -0.430; [89518e52-9df8-4d02-a287-2eac14986b1d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -266.7679224178887, -162.45687876309998, -137.93349839218857, -137.93346854940427
LBFGS Accumulation History: 3 points
Removed measurement aed6e6a to history. Total: 3
th(0)=-266.7679224178887;dx=-4.9426398647575275E-6
New Minimum: -266.7679224178887 > -274.5007084802337
WOLF (strong): th(7018082.316422524)=-274.5007084802337; dx=1.0226394351804353E-6 evalInputDelta=7.732786062344985
New Minimum: -274.5007084802337 > -276.4568503657953
END: th(3509041.158211262)=-276.4568503657953; dx=-6.807592804543538E-7 evalInputDelta=9.688927947906564
Fitness changed from -266.7679224178887 to -276.4568503657953
Iteration 8 complete. Error: -276.4568503657953 Total: 7.6488; Orientation: 1.0166; Line Search: 4.8302
Adding measurement 19c1f7c7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.647e+04, gradient 2.264e-03, dot -0.401; [89518e52-9df8-4d02-a287-2eac14986b1d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -276.4568503657953, -162.45687876309998, -137.93349839218857, -137.93346854940427
LBFGS Accumulation History: 3 points
Removed measurement 19c1f7c7 to history. Total: 3
th(0)=-276.4568503657953;dx=-5.125594892471034E-6
New Minimum: -276.4568503657953 > -279.17014045736937
WOLF (strong): th(7560000.000000003)=-279.17014045736937; dx=1.8274953567381259E-6 evalInputDelta=2.7132900915740947
New Minimum: -279.17014045736937 > -285.0314935345932
WOLF (strong): th(3780000.0000000014)=-285.0314935345932; dx=2.079599663286004E-7 evalInputDelta=8.574643168797934
END: th(1260000.0000000005)=-282.00204729087227; dx=-3.052204689039004E-6 evalInputDelta=5.5451969250769935
Fitness changed from -276.4568503657953 to -285.0314935345932
Iteration 9 complete. Error: -285.0314935345932 Total: 9.3634; Orientation: 1.1905; Line Search: 6.6028
Adding measurement 443b9345 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.509e+04, gradient 2.354e-03, dot -0.346; [89518e52-9df8-4d02-a287-2eac14986b1d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -285.0314935345932, -162.45687876309998, -137.93349839218857, -137.93346854940427
LBFGS Accumulation History: 3 points
Removed measurement 443b9345 to history. Total: 3
th(0)=-285.0314935345932;dx=-5.538303174513486E-6
New Minimum: -285.0314935345932 > -293.6736246367225
END: th(2714587.7094401745)=-293.6736246367225; dx=-5.225897616909746E-7 evalInputDelta=8.64213110212927
Fitness changed from -285.0314935345932 to -293.6736246367225
Iteration 10 complete. Error: -293.6736246367225 Total: 6.2394; Orientation: 1.2199; Line Search: 3.3510
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -293.6736246367225 (> -Infinity) after 86.747s (< 5400.000s)
Returns
-293.6736246367225