BasicOptimizer.scala:89 executed in 133.79 seconds (1.669 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 334812839505000
Reset training subject: 334815577374600
Adding measurement 17cc1a61 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-126.00080773228544;dx=-3.072431026041934E-5
New Minimum: -126.00080773228544 > -126.0008574875106
END: th(2.154434690031884)=-126.0008574875106; dx=-2.2708339240459485E-5 evalInputDelta=4.975522516303954E-5
Fitness changed from -126.00080773228544 to -126.0008574875106
Iteration 1 complete. Error: -126.0008574875106 Total: 12.9690; Orientation: 0.0601; Line Search: 5.1695
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7888d880 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-126.0008574875106;dx=-2.258883131416579E-5
New Minimum: -126.0008574875106 > -126.00097613450671
WOLFE (weak): th(4.641588833612779)=-126.00097613450671; dx=-2.2587201259837276E-5 evalInputDelta=1.1864699611408014E-4
New Minimum: -126.00097613450671 > -126.00109478139109
WOLFE (weak): th(9.283177667225559)=-126.00109478139109; dx=-2.258058030585244E-5 evalInputDelta=2.3729388048820965E-4
New Minimum: -126.00109478139109 > -126.00157319511399
WOLFE (weak): th(27.849533001676676)=-126.00157319511399; dx=-2.256660402539058E-5 evalInputDelta=7.157076033905696E-4
New Minimum: -126.00157319511399 > -126.00369733010676
WOLFE (weak): th(111.3981320067067)=-126.00369733010676; dx=-2.2554636791370697E-5 evalInputDelta=0.0028398425961597695
New Minimum: -126.00369733010676 > -126.01503309915167
WOLFE (weak): th(556.9906600335335)=-126.01503309915167; dx=-2.2546023921701165E-5 evalInputDelta=0.014175611641064734
New Minimum: -126.01503309915167 > -126.0859025502497
WOLFE (weak): th(3341.9439602012008)=-126.0859025502497; dx=-2.2531501098518357E-5 evalInputDelta=0.0850450627390984
New Minimum: -126.0859025502497 > -126.59400557218918
WOLFE (weak): th(23393.607721408407)=-126.59400557218918; dx=-2.235789380230942E-5 evalInputDelta=0.5931480846785746
New Minimum: -126.59400557218918 > -130.57206352305775
WOLFE (weak): th(187148.86177126726)=-130.57206352305775; dx=-2.0651710147240576E-5 evalInputDelta=4.571206035547149
New Minimum: -130.57206352305775 > -151.30273424336121
END: th(1684339.7559414054)=-151.30273424336121; dx=-5.573582433175664E-6 evalInputDelta=25.301876755850614
Fitness changed from -126.0008574875106 to -151.30273424336121
Iteration 2 complete. Error: -151.30273424336121 Total: 29.0410; Orientation: 0.0594; Line Search: 26.0332
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2ac9fc0d to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-151.30273424336121;dx=-1.0112967625667194E-5
New Minimum: -151.30273424336121 > -168.67138375277233
END: th(3628800.0000000005)=-168.67138375277233; dx=-6.930038751096147E-7 evalInputDelta=17.368649509411114
Fitness changed from -151.30273424336121 to -168.67138375277233
Iteration 3 complete. Error: -168.67138375277233 Total: 8.3100; Orientation: 0.0577; Line Search: 5.0888
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 50ec958a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.331e+03, gradient 3.220e-03, dot -0.309; [5b6f042d-1070-4917-b0fa-70799025d5bb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -168.67138375277233, -151.30273424336121, -126.0008574875106, -126.00080773228544
LBFGS Accumulation History: 3 points
Removed measurement 50ec958a to history. Total: 3
th(0)=-168.67138375277233;dx=-1.034154111734871E-5
Armijo: th(7818012.603187701)=-164.59854971558667; dx=3.403477037120631E-6 evalInputDelta=-4.0728340371856575
New Minimum: -168.67138375277233 > -178.88028902441036
WOLF (strong): th(3909006.3015938504)=-178.88028902441036; dx=2.036173679871321E-6 evalInputDelta=10.20890527163803
END: th(1303002.1005312835)=-178.65773755603584; dx=-3.7599420362750297E-6 evalInputDelta=9.986353803263512
Fitness changed from -168.67138375277233 to -178.88028902441036
Iteration 4 complete. Error: -178.88028902441036 Total: 14.3651; Orientation: 1.1646; Line Search: 10.0970
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 48a890b1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.271e+03, gradient 3.310e-03, dot -0.195; [5b6f042d-1070-4917-b0fa-70799025d5bb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -178.88028902441036, -151.30273424336121, -126.0008574875106, -126.00080773228544
LBFGS Accumulation History: 3 points
Removed measurement 48a890b1 to history. Total: 3
th(0)=-178.88028902441036;dx=-1.0939931082512195E-5
New Minimum: -178.88028902441036 > -193.51594931394595
WOLF (strong): th(2807232.926569009)=-193.51594931394595; dx=7.571197005387017E-7 evalInputDelta=14.635660289535593
END: th(1403616.4632845046)=-191.0422770552547; dx=-4.494654471824472E-6 evalInputDelta=12.161988030844327
Fitness changed from -178.88028902441036 to -193.51594931394595
Iteration 5 complete. Error: -193.51594931394595 Total: 11.6874; Orientation: 1.0225; Line Search: 7.5889
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2d9ae913 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.146e+04, gradient 2.547e-03, dot -0.342; [5b6f042d-1070-4917-b0fa-70799025d5bb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -193.51594931394595, -151.30273424336121, -126.0008574875106, -126.00080773228544
LBFGS Accumulation History: 3 points
Removed measurement 2d9ae913 to history. Total: 3
th(0)=-193.51594931394595;dx=-6.457171791171852E-6
New Minimum: -193.51594931394595 > -202.33072978982145
WOLF (strong): th(3024000.0000000005)=-202.33072978982145; dx=4.5371368295806697E-7 evalInputDelta=8.814780475875494
END: th(1512000.0000000002)=-200.965264926713; dx=-2.561958515093376E-6 evalInputDelta=7.4493156127670375
Fitness changed from -193.51594931394595 to -202.33072978982145
Iteration 6 complete. Error: -202.33072978982145 Total: 11.8629; Orientation: 1.1213; Line Search: 7.9178
Adding measurement 31174837 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.734e+04, gradient 2.434e-03, dot -0.401; [5b6f042d-1070-4917-b0fa-70799025d5bb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.33072978982145, -151.30273424336121, -126.0008574875106, -126.00080773228544
LBFGS Accumulation History: 3 points
Removed measurement 31174837 to history. Total: 3
th(0)=-202.33072978982145;dx=-5.905048068973013E-6
New Minimum: -202.33072978982145 > -209.00184288550042
WOLF (strong): th(3257505.251328209)=-209.00184288550042; dx=1.3186232739138245E-6 evalInputDelta=6.671113095678976
New Minimum: -209.00184288550042 > -209.1307947332567
END: th(1628752.6256641045)=-209.1307947332567; dx=-1.761693511437569E-6 evalInputDelta=6.800064943435245
Fitness changed from -202.33072978982145 to -209.1307947332567
Iteration 7 complete. Error: -209.1307947332567 Total: 11.4310; Orientation: 1.0151; Line Search: 7.7536
Adding measurement 302ca5ca to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.242e+04, gradient 1.673e-03, dot -0.641; [5b6f042d-1070-4917-b0fa-70799025d5bb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -209.1307947332567, -151.30273424336121, -126.0008574875106, -126.00080773228544
LBFGS Accumulation History: 3 points
Removed measurement 302ca5ca to history. Total: 3
th(0)=-209.1307947332567;dx=-2.7932448235970946E-6
New Minimum: -209.1307947332567 > -216.17734521168865
END: th(3509041.158211262)=-216.17734521168865; dx=-1.182325639579318E-6 evalInputDelta=7.0465504784319535
Fitness changed from -209.1307947332567 to -216.17734521168865
Iteration 8 complete. Error: -216.17734521168865 Total: 8.7960; Orientation: 1.0301; Line Search: 5.3990
Adding measurement 16b6b5f0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.328e+04, gradient 1.878e-03, dot -0.512; [5b6f042d-1070-4917-b0fa-70799025d5bb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -216.17734521168865, -151.30273424336121, -126.0008574875106, -126.00080773228544
LBFGS Accumulation History: 3 points
Removed measurement 16b6b5f0 to history. Total: 3
th(0)=-216.17734521168865;dx=-3.524716185363496E-6
New Minimum: -216.17734521168865 > -216.52562996090967
WOLF (strong): th(7560000.000000003)=-216.52562996090967; dx=1.2511201275564096E-6 evalInputDelta=0.3482847492210226
New Minimum: -216.52562996090967 > -220.83411841111263
WOLF (strong): th(3780000.0000000014)=-220.83411841111263; dx=2.61037576757541E-7 evalInputDelta=4.656773199423981
END: th(1260000.0000000005)=-219.68645905674848; dx=-1.7179142811389504E-6 evalInputDelta=3.5091138450598294
Fitness changed from -216.17734521168865 to -220.83411841111263
Iteration 9 complete. Error: -220.83411841111263 Total: 13.4835; Orientation: 1.0319; Line Search: 10.0388
Adding measurement 4630f4da to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.170e+04, gradient 2.285e-03, dot -0.358; [5b6f042d-1070-4917-b0fa-70799025d5bb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -220.83411841111263, -151.30273424336121, -126.0008574875106, -126.00080773228544
LBFGS Accumulation History: 3 points
Removed measurement 4630f4da to history. Total: 3
th(0)=-220.83411841111263;dx=-5.214998551570475E-6
New Minimum: -220.83411841111263 > -226.9135001205921
WOLF (strong): th(2714587.7094401745)=-226.9135001205921; dx=7.492538013389618E-7 evalInputDelta=6.079381709479463
END: th(1357293.8547200873)=-226.27488430786738; dx=-2.0438326240384676E-6 evalInputDelta=5.440765896754755
Fitness changed from -220.83411841111263 to -226.9135001205921
Iteration 10 complete. Error: -226.9135001205921 Total: 11.3584; Orientation: 0.9579; Line Search: 7.6210
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -226.9135001205921 (> -Infinity) after 133.791s (< 5400.000s)
Returns
-226.9135001205921