BasicOptimizer.scala:89 executed in 218.64 seconds (3.736 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 696850338558900
Reset training subject: 696854990475500
Adding measurement 5baa19b7 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-979.7824375849978;dx=-0.00645501857222873
New Minimum: -979.7824375849978 > -979.7958971132713
END: th(2.154434690031884)=-979.7958971132713; dx=-0.005688931746622819 evalInputDelta=0.013459528273529031
Fitness changed from -979.7824375849978 to -979.7958971132713
Iteration 1 complete. Error: -979.7958971132713 Total: 23.1913; Orientation: 0.0980; Line Search: 9.4072
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 63550f9a to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-979.7958971132713;dx=-0.005675414319174392
New Minimum: -979.7958971132713 > -979.8246335441868
WOLFE (weak): th(4.641588833612779)=-979.8246335441868; dx=-0.005682440259460717 evalInputDelta=0.028736430915500932
New Minimum: -979.8246335441868 > -979.8533691323412
WOLFE (weak): th(9.283177667225559)=-979.8533691323412; dx=-0.005680722878071533 evalInputDelta=0.0574720190699054
New Minimum: -979.8533691323412 > -979.9683668363995
WOLFE (weak): th(27.849533001676676)=-979.9683668363995; dx=-0.005676275715315799 evalInputDelta=0.17246972312818798
New Minimum: -979.9683668363995 > -980.4854664909623
WOLFE (weak): th(111.3981320067067)=-980.4854664909623; dx=-0.0056712094647105955 evalInputDelta=0.6895693776909866
New Minimum: -980.4854664909623 > -983.2390350265799
WOLFE (weak): th(556.9906600335335)=-983.2390350265799; dx=-0.005658193562303331 evalInputDelta=3.4431379133086466
New Minimum: -983.2390350265799 > -1000.2559672403859
WOLFE (weak): th(3341.9439602012008)=-1000.2559672403859; dx=-0.005547151675866183 evalInputDelta=20.46007012711459
New Minimum: -1000.2559672403859 > -1110.6184650905097
END: th(23393.607721408407)=-1110.6184650905097; dx=-0.004482583084778543 evalInputDelta=130.82256797723846
Fitness changed from -979.7958971132713 to -1110.6184650905097
Iteration 2 complete. Error: -1110.6184650905097 Total: 41.6865; Orientation: 0.0975; Line Search: 36.0166
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3e03d885 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1110.6184650905097;dx=-0.004437883537950379
New Minimum: -1110.6184650905097 > -1303.5095895312777
END: th(50400.00000000001)=-1303.5095895312777; dx=-0.0027340027334552116 evalInputDelta=192.89112444076795
Fitness changed from -1110.6184650905097 to -1303.5095895312777
Iteration 3 complete. Error: -1303.5095895312777 Total: 14.9071; Orientation: 0.0970; Line Search: 9.3212
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 18128f50 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.438e+03, gradient 5.390e-02, dot -0.736; [b243a17f-015c-4778-8ac0-31df4454b08c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1303.5095895312777, -1110.6184650905097, -979.7958971132713, -979.7824375849978
LBFGS Accumulation History: 3 points
Removed measurement 18128f50 to history. Total: 3
th(0)=-1303.5095895312777;dx=-0.0029004991709334522
New Minimum: -1303.5095895312777 > -1548.092697482938
END: th(108583.50837760697)=-1548.092697482938; dx=-0.0014340750839999842 evalInputDelta=244.5831079516604
Fitness changed from -1303.5095895312777 to -1548.092697482938
Iteration 4 complete. Error: -1548.092697482938 Total: 16.0982; Orientation: 1.7215; Line Search: 9.1076
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3dfe1f63 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.304e+03, gradient 5.032e-02, dot -0.528; [b243a17f-015c-4778-8ac0-31df4454b08c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1548.092697482938, -1110.6184650905097, -979.7958971132713, -979.7824375849978
LBFGS Accumulation History: 3 points
Removed measurement 3dfe1f63 to history. Total: 3
th(0)=-1548.092697482938;dx=-0.002525362366258583
New Minimum: -1548.092697482938 > -1789.483584724934
END: th(233936.07721408413)=-1789.483584724934; dx=-3.725802191440343E-4 evalInputDelta=241.39088724199587
Fitness changed from -1548.092697482938 to -1789.483584724934
Iteration 5 complete. Error: -1789.483584724934 Total: 17.1952; Orientation: 2.0622; Line Search: 9.2742
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 42e75f65 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.456e+03, gradient 5.760e-02, dot -0.250; [b243a17f-015c-4778-8ac0-31df4454b08c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1789.483584724934, -1110.6184650905097, -979.7958971132713, -979.7824375849978
LBFGS Accumulation History: 3 points
Removed measurement 42e75f65 to history. Total: 3
th(0)=-1789.483584724934;dx=-0.003317047078991244
New Minimum: -1789.483584724934 > -1792.8827345925333
WOLF (strong): th(504000.0000000002)=-1792.8827345925333; dx=4.817454738564646E-4 evalInputDelta=3.3991498675993626
New Minimum: -1792.8827345925333 > -1942.936180115034
WOLF (strong): th(252000.0000000001)=-1942.936180115034; dx=4.1177657670386824E-4 evalInputDelta=153.4525953901
New Minimum: -1942.936180115034 > -1961.2295250683944
END: th(84000.00000000003)=-1961.2295250683944; dx=-7.296394056639793E-4 evalInputDelta=171.74594034346046
Fitness changed from -1789.483584724934 to -1961.2295250683944
Iteration 6 complete. Error: -1961.2295250683944 Total: 26.0243; Orientation: 1.6741; Line Search: 18.7990
Adding measurement f5f72c7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.349e+04, gradient 4.596e-02, dot -0.396; [b243a17f-015c-4778-8ac0-31df4454b08c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1961.2295250683944, -1110.6184650905097, -979.7958971132713, -979.7824375849978
LBFGS Accumulation History: 3 points
Removed measurement f5f72c7 to history. Total: 3
th(0)=-1961.2295250683944;dx=-0.002106355046602067
New Minimum: -1961.2295250683944 > -2119.5881675457617
END: th(180972.5139626783)=-2119.5881675457617; dx=-1.610057399843108E-4 evalInputDelta=158.3586424773673
Fitness changed from -1961.2295250683944 to -2119.5881675457617
Iteration 7 complete. Error: -2119.5881675457617 Total: 14.9782; Orientation: 1.5768; Line Search: 9.1327
Adding measurement 3d12e867 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.716e+04, gradient 5.670e-02, dot -0.305; [b243a17f-015c-4778-8ac0-31df4454b08c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2119.5881675457617, -1110.6184650905097, -979.7958971132713, -979.7824375849978
LBFGS Accumulation History: 3 points
Removed measurement 3d12e867 to history. Total: 3
th(0)=-2119.5881675457617;dx=-0.0032104051328686986
Armijo: th(389893.4620234736)=-2063.1062745287745; dx=6.128059742308318E-4 evalInputDelta=-56.481893016987215
New Minimum: -2119.5881675457617 > -2213.290762642812
WOLF (strong): th(194946.7310117368)=-2213.290762642812; dx=5.922613493763236E-4 evalInputDelta=93.70259509705011
New Minimum: -2213.290762642812 > -2251.0021101722673
END: th(64982.24367057893)=-2251.0021101722673; dx=-7.183653240771478E-4 evalInputDelta=131.41394262650556
Fitness changed from -2119.5881675457617 to -2251.0021101722673
Iteration 8 complete. Error: -2251.0021101722673 Total: 24.4118; Orientation: 1.6265; Line Search: 18.5254
Adding measurement 458f1384 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.318e+04, gradient 3.995e-02, dot -0.492; [b243a17f-015c-4778-8ac0-31df4454b08c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2251.0021101722673, -1110.6184650905097, -979.7958971132713, -979.7824375849978
LBFGS Accumulation History: 3 points
Removed measurement 458f1384 to history. Total: 3
th(0)=-2251.0021101722673;dx=-0.0015947374220042125
New Minimum: -2251.0021101722673 > -2375.3075590331455
END: th(140000.00000000006)=-2375.3075590331455; dx=-4.1993059058811335E-4 evalInputDelta=124.30544886087819
Fitness changed from -2251.0021101722673 to -2375.3075590331455
Iteration 9 complete. Error: -2375.3075590331455 Total: 14.9414; Orientation: 1.5681; Line Search: 8.9437
Adding measurement 27edf8f0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.714e+04, gradient 4.709e-02, dot -0.405; [b243a17f-015c-4778-8ac0-31df4454b08c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2375.3075590331455, -1110.6184650905097, -979.7958971132713, -979.7824375849978
LBFGS Accumulation History: 3 points
Removed measurement 27edf8f0 to history. Total: 3
th(0)=-2375.3075590331455;dx=-0.0022157441609669537
New Minimum: -2375.3075590331455 > -2395.454654131445
WOLF (strong): th(301620.8566044639)=-2395.454654131445; dx=3.8606924753283056E-4 evalInputDelta=20.14709509829936
New Minimum: -2395.454654131445 > -2458.513677000801
WOLF (strong): th(150810.42830223194)=-2458.513677000801; dx=1.8337301052437021E-4 evalInputDelta=83.2061179676557
END: th(50270.142767410645)=-2451.0414113188704; dx=-7.185109602083867E-4 evalInputDelta=75.73385228572488
Fitness changed from -2375.3075590331455 to -2458.513677000801
Iteration 10 complete. Error: -2458.513677000801 Total: 24.2606; Orientation: 1.6515; Line Search: 18.3457
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2458.513677000801 (> -Infinity) after 218.639s (< 5400.000s)
Returns
-2458.513677000801