BasicOptimizer.scala:89 executed in 1913.92 seconds (257.481 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 676281818529000
Reset training subject: 676314768907300
Adding measurement b7eb48f to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-177.30301569629322;dx=-0.0018440745228666855
New Minimum: -177.30301569629322 > -177.30943225227753
WOLFE (weak): th(2.154434690031884)=-177.30943225227753; dx=-0.0018446148634259838 evalInputDelta=0.006416555984316119
New Minimum: -177.30943225227753 > -177.3158540835393
WOLFE (weak): th(4.308869380063768)=-177.3158540835393; dx=-0.0018443905615073007 evalInputDelta=0.012838387246091543
New Minimum: -177.3158540835393 > -177.34152806978122
WOLFE (weak): th(12.926608140191302)=-177.34152806978122; dx=-0.0018448248773769611 evalInputDelta=0.03851237348800396
New Minimum: -177.34152806978122 > -177.45711409732212
WOLFE (weak): th(51.70643256076521)=-177.45711409732212; dx=-0.0018465787133203665 evalInputDelta=0.1540984010289037
New Minimum: -177.45711409732212 > -178.07368230068417
WOLFE (weak): th(258.53216280382605)=-178.07368230068417; dx=-0.0018465174432140351 evalInputDelta=0.7706666043909536
New Minimum: -178.07368230068417 > -181.93759661625742
WOLFE (weak): th(1551.1929768229563)=-181.93759661625742; dx=-0.0018541048741957764 evalInputDelta=4.634580919964208
New Minimum: -181.93759661625742 > -209.9504684889986
WOLFE (weak): th(10858.350837760694)=-209.9504684889986; dx=-0.0018660838601795423 evalInputDelta=32.647452792705394
New Minimum: -209.9504684889986 > -380.0194073991485
END: th(86866.80670208555)=-380.0194073991485; dx=-8.716320569181532E-4 evalInputDelta=202.7163917028553
Fitness changed from -177.30301569629322 to -380.0194073991485
Iteration 1 complete. Error: -380.0194073991485 Total: 351.0280; Orientation: 0.0985; Line Search: 257.5326
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 61ac25e9 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-380.0194073991485;dx=-0.0018877034758651514
New Minimum: -380.0194073991485 > -672.3994813353146
END: th(187148.86177126726)=-672.3994813353146; dx=-4.089116195528619E-4 evalInputDelta=292.38007393616607
Fitness changed from -380.0194073991485 to -672.3994813353146
Iteration 2 complete. Error: -672.3994813353146 Total: 85.8210; Orientation: 0.1020; Line Search: 55.2308
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7f8c3326 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-672.3994813353146;dx=-0.002179120193686654
New Minimum: -672.3994813353146 > -949.3399351654812
WOLF (strong): th(403200.00000000006)=-949.3399351654812; dx=6.77317141347776E-6 evalInputDelta=276.9404538301666
END: th(201600.00000000003)=-927.1612588972858; dx=-1.9396896247331918E-4 evalInputDelta=254.76177756197126
Fitness changed from -672.3994813353146 to -949.3399351654812
Iteration 3 complete. Error: -949.3399351654812 Total: 112.6951; Orientation: 0.0960; Line Search: 84.7743
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6dfffacc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.927e+04, gradient 5.101e-02, dot -0.287; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -949.3399351654812, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 6dfffacc to history. Total: 3
th(0)=-949.3399351654812;dx=-0.002599959302970299
New Minimum: -949.3399351654812 > -1266.3020473015117
WOLF (strong): th(434334.03351042786)=-1266.3020473015117; dx=2.38916221971372E-4 evalInputDelta=316.96211213603056
New Minimum: -1266.3020473015117 > -1306.416376964098
END: th(217167.01675521393)=-1306.416376964098; dx=-1.6058337208863012E-4 evalInputDelta=357.07644179861677
Fitness changed from -949.3399351654812 to -1306.416376964098
Iteration 4 complete. Error: -1306.416376964098 Total: 112.0773; Orientation: 1.8408; Line Search: 82.1305
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 480b5448 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.510e+04, gradient 4.397e-02, dot -0.262; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1306.416376964098, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 480b5448 to history. Total: 3
th(0)=-1306.416376964098;dx=-0.0019303020683435353
New Minimum: -1306.416376964098 > -1455.9986263729784
WOLF (strong): th(467872.15442816826)=-1455.9986263729784; dx=4.2302368959911183E-4 evalInputDelta=149.58224940888044
New Minimum: -1455.9986263729784 > -1582.1534375653962
WOLF (strong): th(233936.07721408413)=-1582.1534375653962; dx=9.979139804802234E-5 evalInputDelta=275.73706060129825
END: th(77978.69240469471)=-1484.3183620773543; dx=-0.001069124203869089 evalInputDelta=177.9019851132564
Fitness changed from -1306.416376964098 to -1582.1534375653962
Iteration 5 complete. Error: -1582.1534375653962 Total: 140.4880; Orientation: 1.8991; Line Search: 108.3497
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4ded2308 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.873e+04, gradient 4.865e-02, dot -0.291; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1582.1534375653962, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 4ded2308 to history. Total: 3
th(0)=-1582.1534375653962;dx=-0.0023622295636027356
New Minimum: -1582.1534375653962 > -1816.0653209617765
WOLF (strong): th(168000.00000000006)=-1816.0653209617765; dx=1.3197151870025886E-5 evalInputDelta=233.9118833963803
END: th(84000.00000000003)=-1772.908345064685; dx=-7.729337758056714E-4 evalInputDelta=190.75490749928872
Fitness changed from -1582.1534375653962 to -1816.0653209617765
Iteration 6 complete. Error: -1816.0653209617765 Total: 110.9085; Orientation: 1.8449; Line Search: 81.4146
Adding measurement b799d0a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.009e+04, gradient 4.135e-02, dot -0.299; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1816.0653209617765, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement b799d0a to history. Total: 3
th(0)=-1816.0653209617765;dx=-0.0017073296421168368
New Minimum: -1816.0653209617765 > -2011.5098806617877
WOLF (strong): th(180972.5139626783)=-2011.5098806617877; dx=3.76501465744893E-5 evalInputDelta=195.44455970001127
END: th(90486.25698133915)=-1970.9167283272016; dx=-6.748931156516193E-4 evalInputDelta=154.85140736542508
Fitness changed from -1816.0653209617765 to -2011.5098806617877
Iteration 7 complete. Error: -2011.5098806617877 Total: 108.1221; Orientation: 1.8191; Line Search: 79.4332
Adding measurement 50927ea4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.357e+04, gradient 4.308e-02, dot -0.324; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2011.5098806617877, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 50927ea4 to history. Total: 3
th(0)=-2011.5098806617877;dx=-0.0018539816188473585
New Minimum: -2011.5098806617877 > -2172.571517810173
WOLF (strong): th(194946.7310117368)=-2172.571517810173; dx=2.1034547726115203E-4 evalInputDelta=161.06163714838544
END: th(97473.3655058684)=-2162.061978760091; dx=-4.100388206837159E-4 evalInputDelta=150.55209809830308
Fitness changed from -2011.5098806617877 to -2172.571517810173
Iteration 8 complete. Error: -2172.571517810173 Total: 111.6440; Orientation: 2.5653; Line Search: 83.2846
Adding measurement 3abf8109 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.141e+04, gradient 4.400e-02, dot -0.289; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2172.571517810173, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 3abf8109 to history. Total: 3
th(0)=-2172.571517810173;dx=-0.0019340110561140733
New Minimum: -2172.571517810173 > -2336.7133970600676
WOLF (strong): th(210000.0000000001)=-2336.7133970600676; dx=4.6964693644965924E-4 evalInputDelta=164.14187924989437
New Minimum: -2336.7133970600676 > -2344.828991632439
END: th(105000.00000000004)=-2344.828991632439; dx=-4.25105834828259E-4 evalInputDelta=172.25747382226564
Fitness changed from -2172.571517810173 to -2344.828991632439
Iteration 9 complete. Error: -2344.828991632439 Total: 118.3327; Orientation: 1.9679; Line Search: 86.2216
Adding measurement 24ae3e7b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.020e+05, gradient 3.281e-02, dot -0.403; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2344.828991632439, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 24ae3e7b to history. Total: 3
th(0)=-2344.828991632439;dx=-0.0010741093793729466
New Minimum: -2344.828991632439 > -2508.9550613751535
END: th(226215.6424533479)=-2508.9550613751535; dx=-1.7046222569001043E-4 evalInputDelta=164.12606974271466
Fitness changed from -2344.828991632439 to -2508.9550613751535
Iteration 10 complete. Error: -2508.9550613751535 Total: 85.9552; Orientation: 1.8717; Line Search: 55.5770
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Adding measurement 7751dd81 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.093e+05, gradient 3.963e-02, dot -0.331; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2508.9550613751535, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 7751dd81 to history. Total: 3
th(0)=-2508.9550613751535;dx=-0.0015703875585679234
Armijo: th(487366.82752934203)=-2496.725755865069; dx=3.856717846095315E-4 evalInputDelta=-12.229305510084487
New Minimum: -2508.9550613751535 > -2624.7026498253094
WOLF (strong): th(243683.41376467102)=-2624.7026498253094; dx=2.8755050211976674E-4 evalInputDelta=115.74758845015594
END: th(81227.80458822368)=-2622.1202298903077; dx=-4.5979786358866023E-4 evalInputDelta=113.16516851515416
Fitness changed from -2508.9550613751535 to -2624.7026498253094
Iteration 11 complete. Error: -2624.7026498253094 Total: 144.0251; Orientation: 1.9647; Line Search: 113.9521
Adding measurement 7197ca88 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.056e+05, gradient 4.494e-02, dot -0.277; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2624.7026498253094, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 7197ca88 to history. Total: 3
th(0)=-2624.7026498253094;dx=-0.0020182306695529007
New Minimum: -2624.7026498253094 > -2822.0353470500686
WOLF (strong): th(175000.00000000012)=-2822.0353470500686; dx=1.8587624509367525E-4 evalInputDelta=197.33269722475916
END: th(87500.00000000006)=-2793.964477225865; dx=-6.94616466973676E-4 evalInputDelta=169.26182740055538
Fitness changed from -2624.7026498253094 to -2822.0353470500686
Iteration 12 complete. Error: -2822.0353470500686 Total: 114.8204; Orientation: 1.8283; Line Search: 85.5932
Adding measurement 2804b4e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.177e+05, gradient 3.881e-02, dot -0.314; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2822.0353470500686, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 2804b4e to history. Total: 3
th(0)=-2822.0353470500686;dx=-0.0015048379896797593
New Minimum: -2822.0353470500686 > -2967.4478933925698
WOLF (strong): th(188513.03537778996)=-2967.4478933925698; dx=1.9481024034115178E-4 evalInputDelta=145.41254634250117
END: th(94256.51768889498)=-2950.6966973919907; dx=-4.637974471425309E-4 evalInputDelta=128.66135034192212
Fitness changed from -2822.0353470500686 to -2967.4478933925698
Iteration 13 complete. Error: -2967.4478933925698 Total: 117.3592; Orientation: 1.8432; Line Search: 85.9929
Adding measurement 7e41dd52 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.292e+05, gradient 3.964e-02, dot -0.310; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2967.4478933925698, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 7e41dd52 to history. Total: 3
th(0)=-2967.4478933925698;dx=-0.0015685750047715386
New Minimum: -2967.4478933925698 > -3084.8105290276744
WOLF (strong): th(203069.51147055923)=-3084.8105290276744; dx=3.8955166888986854E-4 evalInputDelta=117.36263563510465
New Minimum: -3084.8105290276744 > -3094.891920568471
END: th(101534.75573527961)=-3094.891920568471; dx=-2.863041854377893E-4 evalInputDelta=127.44402717590128
Fitness changed from -2967.4478933925698 to -3094.891920568471
Iteration 14 complete. Error: -3094.891920568471 Total: 114.3753; Orientation: 1.8705; Line Search: 84.2861
Adding measurement 61cb6392 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.384e+05, gradient 2.858e-02, dot -0.421; [77294520-6d9b-4d4a-9d84-8d3c9617ee5f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -3094.891920568471, -672.3994813353146, -380.0194073991485, -177.30301569629322
LBFGS Accumulation History: 3 points
Removed measurement 61cb6392 to history. Total: 3
th(0)=-3094.891920568471;dx=-8.1342420821897E-4
New Minimum: -3094.891920568471 > -3219.4345776859636
END: th(218750.00000000017)=-3219.4345776859636; dx=-1.248094788091009E-4 evalInputDelta=124.54265711749258
Fitness changed from -3094.891920568471 to -3219.4345776859636
Iteration 15 complete. Error: -3219.4345776859636 Total: 85.3869; Orientation: 1.8088; Line Search: 56.2712
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: -3219.4345776859636 (> -Infinity) after 1913.919s (< 5400.000s)
Returns
-3219.4345776859636