BasicOptimizer.scala:89 executed in 1924.62 seconds (241.418 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 678459160841000
Reset training subject: 678488314079100
Adding measurement 26712369 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-187.27341517484535;dx=-0.00286214214592716
New Minimum: -187.27341517484535 > -187.28261356503438
WOLFE (weak): th(2.154434690031884)=-187.28261356503438; dx=-0.002862796648430856 evalInputDelta=0.00919839018902735
New Minimum: -187.28261356503438 > -187.29183235995637
WOLFE (weak): th(4.308869380063768)=-187.29183235995637; dx=-0.002864159467109287 evalInputDelta=0.018417185111019307
New Minimum: -187.29183235995637 > -187.32864044574177
WOLFE (weak): th(12.926608140191302)=-187.32864044574177; dx=-0.002855938845279362 evalInputDelta=0.05522527089641471
New Minimum: -187.32864044574177 > -187.49439574957967
WOLFE (weak): th(51.70643256076521)=-187.49439574957967; dx=-0.0028628482254226205 evalInputDelta=0.22098057473431254
New Minimum: -187.49439574957967 > -188.37868070392148
WOLFE (weak): th(258.53216280382605)=-188.37868070392148; dx=-0.002863222685945917 evalInputDelta=1.1052655290761209
New Minimum: -188.37868070392148 > -193.91650103846243
WOLFE (weak): th(1551.1929768229563)=-193.91650103846243; dx=-0.0028724231548414624 evalInputDelta=6.643085863617074
New Minimum: -193.91650103846243 > -233.4289991758736
WOLFE (weak): th(10858.350837760694)=-233.4289991758736; dx=-0.0027663687616902234 evalInputDelta=46.155584001028245
New Minimum: -233.4289991758736 > -424.7432128651381
END: th(86866.80670208555)=-424.7432128651381; dx=-8.562857555915473E-4 evalInputDelta=237.46979769029275
Fitness changed from -187.27341517484535 to -424.7432128651381
Iteration 1 complete. Error: -424.7432128651381 Total: 334.0249; Orientation: 0.1004; Line Search: 250.4551
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 714f3af4 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-424.7432128651381;dx=-0.002457115612974166
New Minimum: -424.7432128651381 > -721.9683814060004
END: th(187148.86177126726)=-721.9683814060004; dx=-2.8046751775538073E-4 evalInputDelta=297.2251685408623
Fitness changed from -424.7432128651381 to -721.9683814060004
Iteration 2 complete. Error: -721.9683814060004 Total: 81.2581; Orientation: 0.1020; Line Search: 53.0676
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 63266754 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-721.9683814060004;dx=-0.0032304726078819833
New Minimum: -721.9683814060004 > -965.4443924949795
WOLF (strong): th(403200.00000000006)=-965.4443924949795; dx=1.3773539237035986E-4 evalInputDelta=243.47601108897913
New Minimum: -965.4443924949795 > -996.189929180174
END: th(201600.00000000003)=-996.189929180174; dx=-1.3529536620596143E-5 evalInputDelta=274.2215477741736
Fitness changed from -721.9683814060004 to -996.189929180174
Iteration 3 complete. Error: -996.189929180174 Total: 108.2984; Orientation: 0.1013; Line Search: 80.1469
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5972147f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.363e+04, gradient 5.164e-02, dot -0.384; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -996.189929180174, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 5972147f to history. Total: 3
th(0)=-996.189929180174;dx=-0.0026646467943872466
New Minimum: -996.189929180174 > -1166.3971236247112
WOLF (strong): th(434334.03351042786)=-1166.3971236247112; dx=3.540283081820091E-4 evalInputDelta=170.2071944445372
New Minimum: -1166.3971236247112 > -1282.1865601385782
WOLF (strong): th(217167.01675521393)=-1282.1865601385782; dx=1.324685222240039E-4 evalInputDelta=285.99663095840424
END: th(72389.00558507131)=-1205.9983934483496; dx=-0.0011422623934751565 evalInputDelta=209.8084642681756
Fitness changed from -996.189929180174 to -1282.1865601385782
Iteration 4 complete. Error: -1282.1865601385782 Total: 134.9762; Orientation: 1.8871; Line Search: 106.6670
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4eea6e9a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.791e+04, gradient 5.160e-02, dot -0.344; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1282.1865601385782, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 4eea6e9a to history. Total: 3
th(0)=-1282.1865601385782;dx=-0.0026550514168228708
New Minimum: -1282.1865601385782 > -1548.3749545894884
END: th(155957.38480938942)=-1548.3749545894884; dx=-2.696545274430515E-5 evalInputDelta=266.1883944509102
Fitness changed from -1282.1865601385782 to -1548.3749545894884
Iteration 5 complete. Error: -1548.3749545894884 Total: 87.5724; Orientation: 1.8212; Line Search: 56.1241
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 559b8c9e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.449e+04, gradient 4.504e-02, dot -0.365; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1548.3749545894884, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 559b8c9e to history. Total: 3
th(0)=-1548.3749545894884;dx=-0.0020271351610307397
New Minimum: -1548.3749545894884 > -1631.577457554498
WOLF (strong): th(336000.0000000001)=-1631.577457554498; dx=5.372286416918748E-4 evalInputDelta=83.20250296500967
New Minimum: -1631.577457554498 > -1742.635934439549
WOLF (strong): th(168000.00000000006)=-1742.635934439549; dx=1.3420126246798633E-4 evalInputDelta=194.2609798500605
END: th(56000.00000000002)=-1678.9098397472094; dx=-0.0010397536735849804 evalInputDelta=130.53488515772096
Fitness changed from -1548.3749545894884 to -1742.635934439549
Iteration 6 complete. Error: -1742.635934439549 Total: 151.2454; Orientation: 1.8295; Line Search: 119.6378
Adding measurement bfa28cc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.606e+04, gradient 4.708e-02, dot -0.365; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1742.635934439549, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement bfa28cc to history. Total: 3
th(0)=-1742.635934439549;dx=-0.002212535959707991
New Minimum: -1742.635934439549 > -1915.9932150193017
END: th(120648.34264178554)=-1915.9932150193017; dx=-3.0437767802829366E-5 evalInputDelta=173.3572805797528
Fitness changed from -1742.635934439549 to -1915.9932150193017
Iteration 7 complete. Error: -1915.9932150193017 Total: 90.0165; Orientation: 2.0915; Line Search: 56.9304
Adding measurement 5a2f119 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.056e+04, gradient 3.948e-02, dot -0.408; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1915.9932150193017, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 5a2f119 to history. Total: 3
th(0)=-1915.9932150193017;dx=-0.0015537578959243165
New Minimum: -1915.9932150193017 > -2020.6951155481127
WOLF (strong): th(259928.97468231575)=-2020.6951155481127; dx=3.7296138980091333E-4 evalInputDelta=104.70190052881094
New Minimum: -2020.6951155481127 > -2057.6553404299757
END: th(129964.48734115787)=-2057.6553404299757; dx=-9.735767616869052E-5 evalInputDelta=141.66212541067398
Fitness changed from -1915.9932150193017 to -2057.6553404299757
Iteration 8 complete. Error: -2057.6553404299757 Total: 119.1319; Orientation: 1.8547; Line Search: 87.6954
Adding measurement 56befec6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.045e+04, gradient 3.931e-02, dot -0.418; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2057.6553404299757, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 56befec6 to history. Total: 3
th(0)=-2057.6553404299757;dx=-0.0015441106502532382
New Minimum: -2057.6553404299757 > -2132.3414360744387
WOLF (strong): th(280000.0000000002)=-2132.3414360744387; dx=3.188216358875117E-4 evalInputDelta=74.68609564446297
New Minimum: -2132.3414360744387 > -2179.7691391521257
WOLF (strong): th(140000.0000000001)=-2179.7691391521257; dx=4.4241193379632266E-5 evalInputDelta=122.11379872215002
END: th(46666.66666666669)=-2137.18693613825; dx=-7.744560915083341E-4 evalInputDelta=79.53159570827438
Fitness changed from -2057.6553404299757 to -2179.7691391521257
Iteration 9 complete. Error: -2179.7691391521257 Total: 143.1046; Orientation: 1.8664; Line Search: 115.0132
Adding measurement 2badd758 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.275e+04, gradient 4.109e-02, dot -0.385; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2179.7691391521257, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 2badd758 to history. Total: 3
th(0)=-2179.7691391521257;dx=-0.0016859351611831623
New Minimum: -2179.7691391521257 > -2302.547827950594
END: th(100540.2855348213)=-2302.547827950594; dx=-1.3796130840225464E-4 evalInputDelta=122.77868879846847
Fitness changed from -2179.7691391521257 to -2302.547827950594
Iteration 10 complete. Error: -2302.547827950594 Total: 86.6419; Orientation: 1.8955; Line Search: 56.5860
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Adding measurement 194e779a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.095e+04, gradient 3.452e-02, dot -0.455; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2302.547827950594, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 194e779a to history. Total: 3
th(0)=-2302.547827950594;dx=-0.001188244879801595
New Minimum: -2302.547827950594 > -2411.1831120841903
WOLF (strong): th(216607.47890192983)=-2411.1831120841903; dx=1.139435823192294E-4 evalInputDelta=108.63528413359609
END: th(108303.73945096492)=-2406.760478319353; dx=-2.456524385294743E-4 evalInputDelta=104.21265036875866
Fitness changed from -2302.547827950594 to -2411.1831120841903
Iteration 11 complete. Error: -2411.1831120841903 Total: 121.1420; Orientation: 1.8459; Line Search: 88.0382
Adding measurement 6b8f9920 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.861e+04, gradient 4.534e-02, dot -0.330; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2411.1831120841903, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 6b8f9920 to history. Total: 3
th(0)=-2411.1831120841903;dx=-0.0020535657324252735
New Minimum: -2411.1831120841903 > -2470.3419803743773
WOLF (strong): th(233333.33333333352)=-2470.3419803743773; dx=7.294034251764919E-4 evalInputDelta=59.158868290187
New Minimum: -2470.3419803743773 > -2564.302146783799
WOLF (strong): th(116666.66666666676)=-2564.302146783799; dx=7.535056970780398E-5 evalInputDelta=153.11903469960862
END: th(38888.88888888892)=-2508.079942904532; dx=-0.001246713293733144 evalInputDelta=96.89683082034162
Fitness changed from -2411.1831120841903 to -2564.302146783799
Iteration 12 complete. Error: -2564.302146783799 Total: 143.9333; Orientation: 1.8160; Line Search: 114.7426
Adding measurement 1b6efdb7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.830e+04, gradient 3.615e-02, dot -0.407; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2564.302146783799, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 1b6efdb7 to history. Total: 3
th(0)=-2564.302146783799;dx=-0.0013028699407130649
New Minimum: -2564.302146783799 > -2665.4003451639305
END: th(83783.57127901776)=-2665.4003451639305; dx=-3.8680378487995336E-4 evalInputDelta=101.09819838013163
Fitness changed from -2564.302146783799 to -2665.4003451639305
Iteration 13 complete. Error: -2665.4003451639305 Total: 85.9365; Orientation: 1.8299; Line Search: 58.6574
Adding measurement 363429dd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.575e+04, gradient 2.860e-02, dot -0.509; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2665.4003451639305, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 363429dd to history. Total: 3
th(0)=-2665.4003451639305;dx=-8.14926778810982E-4
New Minimum: -2665.4003451639305 > -2780.74198731202
END: th(180506.23241827489)=-2780.74198731202; dx=-1.881717285875593E-4 evalInputDelta=115.34164214808925
Fitness changed from -2665.4003451639305 to -2780.74198731202
Iteration 14 complete. Error: -2780.74198731202 Total: 92.0085; Orientation: 1.8589; Line Search: 59.4937
Adding measurement 8aaa1f8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.117e+04, gradient 3.619e-02, dot -0.401; [79dfdda9-e58b-41e3-89d1-dfb77d1802cf = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2780.74198731202, -721.9683814060004, -424.7432128651381, -187.27341517484535
LBFGS Accumulation History: 3 points
Removed measurement 8aaa1f8 to history. Total: 3
th(0)=-2780.74198731202;dx=-0.0013086166799072506
Armijo: th(388888.8888888892)=-2739.351018033286; dx=3.8022927417535277E-4 evalInputDelta=-41.39096927873379
New Minimum: -2780.74198731202 > -2852.68487569167
WOLF (strong): th(194444.4444444446)=-2852.68487569167; dx=2.621845822359364E-4 evalInputDelta=71.94288837965041
New Minimum: -2852.68487569167 > -2861.059157025594
END: th(64814.81481481487)=-2861.059157025594; dx=-3.945461375365191E-4 evalInputDelta=80.317169713574
Fitness changed from -2780.74198731202 to -2861.059157025594
Iteration 15 complete. Error: -2861.059157025594 Total: 144.4521; Orientation: 1.8569; Line Search: 115.3266
<a id="p-15"></a>Iteration 15
<a id="p-14"></a>
Final threshold in iteration 16: -2861.059157025594 (> -Infinity) after 1924.620s (< 5400.000s)
Returns
-2861.059157025594