BasicOptimizer.scala:89 executed in 220.95 seconds (3.329 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 685018436564000
Reset training subject: 685023142133000
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -1023.5535525804207 > -1023.9949951049565
th(0)=-1023.9949951049565;dx=-0.006132169859408087
New Minimum: -1023.9949951049565 > -1024.0081176436054
WOLFE (weak): th(2.154434690031884)=-1024.0081176436054; dx=-0.005573506138725199 evalInputDelta=0.01312253864887225
New Minimum: -1024.0081176436054 > -1024.0212400140927
WOLFE (weak): th(4.308869380063768)=-1024.0212400140927; dx=-0.005572911031040236 evalInputDelta=0.026244909136153183
New Minimum: -1024.0212400140927 > -1024.0738498760722
WOLFE (weak): th(12.926608140191302)=-1024.0738498760722; dx=-0.005572402530747915 evalInputDelta=0.07885477111574346
New Minimum: -1024.0738498760722 > -1024.3103167497632
WOLFE (weak): th(51.70643256076521)=-1024.3103167497632; dx=-0.005569950322580997 evalInputDelta=0.3153216448066587
New Minimum: -1024.3103167497632 > -1025.5710604341368
WOLFE (weak): th(258.53216280382605)=-1025.5710604341368; dx=-0.0055630669658322624 evalInputDelta=1.5760653291803237
New Minimum: -1025.5710604341368 > -1033.3941648761136
END: th(1551.1929768229563)=-1033.3941648761136; dx=-0.005491460954350464 evalInputDelta=9.399169771157062
Fitness changed from -1023.5535525804207 to -1033.3941648761136
Iteration 1 complete. Error: -1033.3941648761136 Total: 45.5439; Orientation: 0.0626; Line Search: 31.7944
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 51a632eb to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-1033.3941648761136;dx=-0.005430219560510805
New Minimum: -1033.3941648761136 > -1052.9637932996557
WOLFE (weak): th(3341.943960201201)=-1052.9637932996557; dx=-0.005283972671451498 evalInputDelta=19.5696284235421
New Minimum: -1052.9637932996557 > -1071.976329029704
WOLFE (weak): th(6683.887920402402)=-1071.976329029704; dx=-0.005123410086870181 evalInputDelta=38.582164153590384
New Minimum: -1071.976329029704 > -1141.5059132566944
END: th(20051.663761207208)=-1141.5059132566944; dx=-0.004370594421530627 evalInputDelta=108.11174838058082
Fitness changed from -1033.3941648761136 to -1141.5059132566944
Iteration 2 complete. Error: -1141.5059132566944 Total: 24.1605; Orientation: 0.0857; Line Search: 18.4513
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3fe9508 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1141.5059132566944;dx=-0.004028280340684951
New Minimum: -1141.5059132566944 > -1302.228138614736
END: th(43200.00000000001)=-1302.228138614736; dx=-0.0027969675224506457 evalInputDelta=160.72222535804167
Fitness changed from -1141.5059132566944 to -1302.228138614736
Iteration 3 complete. Error: -1302.228138614736 Total: 14.3577; Orientation: 0.0976; Line Search: 8.8258
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6590190a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1302.228138614736;dx=-0.002764981102631771
New Minimum: -1302.228138614736 > -1510.1973380985678
END: th(93071.5786093774)=-1510.1973380985678; dx=-0.0014967766887789553 evalInputDelta=207.96919948383174
Fitness changed from -1302.228138614736 to -1510.1973380985678
Iteration 4 complete. Error: -1510.1973380985678 Total: 14.8532; Orientation: 0.0977; Line Search: 9.3772
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 6b1d9226 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.535e+04, gradient 4.808e-02, dot -0.716; [b583428e-acdf-42dd-9c91-340a9bed72b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1510.1973380985678, -1302.228138614736, -1141.5059132566944, -1033.3941648761136
LBFGS Accumulation History: 3 points
Removed measurement 6b1d9226 to history. Total: 3
th(0)=-1510.1973380985678;dx=-0.0023057511387100907
New Minimum: -1510.1973380985678 > -1721.9478795828868
END: th(200516.63761207208)=-1721.9478795828868; dx=-4.612028279364291E-4 evalInputDelta=211.750541484319
Fitness changed from -1510.1973380985678 to -1721.9478795828868
Iteration 5 complete. Error: -1721.9478795828868 Total: 16.5541; Orientation: 1.7872; Line Search: 9.2950
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 206a4565 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.337e+04, gradient 5.436e-02, dot -0.449; [b583428e-acdf-42dd-9c91-340a9bed72b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1721.9478795828868, -1302.228138614736, -1141.5059132566944, -1033.3941648761136
LBFGS Accumulation History: 3 points
Removed measurement 206a4565 to history. Total: 3
th(0)=-1721.9478795828868;dx=-0.0029495859098129036
New Minimum: -1721.9478795828868 > -1781.0397244306484
WOLF (strong): th(432000.0000000001)=-1781.0397244306484; dx=3.1965109003652295E-4 evalInputDelta=59.09184484776165
New Minimum: -1781.0397244306484 > -1864.6425930992782
WOLF (strong): th(216000.00000000006)=-1864.6425930992782; dx=2.2867451151958938E-4 evalInputDelta=142.6947135163914
END: th(72000.00000000001)=-1858.1001722189253; dx=-7.648216354995222E-4 evalInputDelta=136.1522926360385
Fitness changed from -1721.9478795828868 to -1864.6425930992782
Iteration 6 complete. Error: -1864.6425930992782 Total: 25.1684; Orientation: 1.6681; Line Search: 17.9827
Adding measurement 2044a0d1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.528e+04, gradient 5.765e-02, dot -0.352; [b583428e-acdf-42dd-9c91-340a9bed72b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1864.6425930992782, -1302.228138614736, -1141.5059132566944, -1033.3941648761136
LBFGS Accumulation History: 3 points
Removed measurement 2044a0d1 to history. Total: 3
th(0)=-1864.6425930992782;dx=-0.0033207176140463293
New Minimum: -1864.6425930992782 > -2072.9977086335625
WOLF (strong): th(155119.29768229567)=-2072.9977086335625; dx=1.788220275415923E-4 evalInputDelta=208.35511553428432
END: th(77559.64884114783)=-2046.2747860441423; dx=-0.0010545394072083132 evalInputDelta=181.63219294486407
Fitness changed from -1864.6425930992782 to -2072.9977086335625
Iteration 7 complete. Error: -2072.9977086335625 Total: 20.1829; Orientation: 1.6071; Line Search: 13.8899
Adding measurement 7e1c06fc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.202e+04, gradient 5.365e-02, dot -0.370; [b583428e-acdf-42dd-9c91-340a9bed72b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2072.9977086335625, -1302.228138614736, -1141.5059132566944, -1033.3941648761136
LBFGS Accumulation History: 3 points
Removed measurement 7e1c06fc to history. Total: 3
th(0)=-2072.9977086335625;dx=-0.0028709486949809473
New Minimum: -2072.9977086335625 > -2216.004286999463
WOLF (strong): th(167097.1980100601)=-2216.004286999463; dx=5.130998956922944E-4 evalInputDelta=143.00657836590062
New Minimum: -2216.004286999463 > -2222.652919373603
END: th(83548.59900503005)=-2222.652919373603; dx=-6.031628612850823E-4 evalInputDelta=149.65521074004027
Fitness changed from -2072.9977086335625 to -2222.652919373603
Iteration 8 complete. Error: -2222.652919373603 Total: 19.8104; Orientation: 1.6560; Line Search: 13.7929
Adding measurement 682709d9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.358e+04, gradient 4.117e-02, dot -0.508; [b583428e-acdf-42dd-9c91-340a9bed72b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2222.652919373603, -1302.228138614736, -1141.5059132566944, -1033.3941648761136
LBFGS Accumulation History: 3 points
Removed measurement 682709d9 to history. Total: 3
th(0)=-2222.652919373603;dx=-0.0016929661096673032
New Minimum: -2222.652919373603 > -2346.7873785240963
END: th(180000.00000000006)=-2346.7873785240963; dx=-1.0196527738940726E-4 evalInputDelta=124.13445915049351
Fitness changed from -2222.652919373603 to -2346.7873785240963
Iteration 9 complete. Error: -2346.7873785240963 Total: 15.2009; Orientation: 1.5994; Line Search: 8.8994
Adding measurement 1e7fae30 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.634e+04, gradient 5.266e-02, dot -0.380; [b583428e-acdf-42dd-9c91-340a9bed72b3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2346.7873785240963, -1302.228138614736, -1141.5059132566944, -1033.3941648761136
LBFGS Accumulation History: 3 points
Removed measurement 1e7fae30 to history. Total: 3
th(0)=-2346.7873785240963;dx=-0.0027686138966266883
Armijo: th(387798.24420573923)=-2242.158781174964; dx=6.928649273646022E-4 evalInputDelta=-104.62859734913218
New Minimum: -2346.7873785240963 > -2410.428385163102
WOLF (strong): th(193899.12210286962)=-2410.428385163102; dx=6.831913592711148E-4 evalInputDelta=63.64100663900581
New Minimum: -2410.428385163102 > -2457.813459154295
END: th(64633.04070095654)=-2457.813459154295; dx=-5.526678783243953E-4 evalInputDelta=111.02608063019852
Fitness changed from -2346.7873785240963 to -2457.813459154295
Iteration 10 complete. Error: -2457.813459154295 Total: 24.2210; Orientation: 1.6704; Line Search: 18.2116
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2457.813459154295 (> -Infinity) after 220.945s (< 5400.000s)
Returns
-2457.813459154295