BasicOptimizer.scala:89 executed in 207.86 seconds (3.023 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 9462535147022
Reset training subject: 9466695034189
Adding measurement 2a288bfb to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-0.05482913553714752;dx=-5.166406033749332E-7
New Minimum: -0.05482913553714752 > -0.054829299449920654
WOLFE (weak): th(2.154434690031884)=-0.054829299449920654; dx=-4.945631536639763E-7 evalInputDelta=1.6391277313232422E-7
New Minimum: -0.054829299449920654 > -0.054829880595207214
WOLFE (weak): th(4.308869380063768)=-0.054829880595207214; dx=-4.945628364138289E-7 evalInputDelta=7.450580596923828E-7
New Minimum: -0.054829880595207214 > -0.054832398891448975
WOLFE (weak): th(12.926608140191302)=-0.054832398891448975; dx=-4.945591333298241E-7 evalInputDelta=3.2633543014526367E-6
New Minimum: -0.054832398891448975 > -0.054842039942741394
WOLFE (weak): th(51.70643256076521)=-0.054842039942741394; dx=-4.945596514929175E-7 evalInputDelta=1.290440559387207E-5
New Minimum: -0.054842039942741394 > -0.0548931360244751
WOLFE (weak): th(258.53216280382605)=-0.0548931360244751; dx=-4.94520421943911E-7 evalInputDelta=6.400048732757568E-5
New Minimum: -0.0548931360244751 > -0.05521276593208313
WOLFE (weak): th(1551.1929768229563)=-0.05521276593208313; dx=-4.944210147480124E-7 evalInputDelta=3.836303949356079E-4
New Minimum: -0.05521276593208313 > -0.05751065909862518
WOLFE (weak): th(10858.350837760694)=-0.05751065909862518; dx=-4.931147804064892E-7 evalInputDelta=0.002681523561477661
New Minimum: -0.05751065909862518 > -0.0760660469532013
WOLFE (weak): th(86866.80670208555)=-0.0760660469532013; dx=-4.834468669397694E-7 evalInputDelta=0.021236911416053772
New Minimum: -0.0760660469532013 > -0.2277602255344391
END: th(781801.26031877)=-0.2277602255344391; dx=-3.8906218401986705E-7 evalInputDelta=0.17293108999729156
Fitness changed from -0.05482913553714752 to -0.2277602255344391
Iteration 1 complete. Error: -0.2277602255344391 Total: 56.8410; Orientation: 0.0468; Line Search: 43.4510
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4068b4f0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-0.2277602255344391;dx=-3.465464612178562E-7
New Minimum: -0.2277602255344391 > -0.4708263725042343
END: th(1684339.7559414052)=-0.4708263725042343; dx=-2.344178529546316E-7 evalInputDelta=0.24306614696979523
Fitness changed from -0.2277602255344391 to -0.4708263725042343
Iteration 2 complete. Error: -0.4708263725042343 Total: 13.6221; Orientation: 0.0464; Line Search: 9.2565
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 30a14c8 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-0.4708263725042343;dx=-2.1139285525452977E-7
New Minimum: -0.4708263725042343 > -0.7635142803192139
END: th(3628800.0)=-0.7635142803192139; dx=-1.197451017318609E-7 evalInputDelta=0.29268790781497955
Fitness changed from -0.4708263725042343 to -0.7635142803192139
Iteration 3 complete. Error: -0.7635142803192139 Total: 13.0425; Orientation: 0.0463; Line Search: 8.5760
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 573ba8b3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.327e+03, gradient 3.655e-04, dot -0.827; [66bc1dd0-99a4-4af0-b381-5d91165b067c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.7635142803192139, -0.4708263725042343, -0.2277602255344391, -0.05482913553714752
LBFGS Accumulation History: 3 points
Removed measurement 573ba8b3 to history. Total: 3
th(0)=-0.7635142803192139;dx=-1.335697814859788E-7
New Minimum: -0.7635142803192139 > -1.0654605776071548
END: th(7818012.6031877)=-1.0654605776071548; dx=-4.3991352045456374E-8 evalInputDelta=0.301946297287941
Fitness changed from -0.7635142803192139 to -1.0654605776071548
Iteration 4 complete. Error: -1.0654605776071548 Total: 14.8382; Orientation: 1.0326; Line Search: 8.7467
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2b6f918c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.914e+03, gradient 3.307e-04, dot -0.604; [66bc1dd0-99a4-4af0-b381-5d91165b067c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.0654605776071548, -0.4708263725042343, -0.2277602255344391, -0.05482913553714752
LBFGS Accumulation History: 3 points
Removed measurement 2b6f918c to history. Total: 3
th(0)=-1.0654605776071548;dx=-1.0937857875184833E-7
New Minimum: -1.0654605776071548 > -1.2455101311206818
WOLF (strong): th(1.684339755941405E7)=-1.2455101311206818; dx=6.882080806483913E-9 evalInputDelta=0.18004955351352692
New Minimum: -1.2455101311206818 > -1.2547936737537384
END: th(8421698.779707026)=-1.2547936737537384; dx=-5.742003385182974E-9 evalInputDelta=0.18933309614658356
Fitness changed from -1.0654605776071548 to -1.2547936737537384
Iteration 5 complete. Error: -1.2547936737537384 Total: 18.0673; Orientation: 1.0156; Line Search: 13.0598
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2c8292c1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.993e+03, gradient 3.135e-04, dot -0.511; [66bc1dd0-99a4-4af0-b381-5d91165b067c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.2547936737537384, -0.4708263725042343, -0.2277602255344391, -0.05482913553714752
LBFGS Accumulation History: 3 points
Removed measurement 2c8292c1 to history. Total: 3
th(0)=-1.2547936737537384;dx=-9.825680531483549E-8
New Minimum: -1.2547936737537384 > -1.3210499733686447
WOLF (strong): th(1.8144E7)=-1.3210499733686447; dx=2.327289683997208E-8 evalInputDelta=0.06625629961490631
New Minimum: -1.3210499733686447 > -1.414940893650055
WOLF (strong): th(9072000.0)=-1.414940893650055; dx=1.000286666834935E-8 evalInputDelta=0.16014721989631653
END: th(3024000.0)=-1.365258127450943; dx=-4.871536977461918E-8 evalInputDelta=0.11046445369720459
Fitness changed from -1.2547936737537384 to -1.414940893650055
Iteration 6 complete. Error: -1.414940893650055 Total: 22.6493; Orientation: 1.0250; Line Search: 17.4654
Adding measurement 560f0c86 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.952e+03, gradient 2.839e-04, dot -0.467; [66bc1dd0-99a4-4af0-b381-5d91165b067c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.414940893650055, -0.4708263725042343, -0.2277602255344391, -0.05482913553714752
LBFGS Accumulation History: 3 points
Removed measurement 560f0c86 to history. Total: 3
th(0)=-1.414940893650055;dx=-8.061784479616574E-8
New Minimum: -1.414940893650055 > -1.5457623600959778
END: th(6515010.502656417)=-1.5457623600959778; dx=-1.108006541137661E-8 evalInputDelta=0.13082146644592285
Fitness changed from -1.414940893650055 to -1.5457623600959778
Iteration 7 complete. Error: -1.5457623600959778 Total: 13.9758; Orientation: 1.0397; Line Search: 8.6581
Adding measurement 13ca7361 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.300e+03, gradient 1.934e-04, dot -0.591; [66bc1dd0-99a4-4af0-b381-5d91165b067c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.5457623600959778, -0.4708263725042343, -0.2277602255344391, -0.05482913553714752
LBFGS Accumulation History: 3 points
Removed measurement 13ca7361 to history. Total: 3
th(0)=-1.5457623600959778;dx=-3.7411718278675514E-8
New Minimum: -1.5457623600959778 > -1.6585938334465027
WOLF (strong): th(1.4036164632845046E7)=-1.6585938334465027; dx=1.1667627865783472E-9 evalInputDelta=0.1128314733505249
END: th(7018082.316422523)=-1.636209324002266; dx=-1.5006154391553154E-8 evalInputDelta=0.09044696390628815
Fitness changed from -1.5457623600959778 to -1.6585938334465027
Iteration 8 complete. Error: -1.6585938334465027 Total: 17.8391; Orientation: 1.0266; Line Search: 12.7781
Adding measurement 446c6068 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.037e+03, gradient 2.410e-04, dot -0.406; [66bc1dd0-99a4-4af0-b381-5d91165b067c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.6585938334465027, -0.4708263725042343, -0.2277602255344391, -0.05482913553714752
LBFGS Accumulation History: 3 points
Removed measurement 446c6068 to history. Total: 3
th(0)=-1.6585938334465027;dx=-5.8091221705057925E-8
New Minimum: -1.6585938334465027 > -1.6963438540697098
WOLF (strong): th(1.5120000000000004E7)=-1.6963438540697098; dx=2.0552527543238132E-8 evalInputDelta=0.03775002062320709
New Minimum: -1.6963438540697098 > -1.7485007345676422
WOLF (strong): th(7560000.000000002)=-1.7485007345676422; dx=1.659231828635008E-9 evalInputDelta=0.08990690112113953
END: th(2520000.0000000005)=-1.7151109725236893; dx=-3.207503410988972E-8 evalInputDelta=0.056517139077186584
Fitness changed from -1.6585938334465027 to -1.7485007345676422
Iteration 9 complete. Error: -1.7485007345676422 Total: 23.4332; Orientation: 1.0084; Line Search: 18.4835
Adding measurement 7bc04281 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.272e+03, gradient 1.713e-04, dot -0.507; [66bc1dd0-99a4-4af0-b381-5d91165b067c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.7485007345676422, -0.4708263725042343, -0.2277602255344391, -0.05482913553714752
LBFGS Accumulation History: 3 points
Removed measurement 7bc04281 to history. Total: 3
th(0)=-1.7485007345676422;dx=-2.9333904558745286E-8
New Minimum: -1.7485007345676422 > -1.805054947733879
END: th(5429175.418880348)=-1.805054947733879; dx=-1.2829278567263295E-8 evalInputDelta=0.05655421316623688
Fitness changed from -1.7485007345676422 to -1.805054947733879
Iteration 10 complete. Error: -1.805054947733879 Total: 13.4802; Orientation: 1.0241; Line Search: 7.9953
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -1.805054947733879 (> -Infinity) after 207.857s (< 5400.000s)
Returns
-1.805054947733879