[BUG] Unexpectedly long phases when training a neural network about accelerate HOT 1 OPEN

Because train is a recursive Haskell function, this amounts to loop unrolling in the Accelerate program; you are just building up a larger and larger embedded program, which the rest of the compiler then has to chew on (for no good reason). What you should do is either:

1. rewrite this into a loop in the embedded program (using awhile); or
2. split the loop body into a function you feed to runN (to compile once) and then repeatedly apply it (via Haskell recursion)

Either of those should work around your immediate problem. Of course I'd still like to improve the performance of the compiler internals, but that will take much more time than for you to just give it a simpler program to begin with.

For reference here's the -ddump-simpl-stats output for one step of the 100 epoc program (you are asking it to do a lot!):

Total ticks: 627376

8744 Inline
  8744 Var
25510 RuleFired
  5576 zipWithD
  3984 backpermuteD
  2800 aletD/float
  2792 generateD
  2788 replicateD
  2384 aletD/bind
  1993 mapD
  1992 x*1
  800 aletD/eliminate
  397 commutes (*)
  4 reshapeD
34544 BetaReduce
  34544 inline exp
485729 Substitution
  199868 rebuild
  175976 weakenE
  60512 shrinkE
  32269 weaken
  8744 inline
  5172 strengthenE
  2392 replaceE/shape
  796 replaceE/!
72849 SimplifierDone
  72849

from accelerate.