• eestileib
    link
    fedilink
    arrow-up
    2
    ·
    1 year ago

    Perturbed gradient descent with backprop is what we were doing in the 90s. It feels like there are some new tricks but mostly what I see is the result of GPUs and cheap memory.

    I volunteer at a summer science camp and 90% of the projects are “I pointed AI at this problem and…”, nobody seems to be even trying for analytical approaches any more. I’m ready for a new fad.

    Anybody else remember when it was all wavelets all the time? That was kinda fun.