Starting to hate Deep learning

Oracle MtnGoat
Aug 6 37 Comments

I started learning ML especially deep learning couple of years ago. Worked in grad school research lab. Gained experience in the field, published a paper.
But I'm not able to appreciate this field. Learning statistical machine learning is more fun than deep learning where it is just the matter of trail and error and Coming up with the "novel" architecture. I don't see mathematical rigor there.
On the other hand I feel the engineering aspect of it more challenging and interesting which involves distributed training
But I see people going crazy when the word deep learning is being used.
Am I missing something here?

comments

Want to comment? LOG IN or SIGN UP
TOP 37 Comments
  • Adobe ironjacama
    You mean the difference between something working and not working boiling down to using a sigmoid vs a relu, with no real clue why? Yeah, I feel you.
    Aug 6 17
    • Oracle MtnGoat
      OP
      SpRJ26: well neuroscientists aren't making radical statements unlike "deep learning gurus"
      Aug 6
    • New SpRJ26
      OP: alchemists back in the day also made radical statements - but the science of chemistry slowly grew out of those alchemy efforts. Some things just take time. People who are deep into things don’t take the fake gurus seriously anyway.
      Aug 6
    • Oracle MtnGoat
      OP
      I'm starting to rethink again if career as a deep learning engineer is a good choice compared to SWE
      Aug 6
    • New SpRJ26
      SWE is a much more mature (and deterministic) field than DLE. If you dislike uncertainty and an experimental approach to work then yes, you are better off as a SWE.
      Aug 6
    • Google / Eng iamhal
      Pretty sure this is what swe was like back in 90s
      Aug 6
  • Amazon / Eng Pfum24
    You’re overfitting bro
    Aug 6 6
    • Amazon O(logN)
      Lol
      Aug 6
    • Google macropolo
      It's a well done rant.

      You're misunderstanding why people go crazy over deep learning. They go crazy because of the media hype and the TC.
      Aug 6
    • NVIDIA gruse
      @marcopolo What sort of TC?
      Aug 6
    • Google macropolo
      High TC
      Aug 6
    • NVIDIA gruse
      Sure there’s the high, small tail end of ML people you hear about with high TC and get reported about, but there’s little evidence out there that I’ve seen that the median ML person at a large tech company is doing any better than the median SWE at the same company. So the high TC seems more image than reality
      Aug 6
  • Oracle alwzangry
    It's an inexact science, and toolkits and frameworks allow aggressive, untrained people wing their way into scientific domains in large numbers, overwhelming those who understand the need for rigorous approaches. If science were done like software, we'd still be in the 18th century with no standards for electricity, telecom, transportation, etc.
    Aug 6 1
    • FINRA oGs.MC
      Right now the industry has tons of pretenders bullshitting their way in ML/AI it's infuriating.
      Aug 6
  • Amazon qazwsxedc1
    It’s a bit of a joke . But a joke that works
    Aug 6 2
    • Oracle MtnGoat
      OP
      Its funny when people use the term AGI will be reality with deep learning on something which no one know why it works and how it works 😒
      Aug 6
    • Amazon / Eng Pfum24
      I think we’ll have AGI before we know how it works. Intelligence might be too complex to reason about in simple mathematical terms.
      Aug 6
  • IBM / Data bbWI22
    I understand the sentiment behind your post OP, but industry only cares about results, not about the multitude of different, and perhaps more interesting, approaches. Deep learning in many cases brings results.
    Aug 6 0
  • Microsoft
    Tier 1

    Microsoft

    BIO
    #1 in Prestige
    Tier 1more
    Think of it as a soft science, like psychology.
    Aug 6 0
  • Yahoo JabS27
    those that talk about deep learning, know nothing about deep learning. statistical ML is the only way to go!
    Aug 6 0
  • I had this recent realization that I am not good with AI/ML field where you try to figure out data .. I rather be what I do now... backend software engineer .. reason for any decision is much more clear
    Aug 6 0
  • Microsoft hwaA15
    You nailed it.
    Aug 6 1
    • Oracle alwzangry
      Blind allows "nailed" now? Yay!
      Aug 6
  • Amazon tLFj05
    I have done deep learning. I left and joined as SDE. Deep Learning is less logical. You can always blame it on bad data. The model basically memorizes. If Deep Learning was not just that then Tesla would be self driving on all kind of roads.
    Aug 11 0