Machine learning engineering and ML systems design resources master list

Dec 6, 2019 8 Comments

Hi Fellow Blinders,
I'm trying to make an ultimate thread of recommended ML/ML engineering resources. Contributions much appreciated. I'll add them to the OP.

Looking for anything, from resources for learning machine learning theory to deep learning to the latest trends in ML engineering and systems.

Thanks everyone!

Blind Posts:
List of papers recommended by a Pinterest employee: https://www.teamblind.com/article/ML-design-interview-3cYD0vdM

Books:
Convex Optimization (Boyd)
Introduction to Information Retrieval (Manning)
Elements of Statistical Learning
Introduction to Statistical Learning
Foundations of Machine Learning (Mohri)
Machine Learning Yearning by Andrew Ng (https://d2wvfoqc9gyqzf.cloudfront.net/content/uploads/2018/09/Ng-MLY01-13.pdf )
Smola ( https://alex.smola.org/drafts/thebook.pdf )

Blogs:

Airbnb ( https://medium.com/airbnb-engineering/tagged/machine-learning )
Amazon?
Deepmind ( https://deepmind.com/blog )
Facebook ( https://ai.facebook.com/blog/ )
Google ( https://cloud.google.com/blog/products/ai-machine-learning, https://ai.googleblog.com/, https://www.blog.google/technology/ai/,
Linkedin (https://engineering.linkedin.com/blog/topic/machine-learning)
Netflix ( https://research.netflix.com/research-area/machine-learning )
Pinterest ( https://medium.com/pinterest-engineering/machine-learning/home, https://labs.pinterest.com/projects/machine-learning/ )
Quora (https://www.quora.com/q/quoraengineering/Machine-Learning-at-Quora)
Stripe ? ( https://stripe.com/blog/engineering/ ),
Twitter ( https://blog.twitter.com/engineering/en_us/topics/insights.html )
Uber ( https://eng.uber.com/research/?_sft_category=research-ai-ml )

Courses:

Andrew Ng's original coursera course
Andrew Ng's deep learning courses
Bloomberg ML course
Fast.ai
https://developers.google.com/machine-learning/guides/rules-of-ml/

Misc:
Kaggle.com
Matrix and Gaussian Identity notes: https://cs.nyu.edu/~roweis/notes.html

Papers:
Software Engineering for ML (https://www.microsoft.com/en-us/research/uploads/prod/2019/03/amershi-icse-2019_Software_Engineering_for_Machine_Learning.pdf)
Hidden Technical Debt in ML systems ( https://papers.nips.cc/paper/5656-hidden-technical-debt-in-machine-learning-systems.pdf )

KDD
NIPS, I linked a single paper but it's a great source in general ( https://papers.nips.cc/paper/7595-probabilistic-matrix-factorization-for-automated-machine-learning.pdf )

People:

Yoshua Bengio
Fei-Fei Li
Trevor Hastie
Jiawei Han
Surya Ganguli
Michael Jordan
Guy Lebanon
Yann LeCun
Geoffrey Hinton
Gary Marcus
Andrew Ng
Robert Tibshirani
Ashutosh Saxena
Alex Smola

Videos:

Cracking the ML Design Interview:
Sample questions:
E-commerce, design a system that determines which site visitors should be sent a discount code.
Design a system for ranking the search results (Linkedin jobs, amazon shopping, etc)

comments

Want to comment? LOG IN or SIGN UP
TOP 8 Comments
  • Great initiative OP. Blind is probably not the most collaborative tool for this, can you create/share a google doc?
    Dec 6, 2019 2
    • Indeed / Eng rainwater
      OP
      I'd prefer people just post here, it will help with visibility when the content is directly on the thread. Not opposed to creating a google doc though, but let's see how it goes here first.
      Dec 6, 2019
    • In addition to collaboration here can you please provide a read-only compilation in a Google doc or some other tool (Github repo would be best) it’s hard to follow it here. Thanks 🙏
      Dec 6, 2019
  • Google 0ccupyMars
    What’s annoying is getting an ML interview. Even if I go through this, I can’t get FAANG to give me an ML interview. I guess I need to do side projects?
    Dec 6, 2019 3
    • Indeed / Eng rainwater
      OP
      In the meantime is there anything you would add to the list? Especially ml systems design I feel like that area is harder to find resources for studying.
      Dec 6, 2019
    • Google 0ccupyMars
      I cant get an ML team to take me without ML job experience. Nobody cares about courses.
      Dec 7, 2019
  • American Century Investments aci1942
    Coursera has a free course (50+ hrs of videos) on machine learning taught by a Stanford professor
    Dec 10, 2019 0

Salary
Comparison

    Real time salary information from verified employees