Just like the system design blogs of popular sites like Netflix, fb etc, is there any other website where you can find how the ml models are being deployed at scale?
TFX is your friend
Thanks :) , will have a look.
You deploy it as anything else and horizontally scale it. Make sure you version your models.
Can you recommend nny good amazon blogs on ml at scale?
If you are running run of the mill ml, logistic regression , random forests etc ; the difficult part is feature computation at scale. If your features rely on a lot of aggregations , then that’s the challenging part - the model computation is straight forward lambda and can be horizontally scaled - aggregates features require a lot more thought and engineering - and you have to consider trade offs and lift you get.
Read about Michealangelo (Uber), FBLearner (FB), Tensorflow Serving etc
How did you learn OP?
Not at Cisco
Weird, because we do for our website...and quite well, actually. Stop hating on your own company — no one is forcing you to stay here man. If you don’t like it, leave.
@Cisconian- Curious, how are we applying machine learning on our website?