ML at Scale

Just like the system design blogs of popular sites like Netflix, fb etc, is there any other website where you can find how the ml models are being deployed at scale?

Cisco IT admin Jul 29, 2018

Not at Cisco

Cisco Cisconian Jul 29, 2018

Weird, because we do for our website...and quite well, actually. Stop hating on your own company — no one is forcing you to stay here man. If you don’t like it, leave.

Cisco Gtzmb OP Jul 29, 2018

@Cisconian- Curious, how are we applying machine learning on our website?

Google GoogGoogl Jul 29, 2018

TFX is your friend

Cisco Gtzmb OP Jul 29, 2018

Thanks :) , will have a look.

Amazon piora Jul 29, 2018

You deploy it as anything else and horizontally scale it. Make sure you version your models.

Cisco Gtzmb OP Jul 29, 2018

Can you recommend nny good amazon blogs on ml at scale?

Apple CptHaddock Jul 29, 2018

If you are running run of the mill ml, logistic regression , random forests etc ; the difficult part is feature computation at scale. If your features rely on a lot of aggregations , then that’s the challenging part - the model computation is straight forward lambda and can be horizontally scaled - aggregates features require a lot more thought and engineering - and you have to consider trade offs and lift you get.

Knewton hurry Jul 30, 2018

Read about Michealangelo (Uber), FBLearner (FB), Tensorflow Serving etc

Axtria proud lodu May 20, 2020

How did you learn OP?