Use prediction of ml algorithm as groundtruth for another ml model?

How stupid this idea is?

New
jPsc7 Feb 10, 2023

Not stupid if the first model is well trained. It’s actually a good approach. But you’ll have to monitor for data drift of the first model. You can also fine tune the first model by backpropagating from the loss of the second model. works pretty well in my experience

Meta SirGPT Feb 10, 2023

What purpose or use case are you imagining? Several ML architectures have one model work on the outcome of another model. Like GANs have a discriminator model that works on the output of a generator model. Boosting models connect sequentially with one model working on the residuals of the output from previous model. But if you're just simply connecting model x and model y sequentially, i.e. not even doing a teacher-student arrangement, you basically just have a hybrid model x+y with different loss functions and backprops for part x and part y.

Adobe downBadd Feb 10, 2023

You’re ahead of your time

New
can't code Feb 10, 2023

If ml 1 is expensive external service, makes sense to use its output to train an in-house ml 2, which you can call for free

OfferUp attaahas Feb 10, 2023

that's what Transfer Learning is all about

American Express YgLM33 Feb 10, 2023

Transfer learning is training on model on a task, and then applying it to another task. This isn't transfer learning.

OfferUp attaahas Feb 11, 2023

you can choose a pretrained model to generate raw intermediate outputs to feed in a downstream model, you can also fine tune the pretrained model on your domain before using the output in another model ... in both cases it will be transfer learning .. and will be using a model's ground truth in some form to feed into another model ..go improve your understanding of TL first

American Express YgLM33 Feb 10, 2023

Are there other options for generating the ground truth labels?

New
guoynm Feb 10, 2023

House of mirror.

United States Postal Service mjBV15 Feb 10, 2023

why do you want to do that ? why not use the other model?

JPMorgan Chase feliznavid Feb 11, 2023

This is called meta learning.

Flagged by the community.
Meta SirGPT Feb 12, 2023

@CommieKing What is a b-player?

Meta CommieKing Feb 12, 2023

Folks hired at Meta in the last few years. Also, most folks everywhere else. Also folks who need to ask such questions.