Personnaly I use ETL tools at work. However, most of large industries settle on using coders to do the integration and transformation ? Isn't it easier and time efficient to use tools and dynamically manage the data flow than having to write codes in terms of cost vs time chart?
i think most companies just aren’t aware of prebuilt ETL, the few that do know look down on them vs custom code. it’s like an intellectual superiority contest. at certain levels of scale ETL just doesn’t work effectively though, so maybe good to start ETL then once you out grow move pieces to custom coding
Oh how so? I have used SSIS, ODI,Talend, Informatica and each one of these tools seem to have the capability to do exactly what a custom code can...however, if organizations have a question on handling larger volumes of data to move across a VPN, we can always create a looping package to extract data, which is fairly quick....i guess it comes down to having user knowing how to custom create codes within the tool which can be rather useful..
one thing is dynamic throttling (eg slow down writes based on health of system) - hard to do on etl, easier to do in code
Never heard these names before. At many companies there is no good process to experiment with paid software that could be useful
Tech Industry
Yesterday
3291
ByteDance is officially fucked
Tech Industry
2h
498
I wish I were East Asian instead of Vietnamese (Southeast Asian)
Tech Industry
Yesterday
2306
TESLA UP 14% AFTER HOURS 🎉🎉🎉🎉
Tech Industry
Yesterday
922
The new Tesla Model 3 P goes from 0-60 in 2.9 seconds
AMA
Yesterday
1885
I’m a professional coaster AMA
I think for the most part the pros of using a tool outweigh the cons.
Definitely! It makes sense rather than have coders write custom python and JAVA codes, cause making adjustments and using reusable templates gets rather tedious on hard coding!