Personnaly I use ETL tools at work. However, most of large industries settle on using coders to do the integration and transformation ? Isn't it easier and time efficient to use tools and dynamically manage the data flow than having to write codes in terms of cost vs time chart?
i think most companies just aren’t aware of prebuilt ETL, the few that do know look down on them vs custom code. it’s like an intellectual superiority contest. at certain levels of scale ETL just doesn’t work effectively though, so maybe good to start ETL then once you out grow move pieces to custom coding
Oh how so? I have used SSIS, ODI,Talend, Informatica and each one of these tools seem to have the capability to do exactly what a custom code can...however, if organizations have a question on handling larger volumes of data to move across a VPN, we can always create a looping package to extract data, which is fairly quick....i guess it comes down to having user knowing how to custom create codes within the tool which can be rather useful..
one thing is dynamic throttling (eg slow down writes based on health of system) - hard to do on etl, easier to do in code
Never heard these names before. At many companies there is no good process to experiment with paid software that could be useful
Tech Industry
13h
2125
Go woke, go broke: Google fires 28 employees involved in pro-Hamas protest
2024 Tax
6h
1084
Biden’s new tax proposal is wild
2024 Presidential Election
2d
669
Who are you voting for?
Layoffs
Yesterday
34206
Google CFO confirms "large-scale" layoffs today (Apr 17)
Cars
Yesterday
1588
Why are Americans obsessed with SUV?
I think for the most part the pros of using a tool outweigh the cons.
Definitely! It makes sense rather than have coders write custom python and JAVA codes, cause making adjustments and using reusable templates gets rather tedious on hard coding!