Is data engineering a good field for the next 20 years? Talking about ETL pipelines, computing and processing big data, connecting data sources together, etc Not talking about data analytics/sql analysis
I work as a Senior Data Engineer and have worked on AWS, Azure and Databricks; therefore I think I can answer. 1) Data is growing everyday, hence "Big Data" - tools and practices may change but data engineering will thrive in future. 2) In fact, it's thriving NOW - don't believe me, check LinkedIn, Naukri, Indeed - all companies are actively hiring Data Engineers and have formed new teams which are responsible for creating POC around it. 3) The candidates expect to have more / extra knowledge apart from plain data engineering - as in CI / CD integration of ETL Pipelines, learning GitHub Actions and REST API, low code no code tools like prophecy and their use case 4) Companies are forming giant data lakes to treat structured / semi - structured/ un-structured data that means any tool which can be integrated to treat such data are likely to stay in the market even after 20 years. What I personally believe is that blob storage is likely to grow more in terms of functionalities.
20 years? Nobody has a good idea what jobs will be around in the next 5, let alone 20
Not really. Now that Salesforce is buying Informatica the market will collapse and anyone will be able to do it Find another career.
India
13h
2712
Why is it so G*damn difficult to move money out of India
Ask Blinders
18h
774
Why Pronouns shit captured US ? I don’t see this anywhere else
Cars
Yesterday
1791
Cyber truck killer: Chinese version of EV truck
Tech Industry
Yesterday
3613
I do tech screens at Google. AMA
AMA
Yesterday
2870
I have worked at TikTok US core tech for 3 years. AMA.
I am a data engineer and hope it stays relevant until I retire