Hi All! I currently have 3.5 years experience in primarily Teradata Architecture/ Development shop and looking to transition into Data Engineering. My current skillset is: Teradata SQL, Query Performance Tuning, writing Teradata BTEQ scripts, Unix, assessing Teradata data integration products, AutoSys, and basic Python. I also briefly dabbled little bit with Hive. I understand that most interviews are based on ETL+sql+python+data modeling plus questions around my current experience. 1)Where do you suggest starting? 2)What kind of data engineering projects would you recommend creating? 3)what courses you recommend to get a solid recap of Python? Which areas in Python to focus for interviews? 4) which data structures and algorithms you suggest to learn/practice? Any resources on here ? I know it’s a long road for me but I’m committed to learning and definitely want to move into a data engineering role. Thanks! Looking to hear from you ! TC:110k #tech ###tech
Learn python $& airflow & dbt Start scraping data and dump it into random tables Build data pipelines to do some transformations Stand up dashboards to visualize the data Do this for 50 websites (or just even GitHub) This project work will give you the skill set needed to 1) get your resume flagged for screens 2) have the right skill set to pass interviews
Data Engineering is different everywhere so it depends on where you want to work. 1) Go to reddit r/dataengineering. This question is asked daily so use the search and the wiki first to get the easy questions out of the way 2) You won't have to bother with this depending on where you want to work. You can focus on SQL, Python, Data Modeling and company specific stuff which you can search for on Blind. 3) Mostly focus on DSA. Some places will ask you to code APIs calls using requests or do assertion tests so learn that stuff too. 4) https://neetcode.io/practice you will be fine understanding how to do everything easy and medium above linked lists.
Thanks! For #3, which specific DSA topics would you recommend?
Check number 4 for the DSA topics. Invest in an algo book if you have time.
Get AWS Data engineering certification. That would give a boost to your confidence and resume. Read the "Fundamentals of Data Engineering" book.