Data engineer

Oct 19, 2016 9 Comments

Thinking to move from a developer to data engineer role.

Does data engineer still code though? Or are the jobs mostly about configuration and tuning?

comments

Want to comment? LOG IN or SIGN UP
TOP 9 Comments
  • Yahoo
    ItsTime

    Go to company page Yahoo

    ItsTime
    On the contrary to the above comments, I like data more than the never ending spring coding. I have learnt zero things in the past 4-5 years on application development. But learned more than I wanted after making a switch to being a data engineer. It is still booming with new concepts everyday (streaming, iot, deep learning in cloud). There is so much to learn from the data itself. I would rather bring a new insight to the team on how the business can be improved rather than adding/changing REST interfaces and DTO objects
    Oct 20, 2016 4
  • I wouldn't make that move; I think it's a downgrade.
    Oct 19, 2016 0
  • It's like changing from a toilet janitor to a full time plumber. Unless you're as good as the person who invented data sketch in yahoo, there ain't anything too interesting imo
    Oct 19, 2016 0
  • Depends on the team and project, but usually yes, you're developing data systems. You'll also seek optimization opportunities through configuration (same as a service developer) and write data queries.
    Oct 19, 2016 0
  • Amazon
    dataiq

    Go to company page Amazon

    dataiq
    Or may be you want to consider moving as a software engineer in a database company like MongoDb, Snowflake. As a DE you don't have control over the database internals. You can only optimize your queries, distribution, partition keys rest you have to be dependent on the product. If you want to analyze data, you want to be a data scientist who uses EMR, spark, tensor flow to find patterns in data.
    Jan 27, 2019 0