Database Internals future scope

Credit Karma 🐨Koala
Oct 26 27 Comments

Wanted to work on some distributed database systems like GCP Spanner, AWS DynamoDB etc. and thinking to apply to some of these positions.
However, what is the future scope after working in those teams for few years? Is it easy to switch back to generic SDE? (I think generic SDE makes more money)

comments

Want to comment? LOG IN or SIGN UP
TOP 27 Comments
  • Microsoft presci
    What makes you think people working on those products are not generic SDE?
    Oct 26 12
    • Flipkart tera-bhai
      "I am sure 99% of SDE can't code Paxos" : It's like saying that 99% of SDE can't code Segment Trees, which is wrong. We definitely can code whatever algorithm you ask, but we don't generally get the opportunity to do it in our day to day job. It seems like you are not interested in the job you are getting and are trying to find reasons to reject it. But I would say not being interested is a good enough reason to reject it. On the other hand if you try to find reasons to accept it, one that I can give is consider yourself designing and implementing complex but maintainable system software, do you think after doing such work you'll find it harder to do the "generic SDE work" like building simple CRUD based microservices or building websites or building mobile apps?
      Oct 26
    • Credit Karma 🐨Koala
      OP
      I am actually very interested in system level software. I just didn't wanted to limit future opportunities that's it.
      I know a system level engineer can definitely write CRUD software microservices, no doubt about it.
      Does industry understands this (I mean hiring managers)? I have seen HMs or Recruiters decline applications because of insufficient React experience!
      I am in early stage of my career and got interested into this but worried about future opportunities so need a perspective from industry? Like if you are HM, would you hire a person who knows distributed systems and DB internals or hire someone who have solved CRUD business problems with industry trending tools like GraphQL, React, CircleCI etc.
      I hope you get my question now? 😅
      I 100% know a person writing distributed storage can write CRUD but read on blind like infra to product is difficult move hence curiosity.
      Oct 26
    • Microsoft presci
      Op, if you believe that we don’t receive tons of emails from recruiters of all the leading companies around, you are in for a surprise.
      Oct 26
    • Credit Karma 🐨Koala
      OP
      @Microsoft I am here for advice. I may sound naive but I am early in my career so just wanted to make sure this will not be a career limiting move that's it.
      If not, I am actually excited about taking up this challenge. I always wanted to solve distributed system problems. (I have never solved it and it may be possible I don't like it after a year so was asking experienced people like you that if I am passionate but I don't like when I try, there is a way out or not that's it 😅)
      Oct 26
    • Amazon alfrrd
      > Job description is like you should develop system software, caching, indexing, transaction processing, logging, locking, quorum, buffer management etc.
      I don't think I or any of my other SDE friends do these things. I am evaluating if this can be a wrong career move for future opportunities.

      Let’s stop and think for a second. How many engineers get the opportunity to develop such a deep level of expertise and how many become CRUD monkeys? How could this even remotely be a wrong move?!?
      Oct 26
  • Amazon AWS-Engr
    You're probably mixing web/app development work with cloud. Cloud isn't there to make pretty websites or apps. It's there to handle the back end infrastructure behind those pretty websites and apps. Your offer from Aurora is still in the scope of an SDE. You might not be used to it since you work at CK (not undermining CK - just different work)

    To answer your question, yes there is tons of scope. DynamoDB and GCP Spanner aren't going anywhere anytime soon. Idk what you mean by 'generic SDE', but I assure you that the engineers behind these products are well compensated and are working on challenging business problems.
    Oct 26 10
    • Credit Karma 🐨Koala
      OP
      Cool.
      Yeah I thought same about passing interviews outside Amazon then with this experience. This is what I was looking for.
      Thanks a lot :)
      Oct 26
    • Amazon alfrrd
      Are you at Aurora now? I believe it’s actually the opposite. Engineers who can code Paxos and who can design and build sysyems like DynamoDB and Spanner are usually way smarter and way more valuable than generic CRUD-app-building engineers let alone frontend monkeys who sling React garbage.
      Oct 26
    • Credit Karma 🐨Koala
      OP
      @alfrrd joining AWS Aurora soon! Any idea how's team and product?
      Oct 26
    • Amazon alfrrd
      DM me.
      Oct 26
    • Credit Karma 🐨Koala
      OP
      You have DMs left? My DM for this month are over. Can you please DM 😕
      Oct 26
  • Amazon aws_af
    There is definitely scope for people with those skills. But most business needs are building curd applications. You can check out production engineer, sre , system dev roles. But all of them involve being oncall .
    Oct 26 1
    • Credit Karma 🐨Koala
      OP
      But my question is can I switch teams that build CRUD apps later? Specially at Amazon itself?
      I don't want to be an SRE or PE. I want to stay at my current title SDE.
      Oct 26
  • Google / Eng
    EngElder

    Google Eng

    PRE
    Microsoft
    EngEldermore
    If you're good you'll make much more money as a systems developer. That is a much rarer and more valuable skill set...
    Nov 13 0

Salary
Comparison

    Real time salary information from verified employees