Artificially scaling an app

Microsoft / Eng hebcie8h2
Apr 13 12 Comments

A nOOb learning Scalability. Not much real world experience in scaling out. Doing a side project to learn scalability and the pain points.

Started with a MVP and now planning a load test and slowly up the load to say (3K Req/sec and may be more) to see how far my design can hold.

1) Will this teach me queues, pub/sub, sharding, load balancing and yada yada for the system design?
2) Is this the closest to real world learning for someone like me?
3) Or is this no better than reading theoretical stuff and I'm just wasting my time.?
4) Lastly, how do I mimic failovers?

Using a combination of Azure/AWS to max out my free quota and then some more. For those interested in the tech stack, leveraging JMeter to load test a NodeJS app hosted on an EC2 spot instance. Yet to figure out a barebone way to scale Dynamodb vs the built-in options.

Perhaps this isn't blind's forte may be a quora or stack overflow stuff. There are a few good thoughts here before I explore other channels.

TC: Sr SDE 220K

comments

Want to comment? LOG IN or SIGN UP
TOP 12 Comments
  • ViaSat ggcgvv
    SRE is a good way to learn scalability. They do a lot of scalability.
    Apr 13 3
    • Microsoft / Eng hebcie8h2
      OP
      You mean move into an SRE role?
      Apr 13
    • ViaSat ggcgvv
      Yep. If a company’s SRE is really SRE, not system engineer or devops renaming, then they handle a lot of scaling stuffs which is really cool.
      Apr 13
    • Microsoft / Eng hebcie8h2
      OP
      I had to fight my way and traded a down level for a SDE role. Changing tracks again isn't going to fly :(
      Apr 13
  • Oath / Mgmt Atinlay2
    You’re a senior sde and don’t know this?
    Apr 13 3
    • Microsoft / Eng hebcie8h2
      OP
      Lateral move to SDE and so the question.
      Apr 13
    • Oath / Mgmt Atinlay2
      That’s not what your post says
      Apr 13
    • Microsoft / Eng hebcie8h2
      OP
      It says "Not much experience scaling out". The point here is now I'm a Sr SDE and looking for help. I didn't want to deviate too much into how I got here vs clearly stating my *ask*
      Apr 13
  • Build a slack clone just the backend or a very minimal frontend
    Apr 13 0
  • IBM / Eng pussylick
    Sr sde is not noob
    Apr 13 1
    • Microsoft / Eng hebcie8h2
      OP
      Well, I made a lateral move to Sr SDE. Not from a system design background previously.
      Apr 13
  • Apple / Eng Yoyoboi
    Lol at Quora for technical questions tho
    Apr 13 0