why is python still used for microservices at Lyft?

Jan 23 16 Comments

a lot of companies have moved away from python except for data science and adopted go for services. Lyft already gifts 14 cents from every ride to Amazon. Why doesn’t it try to reduce its AWS footprint by using a more efficient stack? With python, there’s no true multithreading due to the global interpreter lock, so you need different processes, with each having their own copy of the code in memory. The end result is that you need a whole lot of computing resources to scale.
#python #aws #go #makingbezosrich

comments

Want to comment? LOG IN or SIGN UP
TOP 16 Comments
  • Facebook hblk
    Lyft has no infra
    Jan 23 0
  • Python GIL is more of an issue for cpu bound workloads, but most backend systems are doing work that is io bound.
    Jan 23 1
    • OP
      Web frameworks add a lot of overhead. A lot of cpu cycles are spent doing things behind the scenes Like http parsing, deserialization, etc.
      Jan 23
  • Google eFcb15
    If they are using real awas lambdas then there is no real difference to switching to another language if its written well. In AWS the 2 biggest sink holes for spend are unused / underused epcs and detached storage that is no.longer needed. At my last company we built a lot of automation to be able to spin up test environments as needed for builds and testing and it saved a ton.

    So if you really want to make a difference work on thier devops systems they will pay in spades if you do
    Jan 23 0
  • Lyft LmRM52
    We are in process to migrating all the work to php by end of 2020.
    Jan 24 2
    • Facebook hblk
      Do you guys have your own hhvm and powerful cpp backend?
      Jan 24
    • Lyft LmRM52
      Wtf is that?
      Jan 24
  • Microsoft lather
    Lyft is useless stack
    Jan 23 0
  • Lyft Tgvyhb
    We are moving to Fortran and lisp
    Jan 24 1
    • Love it.
      Should I go so a boot camp to be prepared?
      Jan 24
  • Lyft / Eng vRju16
    Some is in Python, but most new stuff is in go. It's hard to justify porting over existing python code short of giving interns projects
    Jan 24 1
    • Uber basket
      ROI could be there if it’s saving you cores
      Jan 24
  • Dropbox 🐝hind
    Just migrated a bunch of dynamically generated functions from Python to Go recently, wasn’t fun.
    Jan 28 0
  • we are moving to Rust
    Jan 24 0
  • Intel
    This&That

    Intel

    PRE
    Fujitsu Global
    This&Thatmore
    The memory and cache layer + compiler is the real question to ask. These days python is viewed as scripting almost and less of a real (heavy engineering) language.

    Great for applications but crappy for performance and microservices.
    Jan 23 0

Salary
Comparison

    Real time salary information from verified employees