What differentiates Databricks from Snowflake?
I don't know much about Databricks. But Snowflake execs/founders seemed like a different league with solid database chops. How is Databricks different? And more importantly how will they even compete? The senior people who have gone there from Google don't inspire much confidence. You need high levels of experience to work on database stuff.
Oh that’s for the info, is IBM where careers go to the moon?
Don't worry about it. You only need to know databricks provides higher packages, while snowflake doesn't. That's why lots of googler moved to databricks, while no one care about snowflake. This doesn't necessarily mean databricks will perform better than snowflake as a company. Like MSFT and amzn have better stock performance than google.
You would Be surprised how many google people are now at Snowflake.
Both will do fine — Snowflake may do better because of interactive sql queries and the bigger analytics market.
Databricks has that too. It is a one stop shop for analysts, data engineering, data scientists. You don’t even need to move the data around. Single platform called lakehouse.
Mmm, you can call it interactive but Spark SQL is not as performant as Snowflake for low latency use cases and the work load management is behind.
I like snowflake because they are beating AWS Redshift and GCP BigQuery … somethings they are doing right
Can you please elaborate the term "beating". Performance wise, cost or feature set?
I know there is a positive vibe with snowflake with customers than Redshift, which is also a parallel database just like Snowflake, but Amazon bought the codes from another company and deployed it (and killed bunch of the earlier SAS data warehouse startups). But AWS can’t support it and it’s buggy with operation issues. BigQuery is only on GCP so it is limiting factor.
You can consider the difference between MapReduce/Flume and Dremel/Procella/F1. The two companies were started for different areas in big data. Now, both of them want to extend to the other one’s area. Who will succeed? I guess it’s too early to say, although I have obvious preference.
An actual thread with learning opportunity, wtf?
Lol
Databricks does a lot of more than just databases, so we do not only have to hire folks with database experience. The folks from Google that we have hired to actually work on database internals have worked on F1, Procella, Mesa/Napa, and BigQuery at Google.
People hired from Ads haven't built any of this. Of course, you might also be getting folks who worked on the data systems.
Have you heard of Cloudera’s Impala (May be not as it is not popular).. it was build by ex google data systems people who worked on those projects you mentioned above. So, no correlation between hiring ex google engineers and the success of product/company.
Databricks is a spin off from UC Berkeley’s RISE/AMP lab and is started by Stoica and a few Berkeley PhD students. Databricks founding team is as elite as it gets
The Snowflake guys are ex-Oracle and they have built systems before. Databricks is more of a univ. spinout.
In what world is "ex-Oracle and built systems" prestigious 👀. Imagine having founders that were PhD students at a prestigious uni. No chance of success there. Oh wait there was some small search engine company that came from Stanford grad students, the name slips my mind but I'll let you know when I remember. 🤔 Edit: I remember now, company is called Google
Personal experience: seen both, Databricks has the better / more elite founding team. Also, Databricks has the better engineers atm. But snowflake is a great company too.
An enterprise needs both systems for slightly different use cases but also have overlapping uses. So, its up to leadership, sales and marketing to make it successful in the enterprise.. not some start engineers or popular professors with PhD…
Yes but this is innovation-heavy territory. Sales and marketing can only do so much.
Wait are you actually dumb? Snowflake founders seem like a different league...? Databricks founders include the guy who literally invented Spark...
You don’t have to be so ignorant and call the person dumb, I wonder how your spouse is tolerating your personality
I know he built Spark. So...?