I am a founder of Databricks. Before that, I was a PhD student and then Postdoc in Computer Science in the AMPLab at the University of California, Berkeley. The focus of my research and work is on large scale distributed computing systems like Hadoop, Spark, and Mesos.
In particular, I am interested in resource management, scheduling, and rapid application development in cluster environments. I’ve worked on scheduling in Hadoop. I was one of the creators of Apache Mesos, a cluster scheduling system that was adopted by Twitter, Apple and other companies as their private cloud platform. Mesos also spurred the creation of Mesosphere, a startup built around the project. I worked with systems engineers and researchers at Google on Omega, their next generation cluster scheduling system. I am passionate about seeding and building open source communities; I led the creation of Berkeley AMP Camps and the Apache Spark Summits.