Recent Blog Entries
I am a cofounder of Databricks, currently busy organizing the first Spark Summit. Before that, I was a PhD and then Postdoc in computer science in the AMPLab at the University of California, Berkeley. I’m focused on large scale distributed computing systems, such as those used by web companies like Google, Facebook, and Yahoo!
In particular, I am interested in resource management, scheduling, and rapid application development in cluster environments. I’ve worked on scheduling in Hadoop. I was one of the three creators of Mesos, a cluster scheduling system that has been adopted by Twitter as their private cloud platform. I recently worked with systems engineers and researchers at Google on Omega (Eurosys paper), their next generation cluster scheduling system.
More recently, I’ve been contributing to Spark, a cluster-scale in-memory analytics engine.
I lead the UC Berkeley AMP Camps, hands-on big data training workshops hosted by the AMPLab. I was also one of the graduate student founders of the Berkeley Computer Science Graduate Entrepreneurs (CSGE), whose vision is to build a thriving culture of entrepreneurship inside Berkeley EECS.