The Architect of Scale: Ion Stoica on Open Source, AI, and the Future of Data

Ion Stoica is a professor of computer science at UC Berkeley, Co-Founder and Executive Chairman of Databricks, and a key architect of the Apache Spark project. Most recently, he’s the Co-Founder of Anyscale, which leverages the open source Ray framework developed in-lab to enable scalable AI workloads, much like Spark revolutionized large-scale data processing.

In this episode of The Data T, we chat with Stoica about his illustrious career, how his obsession with solving hard technical problems led him from networking research to peer-to-peer video, Apache Spark, and ultimately Databricks. He recounts turning Spark’s open-source momentum into a successful enterprise business, crediting speed of execution and targeted hiring  ...