Linaro Connect Bangkok

In this talk, we'll walk you through the up-to-date status of Big Data on AArch64, especially focus on improvements we've made to support big data components(Hadoop, Spark, etc) across platform, the contribution to Apache Bigtop, and the future roadmap.

Apache Bigtop as the open source Hadoop distribution, provides full functionality of packaging, testing, and deployment for users to build their own Hadoop Distro from ground up. Because of it's unique positioning, it is widely leveraged by not only ISVs(Cloudera, Hortonworks, Pivotal, ODPi, etc), but also cloud providers(AWE EMR, Google Cloud Dataproc). Laying on top of Bigtop's foundation, we've pushed the support of big data to the next level under the support of Open Data Platform Initiative(ODPi). To breakdown the details of this talk, we'll share about the enhancement of AArch64 support in Bigtop, how to run big data on AArch64 with Bigtop Provisioner and Sandbox at a click of button, how to build the support of AArch64 with Bigtop's docker based architecture, and how to test the result with a comprehensive CI coverage. Further more, the newly developed integration testing framework 2.0 in Apache Bigtop will be revealed.