Maintained with ☕️ by
IcePanel logo

Apache Kafka on HDInsight with Azure Managed Disks

Share

Services

We’re pleased to announce Apache Kafka with [Azure Managed Disks](https://azure.microsoft.com/en-us/services/managed-disks/) Preview on the HDInsight platform. Users will now be able to deploy Kafka clusters with managed disks straight from the Azure portal, with no sign-up necessary. This will offer the powerful advantage of exponentially higher scalability, and much lower costs as workloads scale. A few months ago [we announced](https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=5&cad=rja&uact=8&ved=0ahUKEwi2ge%5FF-LrUAhUhS5oKHWZFAg4QFghCMAQ&url=https%3A%2F%2Fchannel9.msdn.com%2FShows%2FAzure-Friday%2FIntroducing-Apache-Kafka-on-Azure-HDInsight&usg=AFQjCNE9K8XAt-z0ppbTkFYk6bgbsEbduw&sig2=1JR8uoivaE9PURAqCjqeSg) a limited preview of [Managed Kafka on Azure HDInsight](https://azure.microsoft.com/en-us/services/hdinsight/apache-kafka/). The addition of Kafka on HDInsight will complete the ingestion piece for scalable open-source streaming on Azure. In addition to the scale and performance benefits of Apache Kafka, HDInsight Kafka customers will get the following advantages: · The promise of a managed open-source Kafka backed by a [99.9% uptime SLA](https://azure.microsoft.com/en-us/support/legal/sla/hdinsight/v1%5F0/?v=17.23h). · Managed rebalancing of replicas and partitions across Azure update domains and fault domains. This will ensure high availability of Kafka partitions on environments with a multidimensional view of a rack. This tool is also [open sourced here](https://github.com/hdinsight/hdinsight-kafka-tools). · Security and compliance benefits of [Azure](https://www.microsoft.com/en-us/TrustCenter/Compliance) and [HDInsight](https://azure.microsoft.com/en-us/services/hdinsight/?v=17.23h) with certifications such as SOC, PCI and DSS. * An integrated experience for deploying a managed and secure streaming pipeline (Kafka, Storm or Spark streaming) within minutes via pre-built architectures on Azure Resource Manager templates. Learn more about [the advantages of Apache Kafka with Azure Managed Disks](https://azure.microsoft.com/en-us/blog/announcing-public-preview-of-apache-kafka-on-hdinsight-with-azure-managed-disks/?v=17.23h). * Managed Disks * Features * [ Managed Disks](https://azure.microsoft.com/en-gb/services/managed-disks/)