Apache Kafka on HDInsight with Azure Managed Disks
Share
Services
We’re pleased to announce Apache Kafka with [Azure Managed Disks](https://azure.microsoft.com/en-us/services/managed-disks/) Preview on the HDInsight platform. Users will now be able to deploy Kafka clusters with managed disks straight from the Azure portal, with no sign-up necessary. This will offer the powerful advantage of exponentially higher scalability, and much lower costs as workloads scale.
A few months ago [we announced](https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=5&cad=rja&uact=8&ved=0ahUKEwi2ge%5FF-LrUAhUhS5oKHWZFAg4QFghCMAQ&url=https%3A%2F%2Fchannel9.msdn.com%2FShows%2FAzure-Friday%2FIntroducing-Apache-Kafka-on-Azure-HDInsight&usg=AFQjCNE9K8XAt-z0ppbTkFYk6bgbsEbduw&sig2=1JR8uoivaE9PURAqCjqeSg) a limited preview of [Managed Kafka on Azure HDInsight](https://azure.microsoft.com/en-us/services/hdinsight/apache-kafka/). The addition of Kafka on HDInsight will complete the ingestion piece for scalable open-source streaming on Azure. In addition to the scale and performance benefits of Apache Kafka, HDInsight Kafka customers will get the following advantages:
· The promise of a managed open-source Kafka backed by a [99.9% uptime SLA](https://azure.microsoft.com/en-us/support/legal/sla/hdinsight/v1%5F0/?v=17.23h).
· Managed rebalancing of replicas and partitions across Azure update domains and fault domains. This will ensure high availability of Kafka partitions on environments with a multidimensional view of a rack. This tool is also [open sourced here](https://github.com/hdinsight/hdinsight-kafka-tools).
· Security and compliance benefits of [Azure](https://www.microsoft.com/en-us/TrustCenter/Compliance) and [HDInsight](https://azure.microsoft.com/en-us/services/hdinsight/?v=17.23h) with certifications such as SOC, PCI and DSS.
* An integrated experience for deploying a managed and secure streaming pipeline (Kafka, Storm or Spark streaming) within minutes via pre-built architectures on Azure Resource Manager templates.
Learn more about [the advantages of Apache Kafka with Azure Managed Disks](https://azure.microsoft.com/en-us/blog/announcing-public-preview-of-apache-kafka-on-hdinsight-with-azure-managed-disks/?v=17.23h).
* Managed Disks
* Features
* [ Managed Disks](https://azure.microsoft.com/en-gb/services/managed-disks/)
What else is happening at Microsoft Azure?
Read update
Services
Share
Read update
Services
Share
We’re retiring Azure Time Series Insights on 7 July 2024 – transition to Azure Data Explorer
May 31st, 2024
Services
Share