Edit

Share via


Azure HDInsight release notes

This article provides information about the most recent Azure HDInsight release updates. For information on earlier releases, see HDInsight Release Notes Archive.

Summary

Azure HDInsight is one of the most popular services among enterprise customers for open-source analytics on Azure. Subscribe to the HDInsight Release Notes for up-to-date information on HDInsight and all HDInsight versions.

To subscribe, click the watch button in the banner and watch out for HDInsight Releases.

Release Information

Release date: Apr 28, 2025

Note

This is a Hotfix / maintenance release for Resource Provider. For more information see, Resource Provider.

Azure HDInsight periodically releases maintenance updates for delivering bug fixes, performance enhancements, and security patches ensuring you stay up to date with these updates guarantees optimal performance and reliability.

This release note applies to

HDInsight 5.1 version.

HDInsight 5.0 version.

HDInsight 4.0 version.

HDInsight release will be available to all regions over several days. This release note is applicable for image number 2501080039. How to check the image number?

HDInsight uses safe deployment practices, which involve gradual region deployment. It might take up to 10 business days for a new release or a new version to be available in all regions.

OS versions

  • HDInsight 5.1: Ubuntu 18.04.5 LTS Linux Kernel 5.4
  • HDInsight 5.0: Ubuntu 18.04.5 LTS Linux Kernel 5.4
  • HDInsight 4.0: Ubuntu 18.04.5 LTS Linux Kernel 5.4

Note

Ubuntu 18.04 is supported under Extended Security Maintenance(ESM) by the Azure Linux team for Azure HDInsight July 2023, release onwards.

For workload specific versions, see HDInsight 5.x component versions.

Issues fixed

  • Managed identity-based authentication for WASB encounters issues when network ACL is enabled on storage.
  • Managed identity-based authentication for SQL databases encounters issues when availability zones are used.
  • Multiple security fixes.

Updates

  • Active PIN requests for creating HDInsight clusters with predetermined image versions will be revoked/cancelled on 26 May 2025. Beyond this date, customers will only be able to create clusters using the updated (compliant) images of each HDInsight version. This measure is intended to improve cluster security and prevent potential issues with clusters and gateway nodes.

Reminder

  • HDInsight service transitioned to use standard load balancers for all its cluster configurations due to deprecation announcement of Azure basic load balancer.

    Important

    By default, creation of any new HDInsight cluster happens with Standard Load Balancers. We recommend referring to the migration guide to recreate the cluster. For any assistance, contact support.

  • Basic and Standard A-series VMs Retirement.

    • On August 31, 2024, we'll retire Basic and Standard A-series VMs. Before that date, you need to migrate your workloads to Av2-series VMs, which provide more memory per vCPU and faster storage on solid-state drives (SSDs).
    • To avoid service disruptions, migrate your workloads from Basic and Standard A-series VMs to Av2-series VMs before August 31, 2024.

If you have any more questions, contact Azure Support.

You can always ask us about HDInsight on Azure HDInsight - Microsoft Q&A.

We're listening: You’re welcome to add more ideas and other topics here and vote for them - HDInsight Ideas and follow us for more updates on AzureHDInsight Community.

Note

We advise customers to use to latest versions of HDInsight Images as they bring in the best of open source updates, Azure updates, and security fixes. For more information, see, Best practices.

Next steps