hooglsupreme.blogg.se - Intellij remote debug

#Intellij remote debug how to
#Intellij remote debug trial
#Intellij remote debug download

You see a list of head nodes, worker nodes, and zookeeper nodes. From the cluster blade, select Dashboard. Step 3: Verify the connectivity between the cluster head node and your desktop As part of optional configuration, select the Azure virtual network that you created in the previous step. Use the information available in Create Linux-based clusters in HDInsight. We recommend that you also create an Apache Spark cluster in Azure HDInsight that is part of the Azure virtual network that you created. Step 2: Create an HDInsight Spark cluster Configure a point-to-site connection to a virtual network using PowerShell.

Create a VNet with a site-to-site VPN connection using PowerShell.Create a VNet with a site-to-site VPN connection using the Azure portal.Add an HADOOP_HOME environment variable, and then set the value of the variable to C\WinUtils.įollow the instructions from the following links to create an Azure virtual network, and then verify the connectivity between your desktop computer and the virtual network:

#Intellij remote debug download

To work around this error, you must download Winutils.exe to a location such as C:\WinUtils\bin. This exception is explained in SPARK-2356 and occurs due to a missing WinUtils.exe file in Windows. While running the Spark Scala application for remote debugging on a Windows computer, you might get an exception. Follow the instructions in Use Azure Toolkit for IntelliJ to create Apache Spark applications for an HDInsight cluster. Sign in to your Azure Subscription from IntelliJ IDEA.

#Intellij remote debug how to

For instructions on how to install Azure Toolkit, see Install Azure Toolkit for IntelliJ. HDInsight tools for IntelliJ are available as part of Azure Toolkit for IntelliJ.

HDInsight Tools in Azure Toolkit for IntelliJ.

You can install it from the JetBrains website. You can install it from the Oracle website. For instructions, see Create Apache Spark clusters in Azure HDInsight.

#Intellij remote debug trial

For more information, see Get a free trial of Azure.

Create a Scala application in IntelliJ IDEA, and then configure it for remote debugging.

Verify the connectivity between the cluster head node and your desktop.

Create a Spark cluster in HDInsight that is part of the site-to-site virtual network.

The steps in this document assume that you use a site-to-site network.

Create a site-to-site or point-to-site Azure virtual network.

To complete these tasks, you must perform the following high-level steps: This article provides step-by-step guidance on how to use the HDInsight Tools in Azure Toolkit for IntelliJ to submit a Spark job on an HDInsight Spark cluster, and then debug it remotely from your desktop computer. For instructions, see Remotely debug Apache Spark applications on an HDInsight cluster with Azure Toolkit for IntelliJ through SSH. We recommend debugging Apache Spark applications remotely through SSH.