Cmdlets

Choose a cmdlet from the list on the left or search for a specific cmdlet. Choose a cmdlet from the list or search for a specific cmdlet.
About Help  Providers
 

Add-AzureHDInsightConfigValues

Add-AzureHDInsightConfigValues

microsoft.windowsazure.commands.hdinsight.dll

Synopsis

Adds a Hadoop configuration value customization and/or a Hive shared library customization to the Microsoft Azure HDInsight cluster configuration.

Syntax

Add-AzureHDInsightConfigValues [-Config] [-Core] [-Yarn] [-Hdfs] [-Hive] [-MapReduce] [-Oozie] [-Storm] [-HBase] [<CommonParameters>]

Detailed Description

Adds a Hadoop configuration value customization, such as core-site.xml or hive-site.xml, and/or a Hive shared library customization to the Microsoft Azure HDInsight cluster configuration.This topic describes the cmdlet in the .7.2 version of the Microsoft Azure PowerShell module. To find out the version of the module you're using, from the Azure PowerShell console, type (get-module azure).version.

Parameters

-Config <AzureHDInsightConfig>

The configuration object to which Hadoop configuration is added.

Aliases

None

Required?

true

Position

0

Default value

None

Accept pipeline input?

true (ByValue)

Accept wildcard characters?

false

-Core <Hashtable>

Set of customized Hadoop configuration values for core-site.xml.

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

-Yarn <Hashtable>

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

-Hdfs <Hashtable>

Set of customized Hadoop configuration values for hdfs-site.xml.

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

-Hive <AzureHDInsightHiveConfiguration>

Customization object for Hadoop Hive service, including a set of Hadoop configuration values for hive-site.xml and Hive shared libraries.

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

-MapReduce <AzureHDInsightMapReduceConfiguration>

Customization object for map reduce and the capacity scheduler.

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

-Oozie <AzureHDInsightOozieConfiguration>

Customization object for Hadoop Oozie service. Includes set of Hadoop configuration values for oozie-site.xml.

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

-Storm <Hashtable>

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

-HBase <AzureHDInsightHBaseConfiguration>

Aliases

None

Required?

false

Position

named

Default value

None

Accept pipeline input?

false

Accept wildcard characters?

false

Input Type


Return Type


Notes

Examples

-------------------------- Cluster configuration --------------------------

Set Hive,Oozie, and MapReduce configuration values for an HDInsight cluster.

PS C:\>
          $hiveConfigvalues = new-object 'Microsoft.WindowsAzure.Management.HDInsight.Cmdlet.DataObjects.AzureHDInsightHiveConfiguration'
          $hiveConfigvalues.Configuration = @{ ???hive.exec.compress.output???=???true??? }
          $hiveConfigvalues.AdditionalLibraries = new-object 'Microsoft.WindowsAzure.Management.HDInsight.Cmdlet.DataObjects.AzureHDInsightDefaultStorageAccount'
          $hiveConfigvalues.AdditionalLibraries.StorageAccountName = "yourstorageaccount.blob.core.windows.net"
          $hiveConfigvalues.AdditionalLibraries.StorageAccountKey = (Get-AzureStorageKey yourstorageaccount).Primary
          $hiveConfigvalues.AdditionalLibraries.StorageContainerName = "yoursharedlibcontainer"

          $oozieConfigvalues = new-object 'Microsoft.WindowsAzure.Management.HDInsight.Cmdlet.DataObjects.AzureHDInsightOozieConfiguration'
          $oozieConfigvalues.Configuration = @{ ???hive.exec.compress.output???=???true??? }

          $mapredConfigvalues = new-object 'Microsoft.WindowsAzure.Management.HDInsight.Cmdlet.DataObjects.AzureHDInsightMapReduceConfiguration'
          $mapredConfigvalues.Configuration = @{ ???mapred.map.max.attempts???=???2??? }
          $mapredConfigvalues.CapacitySchedulerConfiguration = @{ ???mapred.capacity-scheduler.init-poll-interval???=???1000??? }

          $config = New-AzureHDInsightClusterConfig -ClusterSizeInNodes 4 `
          ?????? | Set-AzureHDInsightDefaultStorage -StorageAccountName yourstorageaccount.blob.core.windows.net `
          ?????????????? -StorageAccountKey (Get-AzureStorageKey yourstorageaccount).Primary -StorageContainerName " yourstoragecontainer" `
          ?????? | Add-AzureHDInsightConfigValues -Core @{ ???io.file.buffer.size???=???300000??? } -MapReduce $mapredConfigvalues -Hive $hiveConfigvalues -Oozie $oozieConfigvalues

          $config | New-AzureHDInsightCluster -Subscription $subid -Credential $creds -Name yourcluster -Location "North Europe"

Online Version