Apache Bigtop Puppet Don’t install puppet using sudo apt-­‐get install then expect the README.md instructions to work. There are 3 steps to get to the point where you can start debugging the puppet scripts: 1) install puppet using the puppet labs repo shown below 2) copy site.csv.example to site.csv and modify the first entry to include the private IP address of the AWS node you are using. Make sure to update /etc/hostnames also. 3) Modify site.pp to see the config/site.csv file. 4) Run sudo puppet -­‐d -­‐-­‐modulepath=bigtop-­‐deploy/puppet/modules bigtop-­‐
deploy/puppet/manifests/site.pp Enter the following into puppet.list under /etc/apt/sources.list.d/puppet.list deb http://apt.puppetlabs.com/ lucid main >sudo apt-­‐get update ubuntu@ip-­‐10-­‐224-­‐115-­‐96:~$ apt-­‐cache search puppet etherpuppet -­‐ create a virtual interface from a remote Ethernet interface puppetlabs-­‐release -­‐ "Package to install Puppet Labs gpg key and apt repo" puppetmaster-­‐common -­‐ Puppet master common scripts puppetmaster-­‐passenger -­‐ Centralised configuration management -­‐ master setup to run under mod passenger puppetmaster -­‐ Centralized configuration management -­‐ master startup and compatibility scripts puppet-­‐common -­‐ Centralized configuration management puppet-­‐dashboard -­‐ Dashboard for Puppet puppet-­‐el -­‐ syntax highlighting for puppet manifests in emacs puppet-­‐testsuite -­‐ Centralized configuration management -­‐ test suite puppet -­‐ Centralized configuration management -­‐ agent startup and compatibility scripts vim-­‐puppet -­‐ syntax highlighting for puppet manifests in vim The difference between the puppet repo and the default Ubuntu repo is the puppetlabs-­‐release version. Install the puppetlabs-­‐release version. This will install ralsh which is not installed if you do >sudo apt-­‐get install puppet. Create 2 files, one called site.pp and one called testfile.pp Create a blank testfile.txt using >sudo touch testfile.txt, run site.pp using >sudo puppet site.pp and you should see the permissions for testfile.txt change to 777. We can add ensure=>present to the testifile.pp class to create testfile if it isn’t there. For every system resources which exists on the server, puppet can associate a configuration or puppet resource object to it. There is a resource shell in puppet called ralsh which is not available if you use sudo apt-­‐get install puppet. You have to download and install puppet from the tar.gz files. Ralsh is useful for listing the current system state in puppet syntax which can be used to create puppet configuration files. >ralsh –h for a list of commands. Note: ralsh doesn’t support –help like puppet >ralsh -­‐-­‐types to list the commands for package Puppet defines different types of resources. Type resources are things like packages, services, system parameters like hosts which are used to build node configurations. Type Resources: Install bigtop and use ralsh to print out the installed packages in puppet format using the >ralsh package command. You will see an output like this: package { 'gzip': ensure => '1.3.12-­‐9ubuntu1.1', } package { 'hadoop': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐conf-­‐pseudo': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐datanode': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐doc': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐fuse': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐jobtracker': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐namenode': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐native': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐pipes': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐sbin': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐secondarynamenode': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐source': ensure => '1.0.1-­‐1', } package { 'hadoop-­‐tasktracker': ensure => '1.0.1-­‐1', } This will be useful in helping us figure out how to create the node configuration files for all the bigtop services we need to specify. >ralsh service describes the running services: service { 'networking': ensure => 'stopped', enable => 'false', } service { 'ondemand': ensure => 'stopped', enable => 'true', } service { 'oozie': ensure => 'running', enable => 'true', } service { 'plymouth': ensure => 'running', enable => 'false', } >ralsh user >ralsh group >ralsh host host { 'ip6-­‐allhosts': ensure => 'present', ip => 'ff02::3', target => '/etc/hosts', } host { 'ip6-­‐allnodes': ensure => 'present', ip => 'ff02::1', target => '/etc/hosts', } host { 'ip6-­‐allrouters': ensure => 'present', ip => 'ff02::2', target => '/etc/hosts', } host { 'ip6-­‐localhost': ensure => 'present', host_aliases => ['ip6-­‐loopback'], ip => '::1', target => '/etc/hosts', } host { 'ip6-­‐localnet': ensure => 'present', ip => 'fe00::0', target => '/etc/hosts', } host { 'ip6-­‐mcastprefix': ensure => 'present', ip => 'ff00::0', target => '/etc/hosts', } host { 'localhost': ensure => 'present', ip => '127.0.0.1', target => '/etc/hosts', } Hadoop Experiments Can we configure nodes to install and run hadoop? q) a bigtop installation starts all the daemons. What does puppet do? It should also start the daemons? There is no config file to add in IP addresses like master or slave. q) how do you control file ops in puppet? Require to create empty file. Add attributes to the file and see if this works as a config file for a puppet object We have to create a s3cfg object with a hardcoded accesskey and secret key. Is this less work? How to make .bashrc distributed across all computers? Function Resources: Functions execute only in the puppet master. $hadoop_core_proxyusers = { oozie => { groups => 'root,hadoop,jenkins,oozie,users', hosts => "${hadoop_head_node},localhost,127.0.0.1" } } Puppet Configuration: You will see this error if you don’t have a site.csv file defined. No match found for 'hadoop_head_node' in any data file during extlookup() at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/manifests/site.pp:43 on node ip-­‐10-­‐
224-­‐109-­‐199.ec2.internal Under bigtop-­‐deploy/puppet/config copy site.csv.example to site.csv. Add in the FDQN for the AWS server, make sure you update /etc/hostname ubuntu@ip-­‐10-­‐224-­‐109-­‐199:~/bigtop$ cat bigtop-­‐deploy/puppet/config/site.csv hadoop_head_node,ip-­‐10-­‐224-­‐109-­‐199 hadoop_storage_dirs,/data/1,/data/2,/data/3,/data/4 bigtop_yumrepo_uri,http://mirror.example.com/path/to/mirror/ Fix site.pp, I couldn’t get the data config directory for extlookup() to work so I hardcoded the path in: After this the output looks like: ubuntu@ip-­‐10-­‐224-­‐109-­‐199:~/bigtop$ sudo puppet -­‐d -­‐-­‐modulepath=bigtop-­‐
deploy/puppet/modules bigtop-­‐deploy/puppet/manifests/site.pp warning: Implicit invocation of 'puppet apply' by passing files (or flags) directly to 'puppet' is deprecated, and will be removed in the 2.8 series. Please invoke 'puppet apply' directly in the future. info: Loading facts in bigtop-­‐
deploy/puppet/modules/hadoop/lib/facter/hadoop_storage_dirs.rb info: Loading facts in bigtop-­‐
deploy/puppet/modules/hadoop/lib/facter/hadoop_storage_locations.rb info: Loading facts in bigtop-­‐
deploy/puppet/modules/kerberos/lib/facter/kadm_keytab.rb debug: importing '/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/manifests/cluster.pp' in environment production debug: importing '/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/bigtop_util/manifests/init.pp' in environment production debug: Automatically imported bigtop_util from bigtop_util into production notice: Scope(Class[main]): puppet_confdir: debug: Failed to load library 'selinux' for feature 'selinux' debug: Puppet::Type::Package::ProviderRpm: Executing '/usr/bin/rpm -­‐-­‐version' debug: Puppet::Type::Package::ProviderUrpmi: Executing '/usr/bin/rpm -­‐ql rpm' debug: Puppet::Type::Package::ProviderYum: Executing '/usr/bin/rpm -­‐-­‐version' debug: Puppet::Type::Package::ProviderAptrpm: Executing '/usr/bin/rpm -­‐ql rpm' warning: Dynamic lookup of $hadoop_head_node at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/manifests/cluster.pp:19 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_head_node at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/manifests/cluster.pp:27 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_head_node at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/manifests/cluster.pp:35 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_head_node at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/manifests/cluster.pp:39 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_head_node at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/manifests/cluster.pp:41 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. debug: importing '/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/manifests/init.pp' in environment production debug: Automatically imported hadoop::datanode from hadoop/datanode into production debug: importing '/home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/manifests/init.pp' in environment production debug: Automatically imported hadoop-­‐hbase::server from hadoop-­‐hbase/server into production warning: Dynamic lookup of $auth at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/manifests/init.pp:35 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. debug: Scope(Class[Hadoop::Common]): Retrieving template hadoop/core-­‐site.xml debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/core-­‐site.xml]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/core-­‐site.xml in 0.00 seconds warning: Dynamic lookup of $hadoop_namenode_host at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/core-­‐
site.xml:24 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_namenode_port at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/core-­‐
site.xml:24 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_security_authentication at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/core-­‐
site.xml:29 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_security_authentication at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/core-­‐
site.xml:32 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_core_proxyusers at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/core-­‐
site.xml:46 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_core_proxyusers at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/core-­‐
site.xml:47 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/core-­‐site.xml]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/core-­‐
site.xml in 0.01 seconds debug: Failed to load library 'rubygems' for feature 'rubygems' debug: Scope(Class[Hadoop::Common]): Retrieving template hadoop/mapred-­‐
site.xml debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml in 0.00 seconds warning: Dynamic lookup of $hadoop_security_authentication at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:21 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_jobtracker_host at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:99 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_jobtracker_port at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:99 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $mapred_data_dirs at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:104 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $processorcount at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:217 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $processorcount at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:224 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_jobtracker_thrift_port at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:269 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_jobtracker_thrift_port at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:273 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_mapred_jobtracker_plugins at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:276 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_mapred_jobtracker_plugins at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:279 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_mapred_tasktracker_plugins at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:283 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_mapred_tasktracker_plugins at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml:286 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/mapred-­‐site.xml in 0.01 seconds debug: Scope(Class[Hadoop::Common]): Retrieving template hadoop/hdfs-­‐site.xml debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hdfs-­‐site.xml]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hdfs-­‐site.xml in 0.00 seconds warning: Dynamic lookup of $hadoop_security_authentication at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:21 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_namenode_host at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:106 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_namenode_port at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:106 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hdfs_data_dirs at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hdfs-­‐site.xml:111 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $namenode_data_dirs at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:116 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_dfs_namenode_plugins at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:120 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_dfs_namenode_plugins at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:123 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_dfs_datanode_plugins at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:128 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_dfs_datanode_plugins at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:131 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_namenode_thrift_port at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:136 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $hadoop_namenode_thrift_port at /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml:139 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐
qualified variable name (e.g., $classname::variable) or parameterized classes. debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hdfs-­‐site.xml]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop/templates/hdfs-­‐
site.xml in 0.01 seconds debug: Scope(Class[Hadoop::Common]): Retrieving template hadoop/hadoop-­‐
env.sh debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop-­‐env.sh]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop-­‐env.sh in 0.00 seconds debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop-­‐env.sh]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop-­‐env.sh in 0.01 seconds debug: Scope(Class[Hadoop::Common]): Retrieving template hadoop/hadoop debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop in 0.00 seconds warning: Dynamic lookup of $hadoop_security_authentication at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop:21 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/hadoop in 0.00 seconds debug: importing '/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/kerberos/manifests/init.pp' in environment production debug: Automatically imported kerberos::host_keytab from kerberos/host_keytab into production debug: Scope(Hadoop::Tasktracker[tasktracker]): Retrieving template hadoop/taskcontroller.cfg debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/taskcontroller.cfg]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/taskcontroller.cfg in 0.00 seconds warning: Dynamic lookup of $mapred_data_dirs at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/taskcontroller.cfg:1 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. debug: template[/home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/taskcontroller.cfg]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop/templates/taskcontroller.cfg in 0.00 seconds warning: Dynamic lookup of $kerberos_realm at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop-­‐hbase/manifests/init.pp:25 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. debug: Scope(Class[Hadoop-­‐hbase::Common-­‐server-­‐config]): Retrieving template hadoop-­‐hbase/hbase-­‐site.xml debug: template[/home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐site.xml]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐site.xml in 0.00 seconds warning: Dynamic lookup of $zookeeper_quorum at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop-­‐hbase/templates/hbase-­‐site.xml:32 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $rootdir at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop-­‐hbase/templates/hbase-­‐site.xml:37 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. warning: Dynamic lookup of $kerberos_realm at /home/ubuntu/bigtop/bigtop-­‐
deploy/puppet/modules/hadoop-­‐hbase/templates/hbase-­‐site.xml:40 is deprecated. Support will be removed in Puppet 2.8. Use a fully-­‐qualified variable name (e.g., $classname::variable) or parameterized classes. debug: template[/home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐site.xml]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐site.xml in 0.00 seconds debug: Scope(Class[Hadoop-­‐hbase::Common-­‐server-­‐config]): Retrieving template hadoop-­‐hbase/hbase-­‐env.sh debug: template[/home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐env.sh]: Bound template variables for /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐env.sh in 0.00 seconds debug: template[/home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐env.sh]: Interpolated template /home/ubuntu/bigtop/bigtop-­‐deploy/puppet/modules/hadoop-­‐
hbase/templates/hbase-­‐env.sh in 0.00 seconds debug: Adding relationship from Yumrepo[Bigtop] to Package[hbase] with 'before' debug: Adding relationship from Yumrepo[Bigtop] to Package[hadoop-­‐native] with 'before' debug: Adding relationship from Yumrepo[Bigtop] to Package[hbase-­‐regionserver] with 'before' debug: Adding relationship from Yumrepo[Bigtop] to Package[hadoop-­‐tasktracker] with 'before' debug: Adding relationship from Yumrepo[Bigtop] to Package[jdk] with 'before' debug: Adding relationship from Yumrepo[Bigtop] to Package[hadoop] with 'before' debug: Adding relationship from Yumrepo[Bigtop] to Package[hadoop-­‐datanode] with 'before' debug: Puppet::Type::Service::ProviderSystemd: file /bin/systemctl does not exist debug: Puppet::Type::Service::ProviderDaemontools: file /usr/bin/svc does not exist debug: Puppet::Type::Service::ProviderGentoo: file /sbin/rc-­‐update does not exist debug: Puppet::Type::Service::ProviderRedhat: file /sbin/chkconfig does not exist debug: Puppet::Type::Service::ProviderLaunchd: file /bin/launchctl does not exist debug: Puppet::Type::Service::ProviderRunit: file /usr/bin/sv does not exist debug: Puppet::Type::Package::ProviderFink: file /sw/bin/fink does not exist debug: Puppet::Type::Package::ProviderZypper: file /usr/bin/zypper does not exist debug: Puppet::Type::Package::ProviderFreebsd: file /usr/sbin/pkg_delete does not exist debug: Puppet::Type::Package::ProviderAptrpm: false value when expecting true debug: Puppet::Type::Package::ProviderNim: file /usr/sbin/nimclient does not exist debug: Puppet::Type::Package::ProviderRug: file /usr/bin/rug does not exist debug: Puppet::Type::Package::ProviderSun: file /usr/bin/pkginfo does not exist debug: Puppet::Type::Package::ProviderUrpmi: file urpmi does not exist debug: Puppet::Type::Package::ProviderPorts: file /usr/local/sbin/portversion does not exist debug: Puppet::Type::Package::ProviderPkg: file /usr/bin/pkg does not exist debug: Puppet::Type::Package::ProviderHpux: file /usr/sbin/swremove does not exist debug: Puppet::Type::Package::ProviderPacman: file /usr/bin/pacman does not exist debug: Puppet::Type::Package::ProviderPortupgrade: file /usr/local/sbin/portversion does not exist debug: Puppet::Type::Package::ProviderUp2date: file /usr/sbin/up2date-­‐nox does not exist debug: Puppet::Type::Package::ProviderYum: file yum does not exist debug: Puppet::Type::Package::ProviderPortage: file /usr/bin/eix does not exist debug: Puppet::Type::Package::ProviderOpenbsd: file pkg_delete does not exist debug: Puppet::Type::Package::ProviderAix: file /usr/sbin/installp does not exist debug: Puppet::Type::Package::ProviderGem: file gem does not exist debug: Puppet::Type::Package::ProviderSunfreeware: file pkg-­‐get does not exist debug: Creating default schedules debug: Puppet::Type::User::ProviderUser_role_add: file roleadd does not exist debug: Puppet::Type::User::ProviderPw: file pw does not exist debug: Puppet::Type::User::ProviderDirectoryservice: file /usr/bin/dscl does not exist debug: Puppet::Type::User::ProviderLdap: true value when expecting false debug: Failed to load library 'ldap' for feature 'ldap' debug: /File[/var/lib/puppet/state/state.yaml]: Autorequiring File[/var/lib/puppet/state] debug: /File[/var/lib/puppet/client_yaml]: Autorequiring File[/var/lib/puppet] debug: /File[/var/lib/puppet/state/graphs]: Autorequiring File[/var/lib/puppet/state] debug: /File[/var/lib/puppet/state/last_run_summary.yaml]: Autorequiring File[/var/lib/puppet/state] debug: /File[/var/lib/puppet/lib]: Autorequiring File[/var/lib/puppet] debug: /File[/var/lib/puppet/ssl/private_keys]: Autorequiring File[/var/lib/puppet/ssl] debug: /File[/var/lib/puppet/state/last_run_report.yaml]: Autorequiring File[/var/lib/puppet/state] debug: /File[/var/lib/puppet/state]: Autorequiring File[/var/lib/puppet] debug: /File[/var/lib/puppet/ssl/certs]: Autorequiring File[/var/lib/puppet/ssl] debug: /File[/var/lib/puppet/ssl/certificate_requests]: Autorequiring File[/var/lib/puppet/ssl] debug: /File[/var/lib/puppet/facts]: Autorequiring File[/var/lib/puppet] debug: /File[/var/lib/puppet/client_data]: Autorequiring File[/var/lib/puppet] debug: /File[/var/lib/puppet/ssl]: Autorequiring File[/var/lib/puppet] debug: /File[/var/lib/puppet/clientbucket]: Autorequiring File[/var/lib/puppet] debug: /File[/var/lib/puppet/ssl/private]: Autorequiring File[/var/lib/puppet/ssl] debug: /File[/var/lib/puppet/ssl/public_keys]: Autorequiring File[/var/lib/puppet/ssl] debug: /File[/var/run/puppet]/ensure: created debug: Finishing transaction 70087772625340 debug: Loaded state in 0.00 seconds debug: Executing '/etc/puppet/etckeeper-­‐commit-­‐pre' debug: Loaded state in 0.00 seconds info: Applying configuration version '1332977866' debug: /Stage[main]/Hadoop_cluster_node/require: requires Class[Bigtop_util] debug: /Stage[main]/Hadoop::Common/Package[hadoop-­‐native]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/hdfs-­‐
site.xml]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/3/h
dfs]/require: requires Package[hadoop] debug: /Stage[main]//Yumrepo[Bigtop]/before: requires Package[hbase] debug: /Stage[main]//Yumrepo[Bigtop]/before: requires Package[hadoop-­‐native] debug: /Stage[main]//Yumrepo[Bigtop]/before: requires Package[hbase-­‐
regionserver] debug: /Stage[main]//Yumrepo[Bigtop]/before: requires Package[hadoop-­‐
tasktracker] debug: /Stage[main]//Yumrepo[Bigtop]/before: requires Package[jdk] debug: /Stage[main]//Yumrepo[Bigtop]/before: requires Package[hadoop] debug: /Stage[main]//Yumrepo[Bigtop]/before: requires Package[hadoop-­‐
datanode] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/require: requires Package[hadoop-­‐datanode] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/require: requires File[/data/1/hdfs] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/require: requires File[/data/2/hdfs] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/require: requires File[/data/3/hdfs] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/require: requires File[/data/4/hdfs] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/subscribe: subscribes to Package[hadoop-­‐datanode] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/subscribe: subscribes to File[/etc/hadoop/conf/core-­‐site.xml] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/subscribe: subscribes to File[/etc/hadoop/conf/hdfs-­‐site.xml] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]/subscribe: subscribes to File[/etc/hadoop/conf/hadoop-­‐env.sh] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/4/h
dfs]/require: requires Package[hadoop] debug: /Stage[main]//require: requires Class[Bigtop_util] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
3/mapred]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/hadoop-­‐
env.sh]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/2/h
dfs]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/1/h
dfs]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop::Common/File[/etc/default/hadoop]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop-­‐hbase::Common-­‐server-­‐
config/File[/etc/hbase/conf/hbase-­‐env.sh]/require: requires Package[hbase] debug: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/core-­‐
site.xml]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop_worker_node/Hadoop-­‐hbase::Server[hbase region server]/Service[hbase-­‐regionserver]/require: requires Package[hbase-­‐
regionserver] debug: /Stage[main]/Hadoop_worker_node/Hadoop-­‐hbase::Server[hbase region server]/Service[hbase-­‐regionserver]/subscribe: subscribes to File[/etc/hbase/conf/hbase-­‐site.xml] debug: /Stage[main]/Hadoop_worker_node/Hadoop-­‐hbase::Server[hbase region server]/Service[hbase-­‐regionserver]/subscribe: subscribes to File[/etc/hbase/conf/hbase-­‐env.sh] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
2/mapred]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop-­‐hbase::Common-­‐server-­‐
config/File[/etc/hbase/conf/hbase-­‐site.xml]/require: requires Package[hbase] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
1/mapred]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Package[hadoo
p-­‐datanode]/require: requires Package[jdk] debug: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/mapred-­‐
site.xml]/require: requires Package[hadoop] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/require: requires Package[hadoop-­‐tasktracker] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/require: requires File[/etc/hadoop/conf/taskcontroller.cfg] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/require: requires File[/data/1/mapred] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/require: requires File[/data/2/mapred] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/require: requires File[/data/3/mapred] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/require: requires File[/data/4/mapred] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/subscribe: subscribes to Package[hadoop-­‐tasktracker] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/subscribe: subscribes to File[/etc/hadoop/conf/core-­‐site.xml] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/subscribe: subscribes to File[/etc/hadoop/conf/mapred-­‐
site.xml] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]/subscribe: subscribes to File[/etc/hadoop/conf/hadoop-­‐env.sh] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
4/mapred]/require: requires Package[hadoop] debug: /Stage[pre]/before: requires Stage[main] debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Package[ha
doop-­‐tasktracker]/require: requires Package[jdk] debug: /Schedule[daily]: Skipping device resources because running on a host debug: /Schedule[monthly]: Skipping device resources because running on a host debug: /Schedule[hourly]: Skipping device resources because running on a host debug: /Schedule[never]: Skipping device resources because running on a host debug: /Schedule[weekly]: Skipping device resources because running on a host debug: Finishing transaction 70087771456400 info: FileBucket adding {md5}0e24dd628517df6d84383a5098d2f602 info: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/etc/h
adoop/conf/taskcontroller.cfg]: Filebucketed /etc/hadoop/conf/taskcontroller.cfg to puppet with sum 0e24dd628517df6d84383a5098d2f602 notice: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/etc/h
adoop/conf/taskcontroller.cfg]/content: content changed '{md5}0e24dd628517df6d84383a5098d2f602' to '{md5}edf496f0cd49c5fb9e4a1539840514c5' debug: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/etc/h
adoop/conf/taskcontroller.cfg]: The container Hadoop::Tasktracker[tasktracker] will propagate my refresh event debug: /Schedule[puppet]: Skipping device resources because running on a host err: /Stage[main]//Yumrepo[Bigtop]: Could not evaluate: File /etc/yum.conf does not contain a main section debug: Prefetching apt resources for package debug: Executing '/usr/bin/dpkg-­‐query -­‐W -­‐-­‐showformat '${Status} ${Package} ${Version}\n'' debug: Puppet::Type::Package::ProviderApt: Executing '/usr/bin/dpkg-­‐query -­‐W -­‐-­‐
showformat '${Status} ${Package} ${Version}\n'' notice: /Stage[main]/Hadoop_worker_node/Hadoop-­‐hbase::Server[hbase region server]/Package[hbase-­‐regionserver]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop-­‐hbase::Server[hbase region server]/Package[hbase-­‐regionserver]: Skipping because of failed dependencies notice: /Stage[main]//Package[jdk]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]//Package[jdk]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Package[ha
doop-­‐tasktracker]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Package[ha
doop-­‐tasktracker]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Package[hadoo
p-­‐datanode]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Package[hadoo
p-­‐datanode]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop::Common/Package[hadoop]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop::Common/Package[hadoop]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop::Common/File[/etc/default/hadoop]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop::Common/File[/etc/default/hadoop]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
4/mapred]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
4/mapred]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/hadoop-­‐env.sh]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/hadoop-­‐env.sh]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
2/mapred]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
2/mapred]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/3/h
dfs]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/3/h
dfs]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop::Common/Package[hadoop-­‐native]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop::Common/Package[hadoop-­‐native]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/core-­‐site.xml]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/core-­‐site.xml]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
3/mapred]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
3/mapred]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/1/h
dfs]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/1/h
dfs]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/hdfs-­‐site.xml]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/hdfs-­‐site.xml]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/2/h
dfs]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/2/h
dfs]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/mapred-­‐site.xml]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop::Common/File[/etc/hadoop/conf/mapred-­‐
site.xml]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop-­‐hbase::Client-­‐package/Package[hbase]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop-­‐hbase::Client-­‐package/Package[hbase]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop-­‐hbase::Common-­‐server-­‐
config/File[/etc/hbase/conf/hbase-­‐env.sh]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop-­‐hbase::Common-­‐server-­‐
config/File[/etc/hbase/conf/hbase-­‐env.sh]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/4/h
dfs]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/File[/data/4/h
dfs]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Datanode[datanode]/Service[hadoop
-­‐datanode]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
1/mapred]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/File[/data/
1/mapred]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop::Tasktracker[tasktracker]/Service[ha
doop-­‐tasktracker]: Skipping because of failed dependencies debug: Hadoop::Tasktracker[tasktracker]: The container Class[Hadoop_worker_node] will propagate my refresh event notice: /Stage[main]/Hadoop-­‐hbase::Common-­‐server-­‐
config/File[/etc/hbase/conf/hbase-­‐site.xml]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop-­‐hbase::Common-­‐server-­‐
config/File[/etc/hbase/conf/hbase-­‐site.xml]: Skipping because of failed dependencies notice: /Stage[main]/Hadoop_worker_node/Hadoop-­‐hbase::Server[hbase region server]/Service[hbase-­‐regionserver]: Dependency Yumrepo[Bigtop] has failures: true warning: /Stage[main]/Hadoop_worker_node/Hadoop-­‐hbase::Server[hbase region server]/Service[hbase-­‐regionserver]: Skipping because of failed dependencies debug: Class[Hadoop_worker_node]: The container Stage[main] will propagate my refresh event debug: Finishing transaction 70087773049240 debug: Storing state debug: Stored state in 0.01 seconds notice: Finished catalog run in 0.37 seconds debug: Executing '/etc/puppet/etckeeper-­‐commit-­‐post' debug: Finishing transaction 70087798097380 debug: Received report to process from ip-­‐10-­‐224-­‐109-­‐199.ec2.internal debug: Processing report from ip-­‐10-­‐224-­‐109-­‐199.ec2.internal with processor Puppet::Reports::Store