When Running Vagrant Up - Error - Java Failures?

[adron-orange]

I'm running a simple vagrant up from the zk/ directory and it looks like it gets most things done, but then throws some errors at the end.

$ vagrant up
Bringing machine 'zoo1' up with 'virtualbox' provider...
==> zoo1: Importing base box 'hashicorp/precise64'...
==> zoo1: Matching MAC address for NAT networking...
==> zoo1: Checking if box 'hashicorp/precise64' is up to date...
==> zoo1: Setting the name of the VM: zk_zoo1_1455825597727_8223
==> zoo1: Clearing any previously set network interfaces...
==> zoo1: Preparing network interfaces based on configuration...
    zoo1: Adapter 1: nat
    zoo1: Adapter 2: hostonly
==> zoo1: Forwarding ports...
    zoo1: 9090 (guest) => 9960 (host) (adapter 1)
    zoo1: 9050 (guest) => 9950 (host) (adapter 1)
    zoo1: 22 (guest) => 2222 (host) (adapter 1)
==> zoo1: Running 'pre-boot' VM customizations...
==> zoo1: Booting VM...
==> zoo1: Waiting for machine to boot. This may take a few minutes...
    zoo1: SSH address: 127.0.0.1:2222
    zoo1: SSH username: vagrant
    zoo1: SSH auth method: private key
    zoo1:
    zoo1: Vagrant insecure key detected. Vagrant will automatically replace
    zoo1: this with a newly generated keypair for better security.
    zoo1:
    zoo1: Inserting generated public key within guest...
    zoo1: Removing insecure key from the guest if it's present...
    zoo1: Key inserted! Disconnecting and reconnecting using new SSH key...
==> zoo1: Machine booted and ready!
==> zoo1: Checking for guest additions in VM...
    zoo1: The guest additions on this VM do not match the installed version of
    zoo1: VirtualBox! In most cases this is fine, but in rare cases it can
    zoo1: prevent things such as shared folders from working properly. If you see
    zoo1: shared folder errors, please make sure the guest additions within the
    zoo1: virtual machine match the version of VirtualBox you have installed on
    zoo1: your host and reload your VM.
    zoo1:
    zoo1: Guest Additions Version: 4.2.0
    zoo1: VirtualBox Version: 5.0
==> zoo1: Setting hostname...
==> zoo1: Configuring and enabling network interfaces...
==> zoo1: Mounting shared folders...
    zoo1: /vagrant => /Users/axh6454/Codez/togglez/zk
    zoo1: /tmp/vagrant-puppet/modules-b1e0306b80e634d5ba9988bce99c5c70 => /Users/axh6454/Codez/togglez/zk/modules
    zoo1: /tmp/vagrant-puppet/manifests-a11d1078b1b1f2e3bdea27312f6ba513 => /Users/axh6454/Codez/togglez/zk/manifests
==> zoo1: Running provisioner: puppet...
==> zoo1: Running Puppet with default.pp...
==> zoo1: stdin: is not a tty
==> zoo1: notice: Scope(Class[Zkui::Service]): install dir is /opt/zkui
==> zoo1: notice: /Stage[main]/Jdk/File[/usr/lib/jvm/]/ensure: created
==> zoo1: notice: /Stage[main]/Jdk/File[/usr/lib/jvm/jdk1.8.0_20/]/ensure: created
==> zoo1: err: /Stage[main]/Jdk/File[/usr/lib/jvm/jdk-8u20-linux-x64.gz]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///modules/jdk/oracle/jdk8/jdk-8u20-linux-x64.gz at /tmp/vagrant-puppet/modules-b1e0306b80e634d5ba9988bce99c5c70/jdk/manifests/init.pp:19
==> zoo1: notice: /Stage[main]/Jdk/Exec[unpack-java]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Jdk/Exec[unpack-java]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Jdk/File[/usr/lib/jvm/jdk]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Jdk/File[/usr/lib/jvm/jdk]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Jdk/Exec[update-alternatives]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Jdk/Exec[update-alternatives]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Jdk/File[/etc/profile.d/java.sh]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Jdk/File[/etc/profile.d/java.sh]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Jdk/File_line[java_bashrc]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Jdk/File_line[java_bashrc]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Jdk/Anchor[jdk::end:]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Jdk/Anchor[jdk::end:]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zookeeper/File[/var/lib/zookeeper]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zookeeper/File[/var/lib/zookeeper]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zookeeper/File[/var/lib/zookeeper/data]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zookeeper/File[/var/lib/zookeeper/data]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zookeeper/File[/vagrant/zookeeper/]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zookeeper/File[/vagrant/zookeeper/]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zookeeper/Exec[download-zoo]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zookeeper/Exec[download-zoo]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zookeeper/Exec[extract-zoo]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zookeeper/Exec[extract-zoo]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zookeeper/File[/usr/local/zookeeper]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zookeeper/File[/usr/local/zookeeper]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor/Anchor[exhibitor::begin:]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor/Anchor[exhibitor::begin:]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor::Install/File[/opt/exhibitor]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor::Install/File[/opt/exhibitor]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor::Install/File[/opt/exhibitor/exhibitor-1.0-jar-with-dependencies.jar]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor::Install/File[/opt/exhibitor/exhibitor-1.0-jar-with-dependencies.jar]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor::Config/File[/etc/default/exhibitor]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor::Config/File[/etc/default/exhibitor]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor::Config/File[/vagrant/exhibitor.properties]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor::Config/File[/vagrant/exhibitor.properties]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor::Service/File[/etc/init.d/exhibitor]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor::Service/File[/etc/init.d/exhibitor]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor::Service/Service[exhibitor]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor::Service/Service[exhibitor]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Exhibitor/Anchor[exhibitor::end:]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Exhibitor/Anchor[exhibitor::end:]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zkui/Anchor[zkui::begin:]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zkui/Anchor[zkui::begin:]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zkui::Install/File[/opt/zkui]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zkui::Install/File[/opt/zkui]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zkui::Install/File[/opt/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zkui::Install/File[/opt/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zkui::Config/File[/opt/zkui/config.cfg]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zkui::Config/File[/opt/zkui/config.cfg]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zkui::Service/File[/etc/init.d/zkui]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zkui::Service/File[/etc/init.d/zkui]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zkui::Service/Service[zkui]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zkui::Service/Service[zkui]: Skipping because of failed dependencies
==> zoo1: notice: /Stage[main]/Zkui/Anchor[zkui::end:]: Dependency File[/usr/lib/jvm/jdk-8u20-linux-x64.gz] has failures: true
==> zoo1: warning: /Stage[main]/Zkui/Anchor[zkui::end:]: Skipping because of failed dependencies
==> zoo1: notice: Finished catalog run in 0.13 seconds
The SSH command responded with a non-zero exit status. Vagrant
assumes that this means the command failed. The output for this command
should be in the log above. Please read the output to determine what
went wrong.

I'm toying around with seeing what is or isn't working after the errors, any thoughts on what might be causing these errors/failures? It almost looks like certain java failures with the JDK might be occurring.

[ashic]

Read the readme in the zk folder. I've got code to change it so that it doesn't need the jdk file, but haven't integrated it here yet. Will do post March 11 :)

Till then, you'll need to get the jdk and build exhibitor, and put it into the specified directories. You can change a manifest file and specify the exhibitor jar filename. It's a bit manual and messy as it stands.

There'll likely still be a failure about zkui, but that's optional to get things working.

[ashic]

Post March 11, I'd like to get this bit dockerized. There's probably zookeeper docker containers out there already, so using that would be a better option. Tests should run fine as long as the addresses are updated.

[ashic]

Btw...this will install JDK: https://gist.github.com/ashic/8176afc74a8dd96ef166

Can use a shell provisioner and remove jdk steps. But docker would be the way forward.

[adron-orange]

Ah. I've started building some Zookeeper containers specifically for this, albeit the JDK installation is broken (irony => http://compositecode.com/2016/02/01/researching-learning-about-zookeeper-a-guide/)

I'll take a stab at this again w/ Docker and likely have a PR in by end of Saturday/Sunday. Plus the Docker repo built and available too. Will link it here.

[adron-orange]

Hey @ashic, I got the JDK dependency sorted but am having some issues with the Exhibitor jar file. I tried the steps shown in teh vagrant-zk-exhbitor markdown doc https://github.com/Netflix/exhibitor/wiki/Building-Exhibitor. However when I generate the jar file for exhitibor (which is on 1.5.x now) it just generatoes a more generically named jar file, which I renamed and attempted to use, but that doesn't seem to fly. Could you take a look at this?

Here are the errors I'm still seeing.

    ==> zoo1: notice: /Stage[main]/Zkui::Install/File[/opt/zkui]/ensure: created
    ==> zoo1: err: /Stage[main]/Zkui::Install/File[/opt/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar]: Could not evaluate: Could not retrieve information from environment production source(s) puppet:///modules/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar at /tmp/vagrant-puppet/modules-b1e0306b80e634d5ba9988bce99c5c70/zkui/manifests/install.pp:16
    ==> zoo1: notice: /Stage[main]/Zkui::Config/File[/opt/zkui/config.cfg]: Dependency File[/opt/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar] has failures: true
    ==> zoo1: warning: /Stage[main]/Zkui::Config/File[/opt/zkui/config.cfg]: Skipping because of failed dependencies
    ==> zoo1: notice: /Stage[main]/Zkui::Service/File[/etc/init.d/zkui]: Dependency File[/opt/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar] has failures: true
    ==> zoo1: warning: /Stage[main]/Zkui::Service/File[/etc/init.d/zkui]: Skipping because of failed dependencies
    ==> zoo1: notice: /Stage[main]/Zkui::Service/Service[zkui]: Dependency File[/opt/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar] has failures: true
    ==> zoo1: warning: /Stage[main]/Zkui::Service/Service[zkui]: Skipping because of failed dependencies
    ==> zoo1: notice: /Stage[main]/Zkui/Anchor[zkui::end:]: Dependency File[/opt/zkui/zkui-2.0-SNAPSHOT-jar-with-dependencies.jar] has failures: true
    ==> zoo1: warning: /Stage[main]/Zkui/Anchor[zkui::end:]: Skipping because of failed dependencies
    ==> zoo1: notice: Finished catalog run in 13.93 seconds
    The SSH command responded with a non-zero exit status. Vagrant
    assumes that this means the command failed. The output for this command
    should be in the log above. Please read the output to determine what
    went wrong.

[ashic]

Hi @adron-orange , you should be good. Zkui is an http interface on top, which isn't needed for the test. You can rename the exhibitor jar, or change the puppet manifest. As long as the exhibitor puppet step doesn't fail, things should run fine.

Exhibitor is like a supervisor to Zookeeper with minimal UI. It monitors, and kicks zk if it's down. The vagrant image has it mainly for production parity. Same with zkui, though whereas exhibitor is required here, zkui is optional.

You man modify the main puppet manifest to take the zkui bit out if you want. If things are up, run the explicit tests in the project - they write to and read from zookeeper.

[adron-orange]

Noted. I've also managed to get a Docker image running w/ Exhibitor and Zookeeper, so will get a Dockerfile & related docs & Docker Hub image uploaded soon. 👍