ScaleIO 1.30 – VMware vSphere Installation – Part II – SVM Setup

October 24th, 2014 No comments

Keep in mind that, other than the new features added in ScaleIO 1.30, it still operates in the same fashion on vSphere.  Each host still has a ScaleIO VM (SVM) that leverages vmdks, residing on local datastores, as well as can run one or more services including the Metadata Manager (MDM), ScaleIO Data Server (SDS), & ScaleIO Data Client (SDC), & iSCSI Target.

Where ScaleIO 1.30 differs from 1.2x, is the manner in which it is installed, and managed, especially when it comes to creating additional volumes, protection domains, nodes, and the like.  With ScaleIO 1.30, a vSphere Web Client plugin is added to handle all of these functions.  In Part I, I covered setting up the ScaleIO Gateway and registering it with the VMware vSphere Web Client.

Loading the SVM (OVA) Template
Before the process can begin from the Web Client plugin, the ScaleIO OVA has to be uploaded to a vSphere datastore.  This can be done manually, or can be accomplished using a provided PowerCLI script.  Using the provided script, the OVA is uploaded to one or more datastores, and converted to a Template.  It is important to note that the script will upload the OVA to multiple datastores.  This can be very expedient when deploying SVM nodes on multiple hosts.  In my test environment, I loaded one OVA on each host, for all 3 hosts in my lab.
sio01 sio02

 

Read more…

Categories: Software Defined, Storage Tags:

ScaleIO 1.30 – VMware vSphere Installation – Part I – Gateway Setup

September 25th, 2014 No comments

Since ScaleIO 1.30 has been released, I can now publicly talk about how to install it in a vSphere environment.

To learn what has changed, I’ll start by covering the process of installing 1.2x first.

With 1.2x, a ScaleIO VM (SVM) is loaded on each ESXi host, and configured in the same fashion as deploying ScaleIO on Windows, Linux, or alternate Hypervisor configurations, with one exception.  Where the installation differs from all other ScaleIO installations, is that an iSCSI target service is created on each SVM, and each host then connects to the ScaleIO presented storage over iSCSI.  This has not changed yet in 1.30, but the installation still differs.

In ScaleIO 1.2x, a menu driven install script is used to stand up an initial environment, but additional nodes are added manually after installing all the components.  The 1.2x install script does not easily accommodate the addition of nodes.  Those functions are performed after the binaries have been installed on any new ScaleIO nodes.

Read more…

Categories: Software Defined, Storage Tags:

ICYMI – ScaleIO 1.30 Released

September 24th, 2014 No comments

This one slipped under the radar for me.  I knew that it was coming, but didn’t see an announcement for it.

From the Release Notes, some of the new goodness in 1.30 includes:

  • Management
    • Updated installation/deployment/configuration methods
    • VMware vCenter Web Client Plugin for managing ScaleIO on vSphere
    • Updated GUI
    • REST API
    • Syslog reporting
    • Role Based Access Control (RBAC)
    • OpenStack Support (Cinder/Nova)
  • Control
    • IP Roles
    • Enhanced MDM communication redundancy
    • Enhanced Network Throttling
    • Rebuild Throttling
  • Data Services
    • Thin Provisioning
    • Fault Sets
    • Enhanced server RAM read caching
    • Updated Maximums

I have been running the Beta for a while and I’m pretty pleased with the pieces I have tested.  I had the opportunity to meet with some of the engineers last November and provide some input to the integration with the vSphere Web Client, and I have to say that they did an awesome job putting everything together.

For more information about 1.30, take a look at the EMC Support Docs here (requires an EMC Support login).

Categories: Software Defined, Storage Tags:

Isilon OneFS Virtual Nodes in the lab – Part II – VMware Fusion

July 8th, 2014 No comments

In my last post, I covered how to load an Isilon Virtual Node in to VMware Workstation.

Again, check out Chad’s blog for more info around how to get the Virtual Nodes here: http://virtualgeek.typepad.com/virtual_geek/2014/04/love-isilon-want-to-play-merry-xmas.html

Grab Virtual Isilon
After downloading the appropriate zip, and extracting the contents, it is easy to install/configure.  With the 7.1.0.0 build:

  • Unzip the Isilon_OneFS_Virtual_Nodes_7.1.0.0.zip file and view the contents.
  • Unzip the 7.1.0.0_Virtual_Isilon.zip file and view the contents
  • Open the b.7.1.0.12r.vga folder to display the Virtual Node VM files (vmx, vmdk, etc.)

Unzip

In VMware Fusion – Default
The Virtual Nodes are configured as Virtual Hardware v4 with 6 Linked Clones included.

Right click on the .vmx and choosing Open with – VMware Fusion (keep in mind, this is not in a Fusion VM format, but rather a Workstation format)Open With Fusion

Once the VM is opened up, it will prompt to upgrade the virtual hardware version. Choose Don’t Upgrade.

Don't Upgrade

One thing that I don’t like about VMware Fusion, is that it always starts a VM when it is imported in this fashion.

For this virtual Isilon VM, I will force the VM off before it gets into the system setup.

forceoff

In VMware Fusion Professional (I’m using version 6.0.4), opening the VM config file b.7.1.0.12r.vga.vmx will open the VM, and the Linked Clones will appear as snapshots.

viewsnaps

snaps

 

Opening the b.7.1.0.12r.vga.cloneX.vmx under each cloneX folder will open the Linked Clones.  With 6 Linked Clones present, a Virtual Isilon Cluster with up to 6 nodes can be run.

You may be required to browse for the location of the primary .vmx for the clone/snapshot to function properly.
clone1

A total of 1GB of RAM (plus any overhead) per Isilon snapshot will be required.  Keep in mind that 3 nodes are the minimum requirement for Isilon to function properly.

In VMware Fusion – Custom Disk Size
To configure a cluster with custom disk sizes, one of two things must be done.
*Note: It is important NOT to power on the Virtual Nodes before performing these operations.

  • A full copy must be made of the VM or
  • All the snapshots must be removed from the Parent VM

A full copy in Fusion is performed by selecting opening the Virtual Machine library, right click on the Parent VM, then selecting Create Full Clone.  Then provide a VM name and location, and finally click Save.

Alternatively, removing snapshots in Fusion is not as easy, but not too difficult. Select the the Parent VM in the Virtual Machine Library, right-click, select Snapshots.  In Snapshot Manager, select each of the snapshots, and choose delete.  When prompted, for confirmation, select  Yes to remove the Snapshots.  *Note, this will delete all of the Linked Clones as well.

delsnaps

 

delsure

Once an Isilon Node VM does not have any snapshots associated with it, the data disks can be resized. To do this, edit the configuration o the VM, select each of the 3.9GB hard disks, and expand it.

hdd1

hdd1-10

Four drives with 3.9GB allocated is roughly 13GB.  Expanding each data disk to 10GB in this example provides about 35GB of storage for the node.

To create a 3 node cluster, simply copy/clone the Parent VM.

Getting Started
To setup the Virtual Nodes in a standard configuration, follow the PDF instructions included in the 7.1.0.0_Virtual_Isilon.zip file to configure a Virtual Isilon Cluster.  Also EMC Elect member @dynamoxx has a guide for the 6.5.x build, which is very similar here: http://storagemonkey.wordpress.com/2013/02/10/deploying-virtual-isilon-on-esxi/

A couple things to keep in mind…

  • The first NIC is considered the Internal (or backend) interface.  Data traffic will flow across this NIC.
  • The second NIC is considered the External (or frontend) interface. Cluster/Node management will occur on the cluter’s web interface through this port.  Any CIFS/NFS data will be presented from this interface
  • If you add additional NICs to the Virtual Node, they will not be recognized without further configuration.
  • The Virtual Nodes come with 4 data disks (vmdks).  The system will register errors about other disks not being present (5,6,7, etc).  This is expected and does not indicate an issue with the Virtual Node.

Conclusion
I hope this presents a quick easy understanding of how to load Isilon Virtual Nodes on VMware Fusion.

Categories: Storage, Virtualization Tags: , , ,

Isilon OneFS Virtual Nodes in the lab – Part I – VMware Workstation

July 8th, 2014 No comments

I was out on vacation while it was announced that the Isilon OneFS Virtual Nodes (7.0.2.4 & 7.1.0.0) were available to Partners/Customers/Internal users.

Check out Chad’s blog for more info around that here: http://virtualgeek.typepad.com/virtual_geek/2014/04/love-isilon-want-to-play-merry-xmas.html

After downloading the appropriate zip, and extracting the contents, it is easy to install/configure.  With the 7.1.0.0 build:

  • Unzip the Isilon_OneFS_Virtual_Nodes_7.1.0.0.zip file and view the contents.
  • Unzip the 7.1.0.0_Virtual_Isilon.zip file and view the contents
  • Open the b.7.1.0.12r.vga folder to display the Virtual Node VM files (vmx, vmdk, etc.)

In VMware Workstation/Player – Default
The Virtual Nodes are configured as Virtual Hardware v4 with 6 Linked Clones included.

Read more…