Reducing Primary Storage Costs and Complexity

REDUCING PRIMARY
STORAGE COSTS AND
COMPLEXITY WITH NTP
SOFTWARE PRECISION
TIERING
An NTP Software White Paper
Allocating resources to high-cost storage for low-use data doesn’t make
sense. Most organizations would rather match storage to data and use the
saved budgetary resources for other projects. NTP Software Precision
Tiering™ makes it easy for you to find and migrate data automatically to
the most appropriate storage tier, ensure proper archiving of valuable
data, meet compliance and governance requirements, and ensure proper
data protection.
Copyright © 2014 NTP Software. All Rights Reserved.
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
Reducing Primary Storage Costs and
Complexity with NTP Software Precision Tiering
AN NTP SOFTWARE WHITE PAPER
Contents
Executive Summary ........................................................................................................................... 2
The Benefits of File Data Migration ............................................................................................. 3
Enhanced by Precision Tiering ........................................................................................................ 3
Overcoming the Challenges of Traditional File Data Migration ............................................. 4
Precision Tiering: A New Paradigm............................................................................................... 5
What Is Precision Tiering? ............................................................................................................... 5
Policy-Driven and User-Driven Data Movement ......................................................................... 6
Key Benefits of Precision Tiering.................................................................................................... 9
Conclusion ........................................................................................................................................ 10
About NTP Software ..................................................................................................................... 11
Copyright © 2014 NTP Software. All Rights Reserved.
Page 1
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
Executive Summary
Over the last few years, file data (also called unstructured data) has grown explosively. On most
networks, file data accounts for 85% or more of the total storage requirements. Managing this data
effectively is now one of the most important tasks for many organizations.
For years, migrating data from primary storage to other storage tiers has been a part of many
companies’ data management strategies, both for data protection and as a way to control costs.
However, with the explosive growth of file data, managing the costs and resources of data migration
have made the benefits more difficult to recognize.
The cost of conventional data migration methods is essentially proportional to the amount of data in
primary storage. As the quantity of file data increases – which it continues to do at an average rate of
about 50% a year (per Gartner Group) – the required resources of conventional data migration
methods increases commensurately.
In fact, some end-user organizations have already reached the point where their data migration windows
are too small to accommodate all of the processes that need to be done to maintain their data migration
strategy.
The solution – efficient data migration – is a paradigm shift to Precision Tiering. With Precision Tiering,
the majority of the operating cost and resources demanded by conventional data migration are
eliminated, while all of the benefits are preserved. Precision Tiering makes it easy for you to find and
migrate data automatically to the most appropriate storage tier, ensure proper archiving of valuable
data, meet compliance and governance requirements, and ensure proper data protection.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 2
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
The Benefits of File Data Migration
Using high-cost storage for low-use data doesn’t make sense. Most organizations would rather match
storage costs to data and use the saved budgetary resources for other projects. In most organizations, a
large percentage of file data can be migrated to lower-cost storage. And if you’re concerned with
regulatory compliance and corporate governance, archival storage can help safely store files for as long as
they’re needed.
The benefits of migrating data among storage tiers are generally well-known and well-understood, to the
point where most companies use this strategy in some form or another. As we move from conventional
data migration (where data is moved manually based on costly file system scans) to automatic and ondemand data movement, the goal is to extend and enhance the existing benefits of data migration while
greatly reducing the overall cost and complexity:

Automate the migration, storage, and retention of file data in accordance with IT policies and
corporate and government regulations

Improve the performance of primary storage, control primary storage costs, and simplify
management

Reduce overall storage, backup, and help desk costs while controlling data loss and ensuring that all
information remains protected and in compliance with corporate policies
Enhanced by NTP Software Precision Tiering
Overall, the case for data migration is compelling. NTP Software Precision Tiering preserves all the benefits
noted above while removing completely one of the largest cost- and resource-intensive components of
conventional data migration: file system scans.
NTP Software Precision Tiering™ can provide you with a simple way to understand the makeup of your file
data environment and how file data is being used. Precision Tiering gives you greater insight into what
types of files are being stored, who is using them, and how often. It is easier for you to move file data from
primary storage to more cost-appropriate storage tiers once you know what’s being stored and how files
are being used. NTP Software Precision Tiering shows you how data is used and implements policies that
you define to migrate the data automatically.
NTP Software redefines the economics of data movement by being event and policy driven. It is continually
moving data in real time, eliminating the need for repeated scans of the entire file system, thus greatly
helping to reduce storage-related costs.
In addition, a best-practice implementation of NTP Software Precision Tiering increases the business value of
the data in your storage environment and further reduces storage, backup, and operating costs.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 3
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
Overcoming the Challenges of Traditional File Data Migration
All data migration solutions have three cost elements:
1. The cost of determining what to move
2. The cost of actually moving the selected data
3. The cost of maintaining multiple locations of secondary or tertiary storage
Every one of these costs is proportional to the
amount of data involved in the process. For example,
moving more data costs more than moving less,
maintaining a larger storage tier costs more than
maintaining a smaller storage tier, etc. Therefore, if
we wish to control the cost of data migration, we
must manage the amount of data involved at each of
the above steps in the process.
From prior analysis, we know that items 1 and 3
dominate the cost equation. In conventional data
migration methods, the actual cost of moving the
data is relatively small compared to the cost of
finding what to move and then maintaining it in a
non-primary storage tier. To manage file data costeffectively, it becomes important to go where the
money is and to attack the cost of finding what to
move, as well as removing data you don’t need.
Conventional data migration methods typically use an
expensive and resource-intensive strategy to
determine which files should be moved from primary
storage. Specifically, they regularly scan the entirety of the primary storage tier to find files that meet one or
more simple criteria. If a file meets those criteria, it is moved. The problem with this method is that the
organization is paying the same cost over and over again to scan the same files repeatedly but move very
few of them. In addition, as primary storage grows over time, the time and cost of this repetitive scanning
grows proportionately. Eventually, as larger organizations are beginning to discover, the data migration
window becomes too small to accommodate all of the scans and processing that need to be done to
determine what to move. At this point, conventional data migration is no longer practical or economically
viable. A solution has turned into a problem.
Another challenge is that the simple rules used by conventional data migration methods move files without
regard to their business value or future needs. This results in very few files ever being deleted, further
accelerating the cost. In fact, users often come to view non-primary storage tiers as an alternative to deletion
and thus keep more data online. This means that the costs and resources needed for finding potential files to
move grow without bounds, as does the size of other storage tiers. Most organizations will ultimately reach the
point where the cost of conventional data migration cancels out all of its benefits.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 4
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
Precision Tiering: A New Paradigm
The solution to the problems posed by conventional data migration methods is to think about the
opportunity differently. Conventional methods look at data migration as though it were a project: “We
need to find all the files to move from primary storage and get them migrated.” However, data migration is
not a series of one-time events; it needs to be an ongoing process.
Primary storage as it exists at any given moment performs well as long as it remains in a steady state. If no
new data were ever added, nothing would ever need to be moved. Only when users add to the existing
contents of primary storage does something need to change. This is the critical insight:
It is user activity that triggers data migration, not the passage of time or periodic
scans. Data migration needs to be real-time – all the time – behind the scenes and
automated.
It is in this context that we introduce NTP Software Precision Tiering.
What Is NTP Software Precision Tiering?
NTP Software’s Precision Tiering solution incorporates three components:
 NTP Software QFS® is used to configure storage policies on what kinds of files can be stored and
how much storage users can consume (storage quotas).

NTP Software On-Demand Data Movement™ (ODDM™) translates storage policies to decisions
about what files should be moved, and also has the capability to manage user’s own data migration
decisions.

NTP Software Right-Click Data Movement™ (RCDM™) provides a simple interface that enables users
to take control of their own data migration decisions in order to stay within their quotas or comply
with corporate or regulatory data management requirements.
NTP Software’s Precision Tiering solution allows for flexibility in your approach to data migration with
automated policy-driven movement, manual user-driven movement, or a combination of both. You decide
what is best for your organization.
Precision Tiering can also incorporate NTP Software Storage Assessment to provide you with a simple way
to understand the makeup of your file data environment and how file data is being used. With greater
insight into what types of files are being stored, who is using them, and how often, it is easier for you to set
policies to move file data from primary storage to archival storage. Once you know what’s being stored and
how files are being used, NTP Software Precision Tiering determines what data can be migrated. NTP
Software redefines the economics of data movement by being event- and policy-driven in real time, rather
than requiring repeated scans of the entire file system, thus greatly helping to reduce storage-related costs.
NTP Software Precision Tiering provides a simple way to migrate data between storage tiers, automatically
or through user interaction using a single click in order to:

Meet a compliance, security, or ISO requirement
Copyright © 2014 NTP Software. All Rights Reserved.
Page 5
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering

Ensure that valuable data is properly protected

Prepare, collect, and protect a "body of evidence" such as for legal, research, or healthcare
purposes

Protect creative and intellectual property such as engineering drawings

Move regulated files such as medical images to a repository for HIPAA compliance and long-term
archiving
One of the greatest benefits of Precision Tiering should not be overlooked: There is no longer any
requirement to scan the entire file system. Scanning terabytes of data to find files to move from primary
storage takes hours and generates millions of I/Os. With conventional data migration methods, this has to
be done over and over again – every week or every month. With Precision Tiering, these costs and the
associated impact on production are completely eliminated – forever!
Policy-Driven and User-Driven Data Movement
As noted previously, NTP Software Precision Tiering offers two ways to migrate data: Policy-Driven
Movement™ and User-Driven Movement™.
In situations where it is appropriate to engage the user community through User-Driven Movement, users
are presented with a summary of the data for which they are responsible via an easy-to-use, selfexplanatory interface. From this interface, users can view their data in a variety of ways that are
appropriate for managing storage, for example, by size, age, or type.
It is at this point that end users add real value to the overall process. With NTP Software Precision Tiering,
users are empowered to use their unique knowledge of the business value of their files by selecting the
data most appropriate to move from primary storage (as opposed to the files they know they will need to
use next week or next month). By connecting users to the process, they can reduce administrative costs,
add value, and understand what's happening to their data and why.
The specifics of what happens in User-Driven Data Movement through NTP Software Precision Tiering
implemented in conjunction with NTP Software QFS® are illustrated on the next page.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 6
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
1.
2.
3.
4.
5.
6.
The user stores or manipulates data, triggering a policy.
NTP Software QFS® notifies the end-user of the policy and the user’s status.
The user selects files to move with NTP Software Storage Investigator™
NTP Software Storage Investigator gives NTP Software Precision Tiering™ the list of files to be moved.
The tiering engine translates the list into criteria for specific actions and activates the data movement task service.
The specified files are moved to archival storage or another appropriate storage tier.
In some cases, it is not desirable to have users make the decisions about what data should be moved – for
example, when certain files must be kept to meet corporate or government regulations, or to provide an audit
trail for legal purposes. In such cases, Policy-Driven Data Movement is still driven by user activity in primary
storage (and not by expensive file system scans), but users are not engaged in the process of deciding what
to move. Instead, NTP Software Precision Tiering applies its logic / rules in a granular manner and makes
decisions on behalf of the user about what files are to be moved from primary storage.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 7
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
The specifics of what happens in Policy-Driven Data Movement through NTP Software Precision Tiering
implemented in conjunction with NTP Software QFS® are illustrated below.
1. The user stores or manipulates data, triggering a policy.
2. NTP Software QFS triggers the NTP Software Precision Tiering Engine.
3. NTP Software Precision Tiering uses policies to determine specific actions and activates the data
movement task service.
4. The specified files are moved to the most appropriate storage tier, such as archival storage.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 8
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
Key Benefits of Precision Tiering
Precision Tiering offers a number of benefits to your organization, including:






Total visibility – Gain comprehensive reporting across all platforms down to the file/user level. With
a better understanding of what is on your file system, you can more easily manage your file data.
Automated data movement – Perform migration while remaining online to ensure 24 x 7
continuous data access. Precision Tiering helps you manage your file data while preserving system
availability.
Simple integration with popular archival storage platforms – Help ensure optimum system
performance and simple installation. Precision Tiering offers a way to apply your existing policies to
your archival storage decisions.
Improved ROI – Use the right storage for the right data to help reduce costs. Precision Tiering saves
costs by enabling you to move files manually or automatically to the most appropriate storage tier.
Event- and policy-driven file data migration – Avoid repeated scans of the entire file system.
Precision Tiering saves you time and money by operating in real time based on storage events (e.g.,
reaching a certain threshold), policies, or user activity.
Fluid data management – Automate management across locations, storage types, and brands
through a single interface “lens” to save time and money. NTP Software Precision Tiering offers
support for NFS and CIFS and all major platforms.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 9
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
Conclusion
Traditional data migration, while having provided real benefits over the years, has become time-consuming
and laborious to the point where costs now exceed the benefits. Many end-user organizations can no
longer accommodate the cost and resources required for the periodic and time-consuming file system
scans necessary for traditional data migration.
NTP Software Precision Tiering represents a paradigm shift. It delivers all the benefits of data migration
without the cost and resource constraints of earlier solutions. By eliminating expensive file system scans and
providing a simple and automated data movement process, NTP Software Precision Tiering makes it easy for
your organization to find and migrate data continually and automatically to the most appropriate storage
tier, ensure proper archiving of valuable data, meet compliance and governance requirements, and ensure
proper data protection. The net result is a dramatic boost in storage ROI, a large reduction in storage system
spending and administrative overhead, and an increase in the business value of your data.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 10
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
About NTP Software
NTP Software puts users in charge of their file data and is the only company providing file data
management solutions that deliver all of the enterprise-class features needed to understand, manage,
monitor, and secure file data completely. NTP Software is a global leader and has been chosen by the
majority of Fortune 1000 companies and thousands of customers in private and public sectors for providing
leadership through superior solutions, professional services, experience, and trusted advice. NTP Software
delivers a single solution across the entire data storage environment, from individual files and users to an
entire global enterprise across thousands of systems and sites. NTP Software reduces the cost and
complexity associated with the exponential growth of file data and is located on the web at
www.ntpsoftware.com.
Copyright © 2014 NTP Software. All Rights Reserved.
Page 11
Reducing Primary Storage Costs and Complexity with NTP Software Precision Tiering
The information contained in this document is believed to be accurate as of the date of publication. Because NTP
Software must constantly respond to changing market conditions, what is here should not be interpreted as a
commitment on the part of NTP Software, and NTP Software cannot guarantee the accuracy of any information
presented after the date of publication.
This white paper is for informational purposes only. NTP SOFTWARE MAKES NO WARRANTIES, EXPRESS OR
IMPLIED, IN THIS DOCUMENT.
NTP Software and other marks are either registered trademarks or trademarks of NTP Software in the United
States and/or other countries. Other product and company names mentioned herein may be the trademarks of
their respective owners.
NTP Software products and technologies described in this document may be protected by United States and/or
international patents.
FURTHER QUESTIONS?
Call or email NTP Software today. We can help. [email protected]
NTP Software
20A Northwest Blvd., #136
Nashua, NH 03063
Toll Free: 800-226-2755
International: 1-603-622-4400
www.ntpsoftware.com
Copyright © 2014 NTP Software. All rights reserved. All trademarks and registered trademarks are the property
of their respective owners. Doc# 4171EF Rev. 4.0
Copyright © 2014 NTP Software. All Rights Reserved.
Page 12