August, 2019

Data is growing at an exponential rate in the modern borderless world. Over 2.5 Quintilian bytes of data is generated every day across the globe. India alone is set to produce 2.3 million petabytes of digital data by the year 2020, and it is growing at a rate that’s much faster than the world average. Many enterprises are also exploring online data backup in the cloud further fueling this data explosion.

This data explosion increases the demand for storage capacities that are served by Data Centers. In just two decades, Data Centers have scaled up from the size of a room to the size of a commercial tower giving way to accommodate this increased storage need. Besides storage, modern Data Centers are also sprucing up to handle more services. They are more connected than ever and can meet the needs of the contemporary business world.  New solutions have emerged around Data Center architecture that can bring competitive advantages to users through more optimized performance. Data Centers have now become critical components of a modern IT infrastructure.

In India, we see emerging businesses growing at a fast pace, with cloud computing technologies and cloud warehouses taking the lead to store enormous amounts of digital data. At the beginning of the 21st century, most organizations in India had captive Data Centers that were self-managed. With advances introduced in cloud technologies and specialized players adding more capabilities, the self-managed option was replaced by the outsourcing model. Increase in the users, economic growth of the country, and cost advantages of cloud-based Data Centers are some of the trends driving adoption of a cloud-based architecture.  Captive Data Centers are expensive to accommodate and challenging to scale. However, cloud-based Data Center architectures are more flexible.

Many new technologies, services, and facilities that were premium and rare earlier are now part of standard offerings in modern Data Centers. These services are reshaping the way businesses operate today.

Another trend to note is the emergence of Modular 4th generation Data Centers. These Data Centers comprise modular units that help in quickly scaling up the infrastructure. In addition to the components in the racks being modular, the building itself could be modular. For instance, some Data Centers are built in shipping containers. Scaling up means adding more shipping containers with Data Center units.

Resolving the Challenges

Many challenges of the past have now been resolved with architectural advances in the Data Center space. For instance, Pod architecture for SaaS assigns a set of machines to a specific job or customer for all of its required tasks. To create redundancies for power and cooling in a Data Center, a lot of assembling needs to be done which can incur a cost. You may also need to construct additional racks. However, POD comes with frames that are free standing and compatible with most equipment so it can be used for all needs including power, cooling, and cabling. So, your need for construction within the Data Center facility is minimized. It can simplify infrastructure scaling to support your digital growth. It is a standardized deployment that can automate user provisions. It allows you to use shared storage, firewall, and load balancing while customizing individual PODs as per your business needs. When scaling up users, you would not need to perk up your whole infrastructure but only add or remove specific resources user-by-user, which can help reduce overheads.

While Data Centers serve as an ideal place to use your critical applications, operating them has been a big challenge in the past. A Data Center is affected by many environmental factors that add inevitable complexities. A Data Center operator needs to take care of the cooling needs of Data Centers as well as maintain correct levels of air and humidity in the storage spaces. These challenges make it worthwhile for companies to try cloud-based shared storage space managed by third-party experts who could be better equipped to counter these problems. In modern warehouses, Computer Room Air Conditioning (CRAC) device is used instead of traditional air conditioning, which can monitor as well as maintain humidity, air flow, and temperature in a Data Center.

The future is smart!

The future of the Data Center is smart: modern Data Centers are now offering converged infrastructure, and the trend is further moving towards hyper-convergence. This has brought many advantages for Data Center operations and has also solved problems that paralyzed companies earlier. The risk of hardware failure, for instance, plagues companies with the risk of losing data and they struggle to rebuild their infrastructure. Siloed approaches to managing servers was another challenge that made Data Center operations expensive and complicated. With converged infrastructures, the process of managing a Data Center gets organized; with a single interface used for infrastructure management, your company turns more proactive in streamlining your operational processes and in keeping your data on the cloud safe.

While consolidation of operations through convergence makes management easier, most servers are still siloed, and that is where hyper-convergence plays its magic. Hyper-converged Data Centers are software-defined Data Centers that are also called smart Data Centers. They use virtualization and converge all operational layers including computing, networking, and storage into a single box. With hyper-convergence, everything is now on the same server which brings improved efficiencies, reduced costs, and increased control over Data Center components.

Colocation: A trend to watch

Rethink IT, replace captive servers with cloud services. You would now need much less space for storing the same amount of data than you needed in a captive Data Center. Welcome to the concept of managed colocation!

Colocation services (or Colo) are delivered by Data Center solution providers to enhance user experience. A hybrid cloud drives them and provides specialized services for their users. A collocation is a place where customers have better control over their private infrastructure, and with increased proximity to the public cloud, they can also be closer to their customers.

A colocation service relies on the principles of abstraction, software-based provisioning, automation, unified management, and microservices. Colo facilities are highly flexible as it can reap the advantages of both private and public cloud with a hybrid infrastructure. While private cloud gives enhanced security and control, the public cloud makes it easy to transport data over encrypted connections and gives you additional storage space.

Modern colocation services are now shifting to Data Center-as-a-Service (DCaaS) which is a much more flexible deployment than Software as a Service, Platform as a Service, and Infrastructure as a Service models. A hybrid DCaaS colocation architecture has a public IaaS platform, on hosted or on-premise private cloud and a Wide Area Network (WAN) to connect the two. A major advantage of DCaaS is the change in the cost equation. DCaaS providers have high economies of scale that allow them to offer you volume-based discounts taking your costs down. The DCaaS hybrid cloud architecture not only provides hybrid storage flexibility and cost advantage but also other benefits like increased redundancies, improved agility, and maximum security.

A hybrid cloud combines the resources available to you on the private cloud and the public cloud and gives you the flexibility to seamlessly move your data between them. With changes in your cost structures and business needs, you can flip your resources between the two clouds anytime. If you’ve reached the designed capacity of your current private cloud, you can always switch to a Public cloud for further expansion. For instance, Cloud bursting can give you on-demand storage over the public cloud so that you can shift the increased burden on your private cloud to the public in peak business seasons.

Data Center technologies are still emerging, and new architectures like hybrid cloud and hyper-convergence are taking shape. In the future, more companies would realize the benefits of these architectural modifications and will be able to enjoy far higher capacities and advanced Data Center management capabilities.

Sify offers state of the art Data Centers to ensure the highest levels of availability, security, and connectivity for your IT infra. Our Data Centers are strategically located in different seismic zones across India, with highly redundant power and cooling systems that meet and even exceed the industry’s highest standards.

Modern Data Centers are synonymous with massive high-speed computational capabilities, data storage at scale, automation, virtualization, high-end security, and cloud computing capacities. They hold massive amounts of data and provide sophisticated computing capacities. Earlier, a simple network of racks with storage units and a set of management tools to individually manage them were enough. The architecture was simple to understand, and only local resources were consumed in its operation.

However, as organizations became increasingly internet dependent, the volumes of the data exploded with more of it added by the social media and the sensing devices that grew manifold. Remote access to this data through the Web emerged as the trend. The local tools that were used earlier in traditional Data Center were fragmented and were inefficient to handle not just the volumes but also complexities that in effect needed a large infrastructure. There were challenges of scaling up when companies expanded, and performance dipped when peak loads were required to be handled. This led to the evolution of hyperscaling as a solution.

Hyperscale is based on the concept of distributed systems and on-demand provisions of the IT resources. Unlike the traditional Data Center, a hyperscale Data Center calls in a large number of servers working together at high speeds. This ability gives the Data Center a capacity to scale both horizontally and vertically. Horizontal scaling involves on-demand provisioning of more machines from the network when scaling is required. Vertical scaling is about adding power to existing machines to increase their computing capacities. Typically hyperscale Data Centers have lower load times and higher uptimes, even in the demanding situations like the need for high-volume data processing.

Today, there are more than 400 hyperscale Data Centers operating in the world, with the United States alone having 44% of the global Data Center sites. By 2020, the hyperscaled Data Center count is expected to reach 500 as predicted by Synergy Research Group. Other leading countries with hyperscaled Data Center footprints are Australia, Brazil, Canada, Germany, India and Singapore.

Hyperscale Data Center Can Do More at Less Time and Lower Cost

A traditional Data Center typically has a SAN (Storage Area Network) provided mostly by a single vendor. The machines within the Data Center would be running on Windows or Linux, and multiple servers would be connected through commodity switches. Each server in the network would have its local management software installed in it and each equipment connected to them would have its own switch to activate the connection. In short, each component in a traditional Data Center would work in isolation.

In contrast, a hyperscale Data Center employs a clustered structure with multiple nodes housed in a single rack space. Hyperscaling uses storage capacities within the servers by creating a shared pool of resources, which eliminates the need for installation of a SAN. The hyperconvergence also makes it easier to upgrade the systems and provide support through a single vendor solution for the whole infrastructure. Instead of having to manage individual arrays and management interfaces, hyperscaling means integration of all capacities, such as storage, management, networks and data, which are managed from a single interface.

Installing, managing and maintaining a large infrastructure consisting of huge Data Centers would have been impossible for emerging companies or startups that have limited capital and other resources. However, with hyperconvergence, even microenterprises and SMEs, as well as early stage startups can now enjoy access to a large pool of resources that are cost-effective and provide high scalability in addition to flexibility. With hyperconvergence, these companies can use Data Center services in at a much lesser cost with the additional benefit of scalability on demand.

A hyperscale Data Center would typically have more than 5000 servers that are linked through a high-speed fiber optics network. A company can start small with only a few servers configured for use and then, later at any point of time, automatically provision additional storage from any of the servers in the network as their business scales up. An estimate of the demand for additional infrastructure is made based on how the workloads are increasing, and a proactive step can be taken to scale up capacities to meet the increasing need for resources. Unlike traditional Data Centers that work in isolation, hyperscaled infrastructures depend on the idea of making all servers work in tandem, creating a unified system of storage and computing.

When implementing a hyperscale infrastructure, the supplier could play a significant role through the delivery of next-gen technologies that need high R&D investments. According to a McKinsey report, the top five companies using hyperconverged infrastructure have over $50 billion of capital invested in 2017 and these investments are growing at the rate of 20% annually.

Leveraging hyperscaled Data Centers, businesses can achieve superior performance and deliver more at a lower cost and a fraction of time than before. This provides businesses with the flexibility of scaling up on demand and an opportunity to continue operations without any interruptions.

Sify offers state of the art Data Centers to ensure the highest levels of availability, security, and connectivity for your IT infra. Our Data Centers are strategically located in different seismic zones across India, with highly redundant power and cooling systems that meet and even exceed the industry’s highest standards.

Imagine how an orchestra combines a multitude of instruments to create a symphony. In the same way, a hybrid cloud orchestrates, skillfully combining public and private cloud, to create a seamless cloud infrastructure.  As multiple applications on a public–private hybrid infrastructure could add to complexities, with the help of orchestration, a centralized structure can be created to allow management of multiple applications using a single interface. Differences in bandwidths, workloads, and access controls can all be managed by this orchestration software.

Integration of different technologies in a hybrid infrastructure determines how effective the orchestration is. For seamless integration, the compatibility between different systems and applications must be ensured, so that orchestration of workloads between public and private clouds is seamless, providing the needed high-performance compute. In the absence of orchestration, enterprises using a hybrid cloud would be forced to manage the public and private clouds in silos, which can put pressure on their resources and demand additional overheads. In addition, orchestration provides the benefit of streamlining resources for coordination, making it easier to manage multiple workloads.

Orchestration on the Private Cloud

A private cloud may not be cheap, but it brings its advantages. It gives greater control over assets and provides enhanced cloud security, resiliency, and flexibility to the system. With private cloud orchestration, automation of the infrastructure could be managed, by establishing workflows that work without human intervention. While private cloud automation would initiate processes automatically, orchestration results in a unified structure of workflows. In this arrangement, resources can be provisioned as needed to optimize the workloads on a private cloud. Thus, an organization can realize savings in engineering time, and IT costs.

What does orchestration involve?

Orchestration enables a coordinated deployment of automation services on the cloud. Cloud orchestration happens at three levels: resource, workload, and service. At the resource level, IT resources are allocated, and at workload level, they are shared. At the service level, services are deployed so that shared resources are optimally utilized. While individual automation only takes care of a single task, orchestration automates end-to-end processes. It is similar to creating a process flow that automates the sequence of automation. The workflows created in the process enable technologies to manage themselves. There are many orchestration tools available in the market that can be used by organizations based on their individual requirements. Some popular tools are Chef, Puppet, Heat, Juju and Docker. Chef is used at OS level while Puppet is more popular at middleware level. Heat is an orchestration method developed from OpenStack, and it can orchestrate everything in OpenStack. Juju is used at the service level while Docker serves both as a tool for orchestration and technology for virtualization.

Workload placement considerations

In a hybrid cloud, both public and private applications generate different workloads. To manage these workloads, and handle their seamless switch between public and private cloud infrastructure, an appropriate cloud strategy is needed. Distributing the workload between different IT assets is a   business decision in which regulatory compliance requirements, trade-offs, business risks, cost, and growth priorities are taken into consideration. For instance, certain countries like China may have certain federal restrictions on the use of the internet for which a private WAN can be deployed. The cost could be a concern for an organization looking to provide last-mile connectivity if private cloud is deployed, but with public infrastructure used for addressing service needs of remote locations, cost savings can be realized. A private or hybrid cloud may require establishing an in-house team for IT support while public cloud can work without any, and with limited, cloud expertise in-house.

Technical parameters such as data volume, performance, security, and integration are considered when orchestrating workloads between different cloud deployments. Based on the level of importance each of these attributes carries, workloads can be shifted between the public and private cloud. Public clouds could be deployed for workloads that require a higher level of security but a lower level of integration and performance, such as CRM and information systems. When a continuous demand for a higher level of integration arises, an organization may have to add a private cloud to the IT infrastructure. Workloads like file printing, networking, and systems management may work with either nature of the cloud. However, if data volumes grow, the public cloud would not suffice, and the organization should orchestrate to a private cloud. Applications like enterprise resource planning, data marts, and Big Data analytics make use of high volumes of data that need a private cloud to manage.

A true hybrid cloud allows for easy migration of workloads between public and private clouds. It is always wise to develop a hybrid cloud strategy depending upon workloads, as portability of workloads becomes possible and traditional applications can be bridged with modern applications across the cloud infrastructure. When cloud deployments are planned based on the changing needs of the workloads using orchestration, the enterprise can make their IT infrastructure more optimized, flexible, and adaptive.

Sify’s many enterprise-class cloud services deliver massive scale and geographic reach with minimum investment. We help design the right solution to fit your needs and budget, with ready-to-use compute, storage and network resources to host your applications on a public, private or hybrid multi-tenant cloud infrastructure.