By Sandeep Bhargava, Managing Director, Asia Pacific Japan, Rackspace Technology
According to NASSCOM, India has the second-largest internet user base globally; a figure we continue to see accelerate post the pandemic as consumers continue to move online and small businesses digitise. India had an internet subscriber base of 749.1 million as of June 2020, which is expected to cross 1 billion by 2025. This has led to an increase in the amount of data generated and consumed. Indians consumed the highest amount of data globally per month at ~12GB in 2019, which is expected to double over the next five years.
As data volume and variety increase and data sources proliferate, new opportunities will arise to deliver superior customer experiences, drive better business decisions and enable greater agility and resiliency. New technologies and approaches — such as the Internet of Things (IoT), cloud native development, AI and machine learning, and the modern data fabric — offer a path to this intelligent business vision.
Despite these opportunities and new approaches, businesses are struggling to manage data and generate meaningful analysis. They’re weighed down by issues like dirty data, misaligned data collection and governance policies. These companies risk falling behind competitors, who are using data intelligence to adapt to their customers’ needs quickly and proactively.
To gain actionable insights from data, one needs to address some common barriers. Let’s take a look at each of them.
1. Data discovery challenges
Data discovery is difficult when you have unknown data sources, poor data quality, data silos and compliance restrictions. These issues can trace their origin to data used or generated by a specific application stored in a siloed data platform, typically found in an early 2000s web application architecture or in 1990s UNIX applications.
Additionally, incomplete views of customers and other business entities, duplicated data and a general lack of understanding around what data is available (for building new applications or updating existing ones) results in less-effective services, insights and customer experiences.
Solution:
With a holistic view and understanding of your data estate, plus a modern data architecture that makes your data accessible, you can make data discovery and utilization a more natural part of your DevOps processes and culture. DevOps drives speed and quick turnaround. And your data — if it’s known and accessible and in a useful format — can be fully incorporated into your DevOps culture, development and deployment processes.
2. Excessive costs
When your infrastructure isn’t structured for utility and elasticity, your talent is expensive, and you’re facing large, ongoing investments with no guaranteed returns, costs can grow out of control.
Costs also become excessive as you continue to rely on on-premises data solutions for your worst-case scenarios — as you’re stuck servicing older virtualized applications and data infrastructure — and your on-premises data platforms servicing cloud-based applications may incur higher than needed ingress/egress fees.
Solution:
By moving data platforms to the right public and private clouds in a multicloud architecture, you get the benefits of multicloud — including elasticity, self-service, optimized economics and cloud native services — so you can develop modern applications and host a modern data architecture.
3. Complexity
Choosing the right mix of technologies, identifying architectural best practices for deployment, and integrating cloud, on-premises and edge – these are all complex responsibilities. Yet they’re made even more difficult if your data platform mix isn’t optimized.
For example, your data may have been forced into a traditional relational data management system, or worse, into unstructured files, even though that is not the optimal place for data use and analysis. This makes developing applications using this data more difficult and less effective.
IoT dramatically increases the data coming into your business. But it must be analyzed and intelligently separated into data flows that support the business to the extent that your applications get the data they need and when they need it. Many organizations either do not leverage the IoT or do so in a manner that overly restricts their data being used from the IoT. While these approaches result in preventing data flooding with its reliability, security and availability issues, they eliminate the benefits of using all of the appropriate data in their business ecosystem.
Solution:
Dealing with the explosion of data variety, velocity and volume is complex. But by putting this data into the right data platforms and in the right clouds configured into a modern data architecture, your data can be more readily used, more cost effective and set the foundation for modern analytics and superior business insights.
4. Skill gaps
Most organizations don’t have the necessary in-house skills to optimize their data architecture for modern AI/ML use cases and cloud native applications. To create a modern data fabric, you need specialized education, training and experience not organically available in typical IT teams. This skills gap also contributes to data integration architecture that is scattered and opportunistic which prevents applications from getting the right data at the right time and leading to less-than-optimal experiences, results and insights.
Solution:
Work with a partner whose team has the right skills, career paths and continuous work experience, particularly those that are always busy solving problems and building expertise across many different industries and use cases. This helps ensure that they’re able to attract and retain the best data people.
Achieving actionable data insights
With a modern data architecture, your data can help drive better business processes, experiences and decisions. And with a fully integrated data environment supported by DataOps and MLOps, your business and IT teams can make intelligent business and IT decisions that will drive the most value to your customers and have the greatest impact on your business’s bottom line.