Due to the constant influx of data, data warehousing has been forced to evolve or get left behind. Conventional, on-premises data warehouses are simply unable to provide the agility, elasticity or pay-as-you-go efficiency that today's businesses and analytics use cases demand.
But replacing an established on-premise EDW is not as simple as moving tables from point A to point B.
DBTA recently held a webinar with Joe Yong, senior product manager at Microsoft and Rik Tamm-Daniels, senior director of strategic cloud and big data alliances at Informatica, who discussed the benefits and challenges of moving to cloud data warehousing.
Cloud data management drivers and challenges include an explosion in data volumes and types, increased data silos, migration planning, context, data security, and data quality, explained Young and Tamm-Daniels.
The solution combines a data catalogue with data integration and management and a data warehouse.
Azure SQL DW can help, Young and Tamm-Daniels explained. The platform offers:
- The ability to provision a fully managed cloud data warehouse in minutes
- Separation of compute and storage, scale compute in seconds, pay only for what you use
- Save big with pause/resume for batch-based workloads
- Unmatched innovations in security – automatic threat detection
- PolyBase for T-SQL query across Hadoop clusters
- MPP scale to petabytes, geo-redundant w/99.9% SLA
The solution boasts benefits such as enterprise scale future proofing for existing investments; support for hybrid, cloud, and on-premise environments; long standing partnerships with other companies; scalable model for data warehousing and management; and is easily accessible with quick ramp-up.
The essetiantials for successful CDW projects include:
- Catalog for data visibility
- Robust connectivity architecture
- Operational confidence
- Flexible and repeatable integration
- Elasticity
- Performance
- Security
An archived on-demand replay of this webinar is available here.