The need for faster and smarter data integration capabilities is growing. The proliferation of data sources, types, and stores is increasing the challenge of combining data into meaningful, valuable information.
At the same time, to deliver business value, people need information they can trust to act on, so balancing governance is absolutely critical nowadays, especially with new regulations.
DBTA recently held a webinar with Pradeep Bhanot, director product marketing, Actian; Will Davis, senior director of product marketing, Trifacta; and Diby Malakar, VP of product management, SnapLogic, who discussed key technologies and best practices for overcoming big data integration and governance challenges.
Users want both application and data integration in a single, unified platform, Malakar said. The perfect platform includes features such as:
- a self-service, AI-powered, cloud-based integration platform across the enterprise to drive productivity, lower TCO, and speed time to value
- Automate all stages of IT integration projects – design, development, deployment, and maintenance
- Address needs for all personas - Integration Specialist, Ad hoc Integrator, and Citizen Integrator
- Ability to deploy in the cloud, on-premises, and hybrid models balancing innovation with enterprise-grade stability
The SnapLogic Intelligent Integration platform can provide these benefits, Malakar said. The platform contains a wide range of deployment options, delivers more than 500 snaps for integrations with other solutions, and can offer a variety of features for different personas.
The biggest challenge that comes with accelerating data lake adoption is cleaning the data, which impacts the entire data team, Davis said. The rise of machine learning and AI only worsens the problem. Cloud leaders are starting to recognize the critical role of data preparation.
Trifacta data wrangling empowers domain experts with intelligent visual interfaces that automate assessment and transformation of data, according to Davis.
The solution enables IT to collaboratively curate and operationalize data pipelines authored by domain experts and establishes an enterprise-wide platform that refines data from a variety of sources, supporting a range of users and use cases.
Legacy data warehouses hinder business growth, Bhanot explained. It’s very hard to add new data sources to EDW systems, is bogged down by slow performance, and incurs high expansion costs.
He recommended Actian Avalanche, which is an operational cloud data warehouse. The platform is delivered as a managed service that is built upon a pay as you go model.
The platform can:
- Simplify the process of provisioning a data warehouse by leveraging cloud infrastructure.
- Scale, at the pace of the business, to meet ever increasing data volumes.
- Rather than paying for peak-volume, the environment can grow and shrink as needed. The meter only runs when service is in use.
- Bring together all of your data regardless of source or type.
An archived on-demand replay of this webinar is available here.