To support decision-making with rapid data movement, the latest version of Continuent Tungsten Replicator, an open source replication solution for Hadoop, replicates transactions from operational database systems such as MySQL, MariaDB and Oracle to Hadoop in real-time. According to Continuent, this produces exact copies of tables and enables the execution of analytic views in Hadoop within multiple environments including Hive.
By automatically reading the database management system and forwarding transactions when they commit, Continuent says, Tungsten Replicator can reduce the load on operational systems, minimize the amount of data that needs to move between locations, and allow transactions to quickly enter the data warehouse. In addition, when used together with Apache Sqoop, businesses can provision information and then leverage Tungsten Replicator to replicate transactions incrementally in real-time, providing continuous data loading so existing data and changes can easily be applied into Hadoop.
"Today, organizations are struggling to achieve real-time integration between MySQL/MariaDB and Hadoop and Oracle and Hadoop," said Robert Hodges, CEO, Continuent. "Rapid loading of data into Hadoop enables effective analytics and is becoming increasingly crucial, as Hadoop itself raises the bar for real-time query through technology like the Cloudera-sponsored Impala project, Spark, and HBase. With a flexible topology, our low cost, open source based solution provides organizations with a high-performance, low-impact way to transfer data from multiple upstream systems into Hadoop and to handle billions of transactions daily in order to derive demonstrable business value."
For more information, visit www.continuent.com.