Arcadia Data, provider of native visual analytics software for big data, will support KSQL, a new technology for continuous, interactive queries on Kafka topics via SQL.
“What KSQL is about is simply providing a SQL interface on top of Apache Kafka so that now you can do the querying directly on the stream versus having to store it into an intermediary staging area where you can do the querying,” said Dale Kim, senior director of products and solutions.
The integration with Confluent’s KSQL gives all users advanced visualizations for streaming data use cases, specifically around alerts and time-based data exploration (and drill downs).
“We have the plumbing in place to update screens in real-time based on changes in the data, so there is no manual refresh required,” Kim said. “You can take advantage of the constant updates that are going on in the data stream.”
Industries ranging from financial services to automotive can deploy analytical applications with real-time requirements in critical initiatives including predictive maintenance, financial services risk reporting, and data quality checks.
With the KSQL integration, Arcadia Enterprise unlocks the value of IoT analytics to business analysts and lets any user directly query the streaming data sets, or “topics,” in Apache Kafka, platform for managing real-time data.
KSQL leverages the popular SQL query language to run analytics on data-in-motion, so Arcadia Enterprise can more easily query real-time data combined with historical data in consolidated visualizations.
The integration with KSQL will enable Arcadia Data users the ability to browse real-time streaming data in the form of Kafka topics via drag and drop querying, get native visual analytics on real-time streaming data, analyze data earlier in the pipeline in a self-service manner, i.e., without data modeling/transformation, combine historical and real-time analysis in unified analytical applications, and run visualization-based use cases around alerting and historical/real-time drill down analytics.
“Now you can combine streams and tables in the same query so you have the best of the real-time as well as the historical data,” Kim said.
All types of business analysts who are used to using visualization and standard BI tools will benefit the most from this, according to Kim.
“People who are looking at data and trying to make insights and decisions and they need to know what happened in the last few seconds more so than what happened hours or days ago,” Kim said.
For more information about this announcement, visit www.arcadiadata.com.