Industries ranging from financial services to automotive can deploy analytical applications with real-time requirements in critical initiatives including:
- Predictive maintenance. Companies with specialized products and machinery need easier ways to identify impending failures that result in significant losses. Visualizations on streaming data allows analysts to see trends and patterns that lead to failure, so equipment can be repaired or replaced before the failure occurs.
- Financial services risk reporting. With real-time analysis, banks are able to get an immediate understanding of capital market risk, and can make quick decisions about asset allocation and continuously ensure compliance.
- Data quality checks. By identifying data quality issues earlier in the pipeline as data is coming in, businesses can avoid costly downstream errors that lead to bad or delayed decisions. Checks are run on each input source to uncover problems up front and resolve issues faster.
Thanks to the Internet of Things (IoT), today’s organizations are leveraging massive volumes of fast-moving data unlike ever before. However, since most existing IoT analytics technologies are developer-oriented, only data engineers or data scientists obtain business value from streaming data, and only with significant IT intervention. With the KSQL integration, Arcadia Enterprise unlocks the value of IoT analytics to business analysts and lets any user directly query the streaming data sets, or “topics,” in Apache Kafka, a leading technology for managing real-time data. KSQL leverages the popular SQL query language to run analytics on data-in-motion, so Arcadia Enterprise can more easily query real-time data combined with historical data in consolidated visualizations. Unlike legacy business intelligence tools that require manual refreshes on constantly changing data, Arcadia Enterprise leverages the push-based model of Kafka to deliver true real-time visualizations.
Arcadia Data has pioneered native visual analytics on any big data, including Apache Kafka streams,” said Shant Hovsepian, CTO of Arcadia Data. “Our architecture enables the upcoming integration with Confluent’s KSQL to deliver true real-time visualizations with drill downs and alerting, without the need for intermediate databases. We are pleased to partner with Confluent to support this exciting new product.”
The integration with KSQL will enable Arcadia Data users the ability to:
- Browse real-time streaming data in the form of Kafka topics via drag and drop querying;
- Get native visual analytics on real-time streaming data;
- Analyze data earlier in the pipeline in a self-service manner, i.e., without data modeling/transformation;
- Combine historical and real-time analysis in unified analytical applications; and
- Run visualization-based use cases around alerting and historical/real-time drill down analytics.
With the introduction of KSQL, now anyone who is familiar with SQL can do stream processing on Apache Kafka,” said Neha Narkhede, co-founder and CTO at Confluent. “By providing visual analytics, Arcadia Data is giving users another layer to derive value from data, and we’re excited to partner with them on this effort.”