Redpanda, the all-in-one streaming data platform, is unveiling a variety of new AI integrations available within Redpanda Connect, a lightweight yet powerful integration framework written in Golang offering a collection of sources, sinks, and processors that power real-time data and AI pipelines. By expanding AI connectivity with cloud availability—as well as launching a series of other innovations—Redpanda continues to help customers integrate disparate systems in the blink of an eye, according to the company.
Redpanda Connect for Cloud now offers over 100 cloud-based managed connectors and stream processors, including connectors for popular AI services—such as OpenAI, Vertex AI, and AWS Bedrock—and vector databases—such as Pinecone and Qdrant. Additionally, Redpanda Connect offers GPU clusters on GCP for high-performance workloads. The latest AI connectors are all available on major cloud providers, including AWS, GCP, and Microsoft Azure.
“Redpanda has consistently exceeded our expectations,” said Arya Ketan, senior principal engineer at ShareChat. “As a long-time user of Redpanda Connect [since] before it was acquired earlier this year, we are incredibly excited about the new capabilities and value Redpanda has added in such a short time. Redpanda was already saving us millions of USD annually, but bringing these connectors to the cloud will save our data teams significantly in time and resources by ensuring an instant and seamless experience.”
Redpanda’s connector announcement is accompanied by the unveiling of its latest vision, Redpanda R1, a multimodal streaming engine. Redpanda R1 will support flexible topics that empower enterprises to meet latency, storage, durability, and security access demands common for modern streaming data applications.
“The data streaming market is rapidly evolving to support the diversity of data-intensive applications, especially connecting modern AI systems with cloud-native tools,” said Alex Gallego, founder and CEO of Redpanda. “We are committed to helping developers simplify how they build real-time applications by unveiling our vision for Redpanda R1. Unlike complex disjointed alternatives, we want developers to experience a unified product with topic-level flexibility that can deliver any latency, durability, or connectivity requirement in a single engine.”
With Redpanda Connect on the cloud comes additional announcements:
- Cloud Topics: A new type of topic designed to be optimized for workload demands, including latency, cost, or performance, which run in the same Redpanda cluster as other topic types.
- Apache Iceberg Topics: A new type of topic that enables streaming data to be instantly available as Iceberg tables in data lakes and data lakehouse catalogs. These topics can be easily analyzed through standard cloud-based SQL engines.
- Kafka Migrator for Redpanda: A new tool that, through a single command, can migrate schemas, metadata, and access configurations from Kafka clusters to Redpanda, accompanied by simplified observability and error reporting for accelerated troubleshooting.
To learn more about Redpanda’s latest updates, please visit https://www.redpanda.com/home.