Marketplace For Buyers For Vendors For Partners

Lenses Stream Reactor: S3 Source & Sink Kafka Connectors

An Apache Kafka Connect plugin for Amazon S3. As both a source and sink, it holds powerful enterprise features to support many data integration use cases including backup/restore of Kafka topics, data replication across Kafka clusters, sourcing multi-line events/XML and hydrating a data warehouse with optimized object partitioning. It works on any Kafka Connect cluster including AWS MSK Connect. The plugin is licensed under Apache 2.0, open source and available with optional enterprise support via a subscription with Lenses.io.

Purchase this listing from Webvar in AWS Marketplace using your AWS account. In AWS Marketplace, you can quickly launch pre-configured software with just a few clicks. AWS handles billing and payments, and charges on your AWS bill.

About

An enterprise-grade Apache Kafka Connect Source & Sink plugin for Amazon S3 designed to support critical business flows.

The connectors hold powerful enterprise features.

For sourcing:

Collecting unstructured data including multi-line events & XML

Task parallelization for optimal throughput

Dynamic S3 partition discovery

For sinking:

Support for writing to AVRO, Parquet, JSON, Bytes and Text

Full object export (key, value, metadata and headers)

Object partitioning by key, value, headers and time window

Exactly-once semantics

Hive-style (eg. key=value) object partitioning

This widely used connector integrates Kafka and S3 to support a number of use cases including hydrating a lakehouse, cost-efficient Kafka topic backup/restore, and data replication to another Kafka cluster.

It can be deployed as a standalone plugin for any Apache Kafka Connect cluster (including MSK Connect) or deployed via Lenses for a simplified single click management with role-based security, auditing, monitoring, and governance.

The plugin is licensed under Apache 2.0, open-source and available with enterprise support from Lenses.io.

Contact info@lenses.io for details about enterprise support offerings.

Related Products

Sedai for ECS: Autonomous Optimization & Remediation

Sedai for ECS is an autonomous cloud management platform powered by AI/ML delivering continuous optimization for cloud operations teams to reduce costs by 40%, improve performance by 35%, reduce FCIs by 50% and improve ops productivity 6x

AI based Intelligent Document Processing

Our product is an advanced artificial intelligence solution designed to streamline document processing workflows for businesses of all sizes. Leveraging cutting-edge machine learning algorithms, it automates the extraction, analysis, and interpretation of valuable information from a variety of documents, including invoices, contracts, forms, and more. With this powerful tool, businesses can significantly reduce manual effort, minimize errors, and accelerate decision-making processes.

Automated SAS to Pyspark Conversion

SAS workloads come with high costs, scalability challenges, and limited flexibility. Hexaware’s Amaze® accelerates SAS-to-PySpark migration using Gen AI and LLM-powered automation, ensuring a 70-80% conversion accuracy, 3x-5x faster execution, and up to 40% cost savings.

Vectra Cognito for Service Delivery Partners (Billed Monthly)

Vectra Threat Detection and Response for Partner Provided Consulting Engagements

Real-time & Historical Datafeeds | Global Post-War Contemporary Auctions

This dataset is prepared for statistical factor pricing models and standardized across variables including country, region, currency, vendor, artist for seamless data filtering. It contains 20+ years of all items in the Post-War & Contemporary art category sold on auction by Christie’s, Sotheby’s, Bonhams and Phillips from 2000 to date.

Philter

Philter deidentifies and redacts sensitive information, such as Personally Identifiable Information (PII) and Protected Health Information (PHI), in text.

Tuberculosis - Total number of cases in the US | CDC

Centers for Disease Control and Prevention provides free and open access to various health related data. This release contains total number of Tuberculosis cases reported in the United States, by region and by states, in accordance with the current method of displaying WONDER data. Data on United States will exclude counts from US territories. The data is available for past 2 years.

AWS Security Review

An AWS Security Review is an opportunity to ensure that your cloud infrastructure is optimized for performance, security, reliability, and cost-effectiveness. Our certified AWS architects will identify any potential issues or areas for improvement in your AWS environment and make recommendations to get your back on track.