Amazon MSK Connect Launched to Better Apache Kafka UX
Amazon follows up on its 2018 data streaming software, Amazon Managed Streaming for Apache Kafka, with a new offering optimized with managed connectors.
On 16 September 2021, AWS announced the launch of Amazon MSK Connect, an offering with extended compatibility to facilitate Kafka Connect efficiency.
Amazon MSK Connect supports inter-platform migration with supported platforms.
Amazon MSK Connect mitigates Kafka Connect setup processes with just a few clicks.
It eliminates the burden of managing infrastructure, allowing users to focus on important events.
Since its announcement at re: Invent 2018, the real-time data pipeline streaming platform has been optimized by many in the DevOps community.
Apache Kafka is a stream-processing framework that implements a software bus. It is a Scala and Java-based open source development platform developed by the Apache Software Foundation. It is oriented at providing a single, maximum-throughput, low-latency platform for real-time data flows. In 2018, Amazon launched an extension to facilitate real-time data streaming, Amazon Managed Streaming for Apache Kafka, which leverages Apache Kafka's capabilities to build and run applications and data pipelines with ease.
Kafka Connect is an Apache Kafka open source accessory that provides a framework for connecting to external systems such as databases, search indexes, file systems, and key-value stores. Manually running Kafka Connect clusters, on the other hand, necessitates users planning and provisioning the necessary infrastructure, managing cluster operations, and scaling the cluster in response to load changes.
Amazon's new offering is a game-changer in that instance. Amazon MSK Connect makes MSK Connect more soothing to operate. MSK Connect is an escape from the voluminous setup requirements associated with Kafka Connect. Users can now connect and deploy a connector with just a few clicks. It assumes the role of a virtual assistant, perennially monitoring the condition of the connectors to detect frailties that might cause any vacillation. It is automated to patch and manage the latent hardware, auto-scale connectors to match throughput changes. This way, users can implement this on large batches of data without the need for a heavy workforce or constant monitoring; therefore, they can focus on building applications.
MSK Connect and Kafka Connect are entirely compatible; customers may move their current connectors without changing any code. MSK Connect does not require an MSK cluster. It supports Amazon MSK, Apache Kafka, and Apache Kafka compatible clusters. As long as MSK Connect can privately connect to the clusters, these clusters can be self-managed or managed by AWS partners and third parties.
Get similar news in your inbox weekly, for free
Share this news:
The all-in-one monitoring solution for IT admins, DevOps and SREs
Get deep visibility into the performance of your complex enterprise applications and cloud native workloads. Identify potential issues, improve productivity, and ensure that your business and end users are unaffected by downtime and substandard performance ...
How ManageEngine Applications Manager Can Help Overcome Challenges In Kubernetes Monitoring
We tested ManageEngine Applications Manager to monitor different Kubernetes clusters. This post shares our review …
IT Monitoring Powered by AIOps
Harness the power of artificial intelligence (AI) and machine learning (ML) to monitor your IT resources with Site24x7's artificial intelligence for IT operations (AIOps) and machine learning operations (MLOps). Improve mean time to repair (MTTR) issues with the help of Site24x7 AIOps ...
AIOps with Site24x7: Maximizing Efficiency at an Affordable Cost
In this post we'll dive deep into integrating AIOps in your business suing Site24x7 to …
A Review of Zoho ManageEngine
Zoho Corp., formerly known as AdventNet Inc., has established itself as a major player in …
Should I learn Java in 2023? A Practical Guide
Java is one of the most widely used programming languages in the world. It has …
The fastest way to ramp up on DevOps
You probably have been thinking of moving to DevOps or learning DevOps as a beginner. …
Why You Need a Blockchain Node Provider
In this article, we briefly cover the concept of blockchain nodes provider and explain why …
Top 5 Virtual desktop Provides in 2022
Here are the top 5 virtual desktop providers who offer a range of benefits such …