VM Instance

Apache Kafka with CMAK on Amazon Linux 2

Apache Kafka data streaming is used by over 80% of Fortune 100 companies including Goldman Sachs, Target, and Intuit for mission critical applications.  Kafka is built with a client server architecture that handles event producers, processors, connectors, and consumers for scaling without downtime. A high throughput capability manages large data flux in real time. It publishes and subscribes to event streams while continuously importing and exporting data from other systems.  

Kafka’s reliability is ensured by its distributed structure. Each data partition is replicated for durability and reliability. Clusters have fault tolerance against database and server failure. The Cluster Manager for Apache Kafka (CMAK) monitors clusters and service performance. 

Amazon is the largest cloud service provider in the world. Most users rely on Amazon cloud servers for their entire enterprise infrastructure and applications. Amazon Linux 2 integrates with Amazon’s cloud computing platform and Amazon Web Services (AWS). AWS includes an updated deep security manager, C library, compiler, build toolchain, Amazon Machine Image (AMI), cloud-init, and optimized LTS Kernel for better performance on Amazon Elastic Compute Cloud (EC2). Customer workloads perform better on Amazon Linux 2, which supports the latest EC2 instance capabilities. 

Amazon Linux 2 is a stable, secure, high-performance OS. It develops and runs cloud and enterprise applications with updated community-driven enhancements. Unlike most operating systems, it includes both long term support (LTS) and the latest and greatest popular software packages. 

Get it on Azure

Apache Kafka with CMAK on Oracle Linux 8.4 streams generate real time information for transactions, shipping, logistics, and sensor data from apps on IoT (Internet of Things) devices and databases. Information is continuously collected, processed, stored, and analyzed, but users can retrospectively manipulate data. Apache deploys microservices and distributes apps to scale streams in parallel. Its scalable client server architecture features a pull-based design with batch processing to prevent user-end overload. A scalable replication election algorithm decouples producers and consumers to transfer and store data. Event streams redirect to multiple locations as desired. Apache streams persist through network and hardware outages. 

Cluster Manager for Apache Kafka monitors and controls how multiple clusters function. Partitioning and replicating stream data into distributed clusters guarantees minimal latency, high fault tolerance, and zero message loss for on premise and cloud deployments. CMAK enables users to create partition assignments and reassignments. Kafka Connect adds connectors to event sources like PostGres, JMS, Elasticsearch, and Amazon Web Services (AWS) which are managed by REST API. Custom connectors are also supported. Apache Kafka supports a multitude of common client libraries such as C, C++ Go, Java, Scala, .NET, and Python. Security uses SSL and SASL mechanisms for traffic encryption and authentication. 

Amazon Linux boosts developer productivity. AWS LTS applies to systemd, GCC 7.3, Gilbc 2.26, and Binutils 2.29.1 core packages. Rapidly evolving technologies are updated more frequently and are included in an extras channel. System manager (formerly SSM) configures and manages scalable EC2 instances, edge devices, virtual machines (VMs), and on-premises servers. 

Ntegral certified images are always up-to-date, secure, and built to work right out of the box. 

Ntegral packages applications following industry standards, and continuously monitors all components and libraries for vulnerabilities and application updates. When any security threat or update is identified, Ntegral automatically repackages the applications and pushes the latest versions to the cloud marketplaces.