Scribd Logo
Upload

Welcome to Scribd!

  • 27 views

    Kafka TOC

    Uploaded by

    awstestacc34
    This document outlines sessions for a Kafka training course. It covers Kafka concepts, installation, configuration of producers and consumers, internals, cluster architectures, monitoring, integration with other technologies like Hadoop and Spark, and includes hands-on exercises with Kafka.

    Copyright:

    © All Rights Reserved
    Download as XLSX, PDF, TXT or read online from Scribd

    Kafka TOC

    Uploaded by

    awstestacc34
    27 views5 pages
    This document outlines sessions for a Kafka training course. It covers Kafka concepts, installation, configuration of producers and consumers, internals, cluster architectures, monitoring, integration with other technologies like Hadoop and Spark, and includes hands-on exercises with Kafka.

    Original Description:

    Kafka-TOC

    Original Title

    Kafka-TOC

    Copyright

    © © All Rights Reserved

    Available Formats

    XLSX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document outlines sessions for a Kafka training course. It covers Kafka concepts, installation, configuration of producers and consumers, internals, cluster architectures, monitoring, integration with other technologies like Hadoop and Spark, and includes hands-on exercises with Kafka.

    Copyright:

    © All Rights Reserved
    Download as XLSX, PDF, TXT or read online from Scribd
    Download as xlsx, pdf, or txt
    27 views5 pages

    Kafka TOC

    Uploaded by

    awstestacc34
    This document outlines sessions for a Kafka training course. It covers Kafka concepts, installation, configuration of producers and consumers, internals, cluster architectures, monitoring, integration with other technologies like Hadoop and Spark, and includes hands-on exercises with Kafka.

    Copyright:

    © All Rights Reserved
    Download as XLSX, PDF, TXT or read online from Scribd
    Download as xlsx, pdf, or txt
    You are on page 1of 5

    Session Topic

    Session Introduction to Big Data, Big Data Analytics


    Need for Kafka, What is Kafka?
    Kafka Features, Kafka Concepts,
    Kafka Architecture, Kafka Components,
    Where is Kafka Used?
    Kafka Installation,
    Kafka Cluster, Types of Kafka Clusters
    Configuring Single Node Single Broker Cluster

    Session Kafka Producer


    Configuring Single Node Multi Broker Cluster
    Constructing a Kafka Producer
    Sending a Message to Kafka
    Producing Keyed and Non-Keyed Messages
    Sending a Message Synchronously & Asynchronously
    Configuring Producers
    Serializers
    Serializing Using Apache Avro Partitions"

    Session Kafka Consumer


    Consumers and Consumer Groups
    Standalone Consumer
    Consumer Groups and Partition Rebalance
    Creating a Kafka Consumer
    Subscribing to Topics
    The Poll Loop
    Configuring Consumers
    Commits and Offsets
    Rebalance Listeners
    Consuming Records with Specific Offsets
    Deserializers

    Session Kafka Internals


    Cluster Membership
    The Controller
    Replication
    Request Processing
    Physical Storage
    Reliability
    Broker Configuration
    Using Producers in a Reliable System
    Using Consumers in a Reliable System
    Validating System Reliability
    Performance Tuning in Kafka

    Session Kafka Cluster Architectures & Administering Kafka


    Use Cases - Cross-Cluster Mirroring
    Multi-Cluster Architectures
    Apache Kafka’s MirrorMaker
    Other Cross-Cluster Mirroring Solutions
    Topic Operations
    Consumer Groups
    Dynamic Configuration Changes
    Partition Management
    Consuming and Producing
    Unsafe Operations

    Session Kafka Monitoring and Kafka Connect


    Considerations When Building Data Pipelines
    Metric Basics
    Kafka Broker Metrics
    Client Monitoring
    Lag Monitoring
    End-to-End Monitoring
    Kafka Connect
    When to Use Kafka Connect?
    Kafka Connect Properties

    Session Kafka Stream Processing


    Stream Processing
    Stream-Processing Concepts
    Stream-Processing Design Patterns
    Kafka Streams by Example
    Kafka Streams: Architecture Overview

    Session Integration of Kafka With Hadoop, Storm and Spark


    Apache Hadoop Basics
    Hadoop Configuration
    Kafka Integration with Hadoop
    Apache Storm Basics
    Configuration of Storm
    Integration of Kafka with Storm
    Apache Spark Basics
    Spark Configuration
    Kafka Integration with Spark

    Session Integration of Kafka With Talend and Cassandra


    Flume Basics
    Integration of Kafka with Flume
    Cassandra Basics such as and KeySpace and Table Creation
    Integration of Kafka with Cassandra
    Session Kafka Project
    Hands-on Duration

    Kafka Installation
    Implementing Single Node-Single Broker Cluster

    Working with Single Node Multi Broker Cluster


    Creating a Kafka Producer
    Configuring a Kafka Producer
    Sending a Message Synchronously & Asynchronously

    Creating a Kafka Consumer


    Configuring a Kafka Consumer
    Working with Offsets

    Create topic with partition & replication factor 3 and execute it on multi-broker cluster
    Show fault tolerance by shutting down 1 Broker and serving its partition from another broker
    Topic Operations
    Consumer Group Operations
    Partition Operations
    Consumer and Producer Operations

    Kafka Connect

    Kafka Streams
    Word Count Stream Processing

    Kafka integration with Hadoop


    Kafka integration with Storm
    Kafka integration with Spark

    Kafka demo with Cassandra


    d Table Creation

    You might also like

    pFad - Phonifier reborn

    Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

    Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


    Alternative Proxies:

    Alternative Proxy

    pFad Proxy

    pFad v3 Proxy

    pFad v4 Proxy