Swami Keshvanand Institute of Technology, Management & Gramothan,

Ramnagaria, Jagatpura, Jaipur-302017, INDIA

Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

UNIT-2
Cloud Computing Architecture

Cloud Reference Model

The Cloud Reference Model is a conceptual framework that provides a structured way to
understand the components and interactions within a cloud computing environment. It helps in
standardizing the terminology and conceptualizing the various layers and functionalities involved in
cloud computing. The model typically consists of several layers, each representing different aspects
of cloud computing services and infrastructure. While specific models may vary, a common
representation includes the following layers:

1. Cloud Service Models: This layer defines the types of services offered by cloud providers. The
commonly recognized service models are:
 Infrastructure as a Service (IaaS)
 Platform as a Service (PaaS)
 Software as a Service (SaaS)
 Function as a Service (FaaS) or Serverless Computing
2. Cloud Deployment Models: This layer describes how cloud services are deployed and accessed.
Common deployment models include:
 Public Cloud: Services are provided over the internet and available to anyone.
 Private Cloud: Services are provisioned for a specific organization and may be hosted on-
premises or by a third-party provider.
 Hybrid Cloud: A combination of public and private cloud services, allowing data and
applications to be shared between them.
 Community Cloud: Infrastructure shared by several organizations with similar concerns
(e.g., security or compliance).
3. Cloud Infrastructure: This layer includes the physical resources and virtualization technologies
that underpin cloud services, such as servers, storage, networking, and virtualization software.
4. Cloud Orchestration and Management: This layer involves the tools and processes used to
manage and orchestrate cloud resources efficiently. It includes functions like provisioning,
monitoring, scaling, and automation.
5. Cloud Security and Compliance: This layer encompasses the security measures and compliance
standards implemented to protect data and ensure regulatory compliance in the cloud environment.
6. Cloud Services and Applications: This layer represents the actual services and applications hosted
on the cloud platform, which could include web applications, databases, analytics tools, etc.

By providing a structured framework, the Cloud Reference Model helps organizations understand
the various components of cloud computing and how they interact, enabling them to make informed
decisions about cloud adoption, deployment, and management.

Page | 1
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

Layers and Types of Cloud

Cloud computing typically involves different layers and types, which together form the architecture
and deployment models for cloud services. Here's an overview:

Layers of Cloud Computing:

1. Infrastructure Layer: This layer forms the foundation of cloud computing and includes physical
resources such as servers, storage devices, networking equipment, and data centers. It also involves
virtualization technologies that enable the abstraction of hardware resources.
2. Platform Layer: The platform layer provides a runtime environment and development tools for
building and deploying applications. Platform as a Service (PaaS) offerings are common in this
layer, providing developers with tools, APIs, and frameworks to develop, test, and deploy
applications without worrying about the underlying infrastructure.
3. Software Layer: At this layer, cloud providers offer software applications and services that users
can access over the internet. Software as a Service (SaaS) offerings are prevalent here, providing
users with access to applications without the need for installation or maintenance.
4. Management and Orchestration Layer: This layer involves tools and services for managing
cloud resources, automating workflows, and orchestrating deployments. It includes services for
provisioning, monitoring, scaling, and optimizing cloud infrastructure and applications.
5. Security and Compliance Layer: Security is a crucial aspect of cloud computing, and this layer
encompasses measures and services for protecting data, applications, and infrastructure in the cloud.
It includes features like encryption, identity and access management (IAM), threat detection, and
compliance auditing.

Types of Cloud Computing:

Page | 2
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

1. Public Cloud: Services are delivered over the public internet and are available to anyone who
wants to use or purchase them. Public clouds are owned and operated by third-party cloud service
providers, offering scalability, flexibility, and cost-effectiveness.
2. Private Cloud: Private clouds are dedicated cloud environments exclusively used by a single
organization. They can be hosted on-premises or by a third-party provider and offer greater control,
security, and customization compared to public clouds.
3. Hybrid Cloud: Hybrid clouds combine elements of public and private clouds, allowing data and
applications to be shared between them. This approach offers flexibility and scalability, enabling
organizations to leverage the benefits of both public and private cloud environments.
4. Community Cloud: Community clouds are shared infrastructure and services that are tailored to
meet the specific needs of a particular community or group of organizations. They offer
collaboration opportunities while addressing shared concerns such as security, compliance, or
industry regulations.
5. Multi-Cloud: Multi-cloud refers to the use of multiple cloud computing services or platforms from
different providers. Organizations may use a combination of public, private, or hybrid clouds to
meet their diverse needs, avoid vendor lock-in, and optimize performance, cost, and reliability.

These layers and types of cloud computing provide a framework for understanding the architecture,
deployment models, and services offered in the cloud computing ecosystem.

Service Models

Cloud computing offers different service models, each providing varying levels of control,
management responsibility, and abstraction of underlying infrastructure. The common service
models in cloud computing are:

1. Infrastructure as a Service (IaaS):

 In IaaS, cloud providers offer virtualized computing resources over the internet. These
resources typically include virtual machines, storage, and networking components.
 Users have control over the operating systems, applications, and development frameworks
running on the infrastructure but do not manage the underlying physical hardware.
 Examples: Amazon Web Services (AWS) EC2, Microsoft Azure Virtual Machines, Google
Compute Engine.
2. Platform as a Service (PaaS):
 PaaS provides a platform allowing customers to develop, run, and manage applications
without the complexity of building and maintaining the infrastructure.
 PaaS offerings include development tools, runtime environments, databases, and
middleware.
 Users focus on building and deploying applications, while the cloud provider manages the
underlying infrastructure, including operating systems, servers, and networking.
 Examples: Heroku, Google App Engine, Microsoft Azure App Service.
3. Software as a Service (SaaS):
 SaaS delivers software applications over the internet on a subscription basis. Users access
the applications through a web browser or API without needing to install or maintain
software locally.

Page | 3
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

 The provider hosts and manages the entire application stack, including infrastructure,
middleware, and application software.
 Users typically have configuration options to customize the application to their needs but
have limited control over underlying infrastructure or code.
 Examples: Salesforce, Google Workspace (formerly G Suite), Microsoft Office 365.

These service models offer different levels of abstraction and management, catering to various use
cases and requirements. Organizations can choose the appropriate service model based on factors
such as control, scalability, management overhead, and cost-effectiveness.
Data Center Design and interconnection network

In cloud computing, data center design and interconnection networks are fundamental components
that enable the delivery of cloud services to users. Here's how they are typically structured in a
cloud computing environment:

Data Center Design in Cloud Computing:

1. Location and Accessibility: Cloud providers strategically locate data centers in regions with good
access to power, network connectivity, and skilled workforce. Accessibility to users and compliance
with data sovereignty regulations also influence data center location decisions.
2. Physical Infrastructure: Cloud data centers feature robust physical infrastructure, including
redundant power sources, backup generators, advanced cooling systems, fire suppression
mechanisms, and stringent security measures to protect against physical and environmental threats.
3. Virtualization and Resource Pooling: Virtualization technologies are extensively used in cloud
data centers to abstract physical hardware resources and create virtualized pools of compute,
storage, and networking resources. This enables efficient resource allocation, scalability, and
flexibility in provisioning and managing cloud services.
4. Modular and Scalable Architecture: Cloud data centers are designed with a modular architecture
to facilitate scalability and rapid expansion. Components such as server racks, storage arrays, and
networking equipment are deployed in modular units that can be easily added or removed as
demand fluctuates.
5. Automation and Orchestration: Automation tools and orchestration platforms are used to
streamline data center operations, automate routine tasks, and dynamically provision and manage
resources based on workload requirements. This enables cloud providers to achieve higher levels of
efficiency, agility, and cost-effectiveness.

Interconnection Network in Cloud Computing:

1. High-Speed Networking Infrastructure: Cloud data centers are interconnected with high-speed,
low-latency networking infrastructure to facilitate fast and reliable communication between servers,
storage systems, and other components. Technologies like fiber optics, high-bandwidth switches,
and routers are employed to ensure optimal network performance.
2. Redundant and Resilient Connectivity: Cloud providers deploy redundant network connections
and diverse network paths to ensure continuous availability and fault tolerance. Multiple internet
service providers (ISPs), peering arrangements, and redundant links are utilized to mitigate the
impact of network failures or disruptions.
3. Content Delivery Networks (CDNs): Cloud providers leverage CDNs to improve the performance
and reliability of content delivery by caching and serving static and dynamic content from edge

Page | 4
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

locations closer to end-users. CDNs reduce latency, minimize bandwidth usage, and enhance the
user experience for cloud-based applications and services.
4. Software-Defined Networking (SDN): SDN technologies are employed in cloud data centers to
programmatically manage and control network resources using software-based controllers. SDN
enables dynamic network provisioning, traffic optimization, and policy-based management, leading
to greater agility, scalability, and efficiency in cloud networking.
5. Security and Compliance: Cloud providers implement robust security measures, including
encryption, access controls, intrusion detection/prevention systems (IDS/IPS), and traffic
monitoring tools, to protect data and ensure compliance with regulatory requirements. Network
security is a critical aspect of cloud computing infrastructure, given the multi-tenant nature of cloud
environments.

Overall, effective data center design and interconnection networks are essential for delivering
scalable, reliable, and high-performance cloud services to users while maintaining security,
compliance, and operational efficiency.

Architectural design of compute and storage cloud

The architectural design of compute and storage in cloud computing involves creating scalable,
reliable, and efficient infrastructure to deliver computing and storage services to users. Here's a
breakdown of the architectural components and considerations for compute and storage in the
cloud:

Compute Architecture:
1. Virtualized Compute Resources: Cloud providers deploy virtualization technologies such as
hypervisors to abstract physical compute resources (e.g., servers, CPUs, memory) and create virtual
machines (VMs) or containers. This enables multiple workloads to run on the same physical
hardware, leading to resource consolidation and flexibility.
2. Compute Orchestration and Management: Orchestration platforms such as Kubernetes or cloud-
native services like AWS Elastic Kubernetes Service (EKS) manage the lifecycle of compute
resources, including provisioning, scaling, load balancing, and scheduling of containerized or VM-
based workloads.
3. Elastic Scalability: Cloud architectures are designed to scale compute resources dynamically based
on workload demand. Auto-scaling features automatically adjust the number of VM instances or
containers in response to changes in traffic, ensuring optimal performance and resource utilization.
4. Serverless Computing: Serverless computing platforms like AWS Lambda or Google Cloud
Functions abstract away the underlying infrastructure and allow developers to focus on writing code
without managing servers. Functions are executed in response to events, and users are billed based
on actual usage, promoting cost efficiency and agility.
5. Compute Instance Types: Cloud providers offer a variety of compute instance types optimized for
different workloads, such as general-purpose, compute-optimized, memory-optimized, and GPU-
accelerated instances. Users can choose instance types based on their specific performance and
resource requirements.

Page | 5
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

Storage Architecture:
1. Object Storage: Object storage services like Amazon S3 or Google Cloud Storage provide scalable
and durable storage for unstructured data, such as images, videos, documents, and backups. Objects
are stored with metadata and accessed via HTTP/HTTPS APIs, making them suitable for web
applications and content delivery.
2. Block Storage: Block storage offerings such as Amazon EBS or Azure Disk provide persistent
block-level storage volumes that can be attached to VMs or containers. Block storage is commonly
used for databases, file systems, and applications requiring low-latency access to data.
3. File Storage: File storage services like Amazon EFS or Azure Files offer shared file systems that
can be accessed concurrently by multiple VMs or containers. File storage is suitable for applications
requiring file-based access and shared data repositories.
4. Scalable Storage Architectures: Cloud providers employ distributed storage architectures that
replicate data across multiple nodes or data centers to ensure durability and availability. Techniques
such as sharding, replication, and erasure coding are used to distribute data efficiently and mitigate
the risk of data loss.
5. Data Lifecycle Management: Cloud storage services offer features for data lifecycle management,
including versioning, encryption, data tiering, and automated backup and archival. These features
help optimize storage costs, ensure data security, and comply with regulatory requirements.
6. Hybrid and Multi-Cloud Storage: Cloud architectures support hybrid and multi-cloud storage
solutions that seamlessly integrate on-premises data centers with cloud storage services.
Technologies like AWS Storage Gateway or Azure StorSimple enable hybrid storage deployments,
while data replication and synchronization tools facilitate multi-cloud data management.

By leveraging these architectural principles and technologies, cloud providers build resilient,
scalable, and cost-effective compute and storage infrastructures that meet the diverse needs of users
and applications in the cloud computing ecosystem.

Fractures of cloud programming

It seems like you're referring to "fractures" as challenges or pitfalls in cloud programming. Cloud
programming, while offering numerous benefits such as scalability, flexibility, and cost-
effectiveness, also comes with its own set of challenges. Here are some common "fractures" or
challenges in cloud programming:

1. Distributed Systems Complexity: Cloud applications typically involve distributed systems

architecture, where various components interact over a network. Managing the complexity of
distributed systems, including data consistency, fault tolerance, and communication between
components, can be challenging.
2. Vendor Lock-In: Cloud service providers offer proprietary services and APIs, which can lead to
vendor lock-in. Migrating applications between different cloud platforms or transitioning from
cloud to on-premises infrastructure can be difficult and costly.
3. Security and Compliance: Cloud computing introduces new security challenges, including data
breaches, unauthorized access, and compliance with regulations such as GDPR, HIPAA, or PCI-
DSS. Securing cloud environments requires implementing robust security measures, encryption,
access controls, and regular audits.
4. Scalability and Performance: While cloud platforms offer scalability, designing applications to
scale efficiently and handle varying workloads can be complex. Ensuring high performance and low

Page | 6
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

latency in distributed environments requires careful architectural design, optimization, and

monitoring.
5. Cost Management: Cloud computing offers pay-as-you-go pricing models, but costs can quickly
escalate if resources are not optimized or managed effectively. Understanding cloud pricing
structures, monitoring usage, and implementing cost-saving strategies such as resource rightsizing
or spot instances are essential for cost management.
6. Network Latency and Reliability: Cloud applications rely on network connectivity between
distributed components, which can introduce latency and reliability issues. Designing for resilience,
implementing retry mechanisms, and optimizing network communication can help mitigate these
challenges.
7. Data Management and Migration: Managing data in the cloud, including storage, backup, and
retrieval, requires careful planning and consideration of factors such as data sovereignty, latency,
and compliance. Migrating data between on-premises and cloud environments or between different
cloud providers can also be complex and time-consuming.
8. Concurrency and Parallelism: Cloud applications often need to handle concurrent requests and
execute tasks in parallel to achieve high throughput and responsiveness. Managing concurrency,
synchronization, and resource contention requires proper concurrency control mechanisms and
programming patterns.
9. Monitoring and Debugging: Monitoring the performance, availability, and health of cloud
applications and infrastructure is critical for identifying issues and optimizing performance.
Implementing robust logging, monitoring, and debugging tools helps diagnose and troubleshoot
problems effectively.
10. DevOps and Automation: Adopting DevOps practices and automation tools is essential for
managing cloud infrastructure, deploying applications, and implementing continuous integration
and delivery (CI/CD) pipelines. However, transitioning to DevOps culture and implementing
automation can be challenging and require organizational and cultural changes.

Addressing these challenges requires a combination of technical expertise, architectural best

practices, and ongoing optimization efforts to build and maintain resilient, scalable, and cost-
effective cloud applications.

Parallel and distributed programming paradigm in cloud computing

Parallel and distributed programming paradigms are essential in cloud computing to harness the
power of distributed resources and achieve scalability, performance, and fault tolerance. Here's how
these paradigms are applied in the context of cloud computing:

Parallel Programming Paradigm:

Parallel programming involves breaking down tasks into smaller subtasks that can be executed
concurrently to improve performance. In cloud computing, parallel programming is often used to
exploit the computational resources of multiple virtual machines or containers running in parallel.
Key concepts and techniques in parallel programming for cloud computing include:

1. Task Decomposition: Breaking down large computational tasks into smaller, independent units of
work that can be executed concurrently across multiple processing units.
2. Parallel Algorithms: Designing algorithms and data structures that support parallel execution, such
as parallel sorting, searching, and matrix multiplication algorithms.

Page | 7
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

3. Parallelism Models: Leveraging different models of parallelism, such as task parallelism, data
parallelism, and pipeline parallelism, to distribute workloads efficiently across multiple processors
or nodes.
4. Concurrency Control: Managing concurrent access to shared resources and ensuring data
consistency and integrity through techniques such as locking, synchronization, and transaction
management.
5. Parallel Programming Models: Using programming models and frameworks that support parallel
execution, such as message passing (e.g., MPI), shared-memory (e.g., OpenMP), or functional
programming (e.g., MapReduce).

Distributed Programming Paradigm:

Distributed programming focuses on developing applications that run across multiple
interconnected nodes or machines, often geographically distributed. In cloud computing, distributed
programming is essential for building scalable and fault-tolerant applications that can handle large-
scale data processing and distributed computing tasks. Key concepts and techniques in distributed
programming for cloud computing include:

1. Distributed Systems Architecture: Designing applications with a distributed architecture that

consists of multiple loosely coupled components communicating over a network.
2. Communication Protocols: Using communication protocols and middleware for inter-process
communication (IPC) and distributed coordination, such as Remote Procedure Call (RPC), message
queues (e.g., AMQP, Kafka), and publish-subscribe systems (e.g., MQTT).
3. Consistency and Replication: Managing data consistency and replication in distributed systems to
ensure that data remains consistent and available across multiple replicas or partitions.
4. Fault Tolerance and Resilience: Implementing fault-tolerant mechanisms such as redundancy,
replication, and failover to ensure system resilience and availability in the face of failures or
network partitions.
5. Scalability and Load Balancing: Designing distributed applications to scale horizontally by
adding or removing nodes dynamically and distributing workloads evenly across multiple nodes
using load balancing techniques.
6. Distributed Computing Frameworks: Leveraging distributed computing frameworks and
platforms such as Apache Hadoop, Apache Spark, and Apache Flink to simplify the development of
distributed applications and perform large-scale data processing and analytics tasks.

By applying parallel and distributed programming paradigms in cloud computing, developers can
harness the power of distributed resources and build scalable, high-performance, and fault-tolerant
applications that meet the demands of modern cloud-based environments.

Map Reduce in cloud computing

MapReduce is a programming model and framework for processing and generating large-scale
datasets in parallel across a distributed cluster of computers. It was popularized by Google and later
implemented in open-source frameworks such as Apache Hadoop. MapReduce is widely used in
cloud computing environments for tasks such as data processing, analytics, and batch processing.
Here's how MapReduce works in cloud computing:

Key Components of MapReduce:

Page | 8
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

1. Mapper Function (Map):

 The input dataset is divided into smaller chunks, which are processed in parallel by mapper
functions.
 Each mapper function applies a transformation to the input data, typically generating a set of
intermediate key-value pairs.
2. Shuffling and Sorting:
 The intermediate key-value pairs generated by mapper functions are shuffled and sorted
based on their keys.
 This ensures that all values associated with the same key are grouped together, making them
ready for the reduce phase.
3. Reducer Function (Reduce):
 The sorted intermediate key-value pairs are processed in parallel by reducer functions.
 Each reducer function aggregates or summarizes the values associated with a specific key,
producing the final output.

Execution Flow of MapReduce:

1. Job Submission:
 A MapReduce job is submitted to the cluster, specifying the input data, mapper function,
reducer function, and other job parameters.
2. Job Scheduling:
 The job scheduler assigns map and reduce tasks to available nodes in the cluster, taking into
account resource availability and data locality.
3. Map Phase:
 Each mapper function processes a portion of the input data and generates intermediate key-
value pairs.
 Mapper tasks run in parallel across multiple nodes, processing data in distributed fashion.
4. Shuffle and Sort Phase:
 Intermediate key-value pairs are shuffled and sorted based on their keys.
 This phase ensures that all values associated with the same key are grouped together and
ready for the reduce phase.
5. Reduce Phase:
 Each reducer function processes a subset of the sorted intermediate data, aggregating or
summarizing values associated with the same key.
 Reducer tasks run in parallel across multiple nodes, producing the final output.
6. Output Generation:
 The output of the reduce phase is written to storage, typically distributed file systems such
as Hadoop Distributed File System (HDFS).
 The output can be further processed or analyzed by downstream applications.

Advantages of MapReduce in Cloud Computing:

1. Scalability: MapReduce enables parallel processing of large datasets across distributed clusters,
allowing applications to scale horizontally as demand grows.
2. Fault Tolerance: MapReduce frameworks provide built-in fault tolerance mechanisms,
automatically handling node failures and ensuring job completion.

Page | 9
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

3. Data Locality: MapReduce frameworks optimize data processing by scheduling tasks on nodes
where the data is stored, minimizing data transfer over the network.
4. Programming Model: MapReduce provides a simple and intuitive programming model,
abstracting away the complexities of distributed computing and parallel processing.
5. Ecosystem Integration: MapReduce frameworks such as Apache Hadoop integrate with a wide
range of tools and libraries for data processing, analytics, and machine learning.

Overall, MapReduce is a powerful paradigm for distributed data processing in cloud computing
environments, enabling efficient and scalable analysis of large-scale datasets

Hadoop:

Hadoop is an open-source software framework used for distributed storage and

processing of large datasets across clusters of computers using simple programming
models. It is designed to scale up from single servers to thousands of machines, each
offering local computation and storage.

Hadoop consists of several key components:

1. Hadoop Distributed File System (HDFS): HDFS is a distributed file system that stores data
across multiple machines in a Hadoop cluster. It provides high throughput access to
application data and is designed to be fault-tolerant, detecting and recovering from
failures at the application layer.
2. MapReduce: MapReduce is a programming model and processing engine for distributed
computing on large datasets. It enables parallel processing of data across a cluster of
computers. MapReduce programs are written in Java and consist of two main functions:
map and reduce. The map function processes input data and produces a set of
intermediate key-value pairs, and the reduce function merges these intermediate pairs to
produce the final output.
3. Yet Another Resource Negotiator (YARN): YARN is the resource management layer of
Hadoop. It is responsible for managing computing resources in a Hadoop cluster and
scheduling tasks. YARN decouples the resource management and job scheduling
functionalities from the MapReduce programming model, allowing other programming
models and frameworks to run on Hadoop.

Hadoop is widely used for processing and analyzing large datasets in various industries,
including finance, healthcare, retail, and telecommunications. It provides a cost-effective
solution for storing and analyzing vast amounts of data, enabling organizations to derive
valuable insights and make data-driven decisions.

Page | 10
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

High Level language for Cloud

When discussing a "high-level language for cloud," it typically refers to a programming

language that is well-suited for developing cloud-native applications and services. These
languages are chosen for their ability to efficiently leverage cloud infrastructure, scale
easily, and integrate with cloud services and APIs. Here are some popular high-level
languages commonly used for cloud development:

1. Python: Python is a versatile and widely-used language known for its simplicity and
readability. It has a rich ecosystem of libraries and frameworks that facilitate cloud
development, including Flask and Django for web development, Boto3 for interacting with
AWS services, and TensorFlow for machine learning applications.
2. JavaScript (Node.js): Node.js allows developers to use JavaScript on the server-side,
making it a popular choice for full-stack development. It offers asynchronous and event-
driven programming, which align well with cloud-native architectures. Frameworks like
Express.js are commonly used for building APIs and microservices.
3. Java: Java is a robust and mature language with strong support for building enterprise-
grade applications. It is well-suited for large-scale cloud deployments and offers
frameworks like Spring Boot for creating microservices and web applications. Java's
portability also makes it suitable for developing applications that can run across different
cloud platforms.
4. Go (Golang): Go is a statically typed language developed by Google, known for its
simplicity, performance, and built-in support for concurrency. It is increasingly popular for
cloud-native development, particularly for building microservices and distributed systems.
Go's small footprint and fast compilation make it well-suited for deploying lightweight and
scalable applications in the cloud.
5. C#: C# is commonly associated with the Microsoft ecosystem and is widely used for
developing applications on the Azure cloud platform. It offers robust frameworks like
ASP.NET Core for building web applications and services. C# developers can leverage
Azure-specific SDKs and tools for seamless integration with Azure services.
6. Ruby: Ruby is valued for its developer-friendly syntax and productivity features. While not
as commonly associated with cloud development as some other languages, it is still used
for building web applications and APIs, often with the Ruby on Rails framework. Heroku, a
popular cloud platform, offers strong support for Ruby applications.

These languages each have their strengths and are chosen based on factors such as
developer expertise, project requirements, and compatibility with the chosen cloud
platform. Ultimately, the best language for cloud development depends on the specific
needs and goals of the project.

Page | 11
 Swami Keshvanand Institute of Technology, Management & Gramothan,
Ramnagaria, Jagatpura, Jaipur-302017, INDIA
Approved by AICTE, Ministry of HRD, Government of India
Recognized by UGC under Section 2(f) of the UGC Act, 1956
Tel. : +91-0141- 5160400Fax: +91-0141-2759555
E-mail: info@skit.ac.in Web: www.skit.ac.in

Programming of Google App Engine

The Google Maps Platform offers a variety of APIs that developers can use to integrate maps, location-
based services, and geographic data into their applications. Here's a general overview of how you can
programmatically interact with Google Maps:

1. Google Maps JavaScript API: This API allows you to embed Google Maps into web pages and
customize them with markers, overlays, and interactive elements. You can also use it to add features like
directions, street view, and geocoding to your web applications.
2. Google Maps Geocoding API: Geocoding is the process of converting addresses (like "1600
Amphitheatre Parkway, Mountain View, CA") into geographic coordinates (latitude and longitude). The
Geocoding API allows you to perform geocoding and reverse geocoding, translating coordinates into
addresses.
3. Google Maps Directions API: This API provides directions for various modes of transportation (driving,
walking, bicycling, and transit) between two or more locations. You can use it to retrieve step-by-step
directions, distance, and duration for routes.
4. Google Maps Places API: The Places API enables you to search for places (e.g., restaurants, hotels,
landmarks) based on specific criteria such as keyword, type, or geographic location. You can also use it
to retrieve details about individual places, including reviews, ratings, and photos.
5. Google Maps Static API: This API allows you to generate static map images that can be embedded in
web pages or mobile apps. You can customize the appearance of the map, add markers and overlays,
and specify the desired size and format of the image.
6. Google Maps Street View Static API: Similar to the Static API, this API allows you to generate static
street view images using specified coordinates or panorama IDs.
7. Google Maps Distance Matrix API: The Distance Matrix API provides travel distance and time
estimates for multiple origins and destinations. It can be used to calculate distances for various
transportation modes and to optimize routes based on travel time.
8. Google Maps Elevation API: This API provides elevation data for points on the earth's surface, allowing
you to retrieve elevation profiles for routes or display elevation contours on maps.

To use these APIs, you'll need to sign up for a Google Maps Platform account and obtain an API key,
which you'll include in your API requests for authentication and usage tracking. Google provides
comprehensive documentation, code samples, and client libraries for various programming languages
to help you get started with integrating Google Maps into your applications.

Page | 12