Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -31,19 +31,19 @@ There are different types of communication within a cluster:
- LoadBalancer Service
- Ingress Controller

### **Container to Container Communication**
### Container to Container Communication

When a Pod is created, it has its own network namespace which is set up by a **pause container**. This container is special as it does not run any workload and is not visible from the kubectl commands. The other containers of this Pod are all attached to the pause container's network namespace and are thus communicating through `localhost`.

![container-to-container](container-to-container.png)

### **Pod to Pod on the Same Node**
### Pod to Pod on the Same Node

Each Pod has its own network namespace and they communicate via a virtual Ethernet (veth) pair connected to a bridge on the host. This setup allows Pod-to-Pod traffic to be switched locally without leaving the Node.

![pod-to-pod-same-node](pod-to-pod-same-node.png)

### **Pod to Pod Across Different Nodes**
### Pod to Pod Across Different Nodes

The network plugin ensures that each Pod's IP is routable across the cluster, using encapsulation, overlays, or native routing. Packets travel across the network infrastructure between Nodes before reaching the destination Pod's virtual interface.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,13 @@ title: "Without Container Orchestration"
weight: 1
---

### **Why Kubernetes?**
### Why Kubernetes?

Running services in containers tend to produce numerous containers pretty quick. Handling many containers with no additional aid is a very cumbersome job. Hence, an orchestration solution is necessary to run services in containers efficiently.

![image](containers2.png)

### **Without Container Orchestration**
### Without Container Orchestration

- Think about scaling up services; it **increases manual work**.
- Think about fixing crashing nodes; it **increases manual work**.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ weight: 3
---


### **Overview**
### Overview

Block storage provides high-performance, flexible, and scalable solutions for applications requiring direct access to storage devices. It is well-suited for databases, virtualized environments, and other performance-critical workloads. Block storage offers several benefits compared to other storage systems.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@ weight: 3
---


### **Explained**
### Explained

Block storage is a fundamental component of cloud computing infrastructure, offering a versatile and scalable solution for storing and managing data. It allows dividing data into fixed-sized blocks, which can be accessed and manipulated independently. This flexibility allows for efficient data storage and retrieval, making block storage an ideal choice for applications requiring high-performance storage, such as databases and virtual machines. By leveraging block storage, organizations can focus on their core workflows and applications without the burden of managing file storage and locations. With the ability to scale horizontally and integrate seamlessly with other cloud services, block storage empowers customers to overcome the limitations of legacy storage systems, ensuring optimal performance and cost-effectiveness at any scale.

### **Definition**
### Definition

Block storage is an architecture that divides data into fixed-size blocks, each with a unique address. Block storage devices like hard disk and solid-state drives use block-level access protocols like iSCSI and Fibre Channel to read and write data. This storage method is ideal for low-latency, high-performance environments where data access speed is crucial. However, it can be more complex and expensive to set up initially.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ weight: 3
---


### **Overview**
### Overview

These are just a few examples of the many uses of block storage. Its versatility and scalability make it a crucial component in various IT environments, enabling efficient data storage and management for multiple applications and workloads. Block storage has many uses in cloud computing and other IT environments.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ weight: 3
---


### **Overview**
### Overview

Suppose your organization requires a centralized, easily accessible, affordable way to store files and folders. In that case, file-level storage is a good approach.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ weight: 3
---


### **Explained**
### Explained

File storage has been around for considerably longer than object or block storage. It is something most people are familiar with. You name your files, place them in folders, and nest them under more folders to form a set path. This way, files are organized into a hierarchy, with directories and sub-directories. Each file also has a limited set of metadata associated with it, such as the file name, the date it was created, and the date it was last modified.

Hierarchical file storage is practical for organizing structured data. This works well up to a point, but as capacity grows, the file model becomes burdensome for two reasons. First, performance suffers beyond a certain capacity. A NAS system has limited processing power, making the processor a bottleneck. Second, performance also suffers with the massive database – the file lookup tables – that accompany capacity growth.

Scaling requires adding more hardware or upgrading to higher-capacity devices, which can be costly. Cloud-based file storage services offer a solution by allowing multiple users to access and share files stored in off-site data centers. With a monthly subscription fee, you can keep your files in the cloud, quickly scale up capacity, and specify performance and protection criteria. Additionally, you save on the expense of maintaining on-site hardware since the cloud service provider manages the infrastructure.
### **Definition**
### Definition

File storage in the cloud refers to the practice of storing and managing files on remote servers that are accessible via the Internet. Instead of saving files on local storage devices like hard drives or USB drives, cloud storage allows users to upload and store files on servers maintained by a cloud storage provider. These files can then be accessed, shared, and synced across multiple devices and platforms.

Expand All @@ -23,7 +23,7 @@ Examples of file cloud storage services include Dropbox, Google Drive, and Micro
- Cloud File System: is a hierarchical storage system in the cloud that provides shared access to file data. Users can create, delete, modify, read, and write files, as well as organize them logically in directory trees for intuitive access.
- Cloud File Sharing: is a service that provides simultaneous access for multiple users to a common set of files stored in the cloud. Security for online file storage is managed with user and group permissions so administrators can control access to the shared file data.

### **Requirements for Cloud File Storage**
### Requirements for Cloud File Storage

An ideal file-based data storage solution in the cloud must deliver the proper performance and capacity for today while also being capable of scaling as business needs change. The solution should include the following features:

Expand All @@ -34,7 +34,7 @@ An ideal file-based data storage solution in the cloud must deliver the proper p
- Compatibility: integrates seamlessly with existing applications with no new code to write
- Fully Managed: provides a system that can be launched in minutes with no physical hardware required or ongoing software maintenance

### **Different Cloud File Storage Services**
### Different Cloud File Storage Services

The benefits of cloud file storage are clear, but it is important to note that not all cloud file storage solutions are created equal; various solutions exist. Cloud file storage can be delivered in one of two ways:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ weight: 3
---


### **Overview**
### Overview

Cloud file storage provides the flexibility to support and integrate with existing applications, plus the ease of deploying, managing, and maintaining all your files in the cloud. These two key advantages allow organizations to support various applications and verticals. Use cases such as large content repositories, development environments, media stores, and user home directories are ideal workloads for cloud-based file storage.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ weight: 3
---


### **Overview**
### Overview

Overall, object storage provides a scalable, durable, and cost-effective solution for storing and managing large volumes of data. It is suitable for various use cases, including backup and recovery, content distribution, data archiving, and big data analytics. Object storage offers several benefits compared to traditional storage systems.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,11 @@ title: "Details - Object Storage"
weight: 3
---

### **Explained**
### Explained

Object storage has become the foundation for web-scale architectures in public or private clouds. Its appeal is due to its potential to handle massive scale while minimizing complexity and cost. It allows application developers and users to focus more on their workflow and logic and not worry about managing file storage and file locations. Customers struggling with large-scale data storage deployments are turning to object storage to overcome the limitations that legacy storage systems face at scale.

### **Definiton**
### Definiton

Object storage is an architecture that manages data as distinct units, known as objects. Each object contains the actual data, metadata, and a unique identifier. The metadata stored alongside the data can include information such as creation date, size, and custom attributes. This technique manages and manipulates data storage using objects in a central location, not structured as files within folders. This approach to data storage offers substantial benefits in terms of scalability, cost-efficiency, and ease of use. It is a primary form of storage used in cloud computing infrastructure.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ title: "Use Cases - Object Storage"
weight: 3
---

### **Overview**
### Overview

These are just a few examples of the many uses of object storage. Its scalability, durability, and cost-effectiveness make it a popular choice for storing and managing large volumes of unstructured data in various industries and applications. Object storage is a versatile solution that finds applications in multiple industries and use cases.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ weight: 3
---


### **Explained**
### Explained

As our reliance on technology grows, so does our need for efficient and cost-effective data storage solutions. We'll explore two popular storage technologies, object storage and block storage, their fundamental differences, and their strengths and weaknesses so that you can choose the right solution for your organization.
Object vs Block: Cost
Expand All @@ -17,7 +17,7 @@ Cost is a crucial factor in data storage, and both object and block storage solu
- Access Costs: One potential drawback of object storage is access costs. Retrieving data from object storage can be more expensive than block storage due to the additional overhead associated with the retrieval process. On the other hand, block storage provides direct access to data and typically incurs lower access costs.
- Hardware Costs: Large-scale block storage often requires specialized hardware, such as Fiber Channel switches, which can be expensive to implement and maintain. On the other hand, object storage can use commodity hardware, making it a more cost-effective option for smaller organizations or those with limited budgets.

### **Object vs Block: Selection**
### Object vs Block: Selection

Choosing between object and block storage ultimately depends on your specific data storage and management requirements. Object storage is ideal for storing unstructured data such as multimedia files, backups, and archives. It's also well-suited for distributed data storage, analytics, and big data applications. Block storage is ideal for storing structured data such as databases and virtual machines. It's also well-suited for high-performance applications that require low latency and high throughput.

Expand All @@ -26,15 +26,15 @@ Choosing between object and block storage ultimately depends on your specific da
- Evaluate Scalability: Object storage's scalability and elasticity make it an ideal solution for distributed data storage. In contrast, block storage may be more limiting in terms of scalability.
- Evaluate Performance: Block storage typically offers lower latency and higher performance for applications that require rapid data access. In contrast, object storage can provide higher throughput for large data access requests.

### **Object vs Block: Scalability**
### Object vs Block: Scalability

Scalability is critical in data storage, mainly as data volumes grow exponentially.

- Scalability at Scale: Object storage's flat address space and erasure coding techniques make it highly scalable, even at petabyte-scale data volumes. Block storage's reliance on file systems and hierarchical structures can limit scalability, particularly as data volumes increase.
- Elasticity: Object storage's scalability extends to elasticity, allowing organizations to adjust storage capacity on-demand to meet changing data storage requirements. Block storage's scalability is typically more rigid, requiring more planning and management to scale effectively.
- Data Distribution: Object storage's scalability and elasticity make it an ideal solution for distributed data storage. As organizations grow and expand, object storage can provide a cost-effective and efficient way to store data across multiple locations.

### **Object vs Block: Performance**
### Object vs Block: Performance

Performance is another crucial consideration in data storage, particularly for applications that require rapid data access.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ description: ""
title: "Storage Types"
weight: 3
---
### **Definition**
### Definition
When it comes to storage in the cloud, there are three main types:

- File Storage
Expand All @@ -26,12 +26,12 @@ Let's take a closer look at each of them.

![file-object-block](file-object-block.png)

### **Files Storage**
### Files Storage

File storage is designed to store and manage files in a hierarchical structure, similar to how files are organized in a traditional file system. It provides a shared file system that can be accessed by multiple users or applications simultaneously. File storage is suitable for scenarios where you need to store and access files in a structured manner, such as shared drives, file sharing, or hosting web content.
### **Object Storage**
### Object Storage

Object storage, on the other hand, is a storage architecture that manages data as objects. Each object consists of data, metadata (attributes or properties associated with the object), and a unique identifier. Object storage is highly scalable and offers virtually unlimited storage capacity. It is ideal for storing unstructured data like images, videos, documents, backups, and logs. Object storage is accessed using APIs, making it suitable for cloud-native applications and distributed systems.
### **Block Storage**
### Block Storage

Block storage works at the lowest storage level. It provides raw storage volumes that can be mounted as block devices by virtual machines or servers. It offers high-performance storage with low latency and is often used for databases, virtual machines, and applications that require direct access to storage at the block level. The operating system manages block storage and requires a file system to organize and manage data.
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ description: ""
title: "Cloud Storage"
weight: 3
---
### **Definition**
### Definition

Cloud storage is a service that provides a convenient and scalable solution for storing, backing up, and accessing data over the Internet, eliminating the need for physical storage devices like hard drives or USB sticks.

Expand All @@ -14,21 +14,21 @@ This approach simplifies data management, enhances data security, and promotes c

![cloud-storage](cloud-storage.png)

### **Benefits**
### Benefits

Cloud storage offers several advantages over traditional local storage. Here are some key features and benefits of cloud storage:
### **Scalability**
### Scalability

Cloud storage providers typically offer flexible plans, allowing users to increase or decrease their storage capacity as needed. This scalability makes it easy to accommodate changing storage requirements.
### **Accessibility**
### Accessibility

Cloud storage allows users to access their files anywhere with an internet connection. This makes it convenient for users to access their data from different devices, such as computers, smartphones, or tablets.
### **Collaboration**
### Collaboration

Cloud storage services often include collaboration features, allowing multiple users to access and work on the same files simultaneously. This makes it easier for teams to collaborate on projects and share documents.
### **Cost-effectiveness**
### Cost-effectiveness

Cloud storage eliminates the need for users to invest in and maintain their physical storage infrastructure. Users typically pay for the storage they use on a subscription basis, making it a cost-effective solution for individuals and businesses.
### **Backup and Recovery**
### Backup and Recovery

Cloud storage providers often have robust backup and recovery mechanisms in place. This helps protect data from loss due to hardware failures, accidents, or other unforeseen events. Users can quickly restore their files from backups stored in the cloud.
Loading