DevOps UT Meetup, Nov. 8

A system architecture for streaming data pipelines that scales automatically while minimizing compute costs.

Applications deployed as Kubernetes Deployments (or StatefulSets) can be scaled manually or automatically either through the API or with the HorizontalPodAutoscaler (HPA). This can be a great solution for scaling relatively steady workloads with short-lived task durations, such as a REST API backing a web application.

With volatile workloads, back pressure can become a problem. If volume increases faster than resources can scale up, requests will time out.


Agenda
6:00 - 6:10 PM Introductions and Announcements
6:10 - 6:30 PM Presentation by Richard and Bart Wood from SaasGlue - https://www.saasglue.com/
6:30: Demo showing scaling example in Kubernetes and Message Queues
6:50 - 7:00 PM Q & A

Demo Code: https://github.com/saascipes/k8s-auto-scaler

DevOps UT Oct. 11, 2023 Zoom meetup

In today's dynamic cloud landscape, microservices have revolutionized the way we design, build, and scale applications. However, this modular approach brings its own challenges, primarily in the areas of monitoring and observability. This presentation will delve deep into how four industry-leading tools—InfluxDB, Jaeger, Grafana, and OpenTelemetry—come together to provide a comprehensive monitoring solution for your microservices ecosystem.

Key Points to be Covered:

1. Microservices Monitoring Challenges:
* The fragmented nature of microservices.
* The need for real-time visibility.
* Challenges in tracing requests across services.

2. Introduction of the Monitoring Stack:
* Overview of InfluxDB, Jaeger, Grafana, and OpenTelemetry.
* How they fit into the microservices architecture.

3. OpenTelemetry: The Unified Observability Framework:
* What is OpenTelemetry?
* Its role in instrumenting applications.
* Gathering and exporting telemetry data.

4. Tracing with Jaeger:
* Importance of distributed tracing.
* How Jaeger visualizes trace data.
* Integrating Jaeger with OpenTelemetry.

5. InfluxDB: Storing Time-Series Data:
* Introduction to InfluxDB as a time-series database.
* Storing metrics and events from microservices.
* Performance and scalability advantages.

6. Visualizing Data with Grafana:
* Creating insightful dashboards.
* Integrating Grafana with InfluxDB and Jaeger.
* Alerting and anomaly detection.

7. Best Practices for Monitoring Microservices:
* Combining metrics, traces, and logs.
* Setting meaningful alerts.
* Continuous improvement through observability.

2 0

As enterprises transition to containerized deployments and microservices architectures, the need for comprehensive and dynamic policy enforcement becomes paramount. The Open Policy Agent (OPA) emerges as an industry-standard solution, serving as a universal policy engine across the stack.

In this presentation we will discuss:

1. What is OPA?

Delve deep into the fundamentals of the Open Policy Agent, understanding its architecture, core components, and its role in the DevOps ecosystem.

2. OPA in the Enterprise Landscape:

Explore how OPA is revolutionizing policy enforcement in modern enterprise systems and why it matters.

3. Hands-on with OPA:

We will do a live demo of OPA's capabilities. By leveraging OPA with Istio and Kubernetes, we'll illustrate the process of setting up a basic Role-Based Access Control (RBAC) system.

0 0

Carson provides an engaging presentation discussing the different data formats used in today's cloud computing environments. He provides detailed examples of each with their accompanying pros and cons.

1 0

Thomas Bell will be sharing his expertise on service meshes, with a focus on Istio. Service meshes have become an important aspect of modern infrastructure, providing a comprehensive solution for managing and securing microservices-based applications.

During his talk, Thomas will cover the fundamentals of service meshes, explaining what they are and why they are essential in today's complex infrastructure environments. He will also showcase some of the capabilities of Istio, a popular open-source service mesh that offers a robust set of features for traffic management, security, and observability.

Attendees can look forward to a demo of Istio's capabilities, demonstrating how it can help organizations efficiently manage and secure their microservices-based applications. Thomas will also touch on some of the challenges organizations may face when implementing service meshes, providing valuable insights on how to overcome them. By the end of the presentation, attendees will have a better understanding of service meshes and how they can leverage Istio to enhance their infrastructure's capabilities.

2 0