DevOps Practices and Testing in Production

Common Release Problems

Issues like missing dependencies and slow performance.

Dev - Ops Divide

Separation of coding and operations tasks.

QA in Development

Quality assurance continues throughout the development process.

DevOps

Integration of development and operations teams.

DevOps Goals

Reduce friction and enable rapid releases.

Monitoring Performance

Tracking system performance and crash reports.

Automated Testing

Running tests automatically on every code change.

Change Management

Process of managing software updates and rollbacks of individual changes

Dependency Management

Handling software dependencies in development.

Load Spikes Management

Handling sudden increases in system load.

Database Tuning

Optimizing database performance for efficiency.

Rollback Releases

Reverting to previous software versions.

Bottlenecks Identification

Finding and addressing performance bottlenecks.

Continuous Delivery

Ensures software is production-ready at all times.

Continuous Deployment

Automatically tests and deploys incremental software changes.

Continuous Integration (CI)

automates code integration and testing.

Containers

Lightweight virtualization for application deployment.

Docker

Tool for creating and managing containers.

Configuration Management

Scripts to manage system configurations and versions.

Monitoring Tools

Tools for tracking system performance and health.

Incremental Rollout

Gradual deployment of features to users.

Rolling Back Changes

Reverting to previous software versions if needed.

Causal Inference

Determining the impact of changes on outcomes.

Treatment

Variant in A/B testing that is tested against control.

Control

Variant in A/B testing that serves as baseline.

Experiments in Production

Serve different versions to varied populations for analysis.

Release Management

Control which software version is deployed.

Version

Combination of revision and variant in software.

Parallel Development

Simultaneous work on independent software features.

Traceability

Ability to track changes and their origins.

Accountability

Responsibility for changes made in software.

Branching

Creating separate lines of development in software.

Trunk-based Development

Single branch development with frequent merges.

Feature Flags

Boolean options to enable/disable features dynamically.

Semantic Versioning

Versioning scheme using MAJOR.MINOR.PATCH format.

MAJOR Version

Incremented for incompatible API changes.

MINOR Version

Incremented for backwards-compatible functionality additions.

PATCH Version

Incremented for backwards-compatible bug fixes.

A/B Testing

Comparative testing of two versions for performance based on user behaviour.

Beta Tests

Pre-release testing with real users for feedback.

Telemetry Infrastructure

System for collecting and analyzing performance data.

Rollback Script

Script to revert to a previous software version.

Testing in Production

Evaluating software performance under real conditions.

Monitoring Outcomes

Observing results from software in live environments.

Data Collection in Testing

Gathering metrics to assess software functionality.