Open main menu

DevOps

DevOps (a clipped compound of "development" and "operations") is a software development methodology that combines software development (Dev) with information technology operations (Ops). The goal of DevOps is to shorten the systems development life cycle while also delivering features, fixes, and updates frequently in close alignment with business objectives.[1] The DevOps approach is to include automation and event monitoring at all steps of the software build.[citation needed]

Contents

DefinitionEdit

 
Venn diagram showing DevOps as the intersection of development (software engineering), operations and quality assurance (QA)

Academics and practitioners have not developed a unique definition for the term "DevOps".

From an academic perspective, Len Bass, Ingo Weber, and Liming Zhu—computer science researchers from the Software Engineering Institute—suggested to define DevOps as "a set of practices intended to reduce the time between committing a change to a system and the change being placed into normal production, while ensuring high quality".[2]

The term DevOps, however, has been used in multiple contexts.[3]

HistoryEdit

In 2009 Patrick Debois coined the term[failed verification] by naming a conference "devopsdays"[4] which started in Belgium and has now spread to other countries.[5]

ToolchainEdit

 
Illustration showing stages in a DevOps toolchain

As DevOps is intended to be a cross-functional mode of working, rather than a single DevOps tool, there are sets (or "toolchains") of multiple tools.[6] Such DevOps tools are expected to fit into one or more of these categories, reflective of key aspects of the development and delivery process:[7][8]

  1. Code – code development and review, source code management tools, code merging
  2. Build – continuous integration tools, build status
  3. Test – continuous testing tools that provide feedback on business risks
  4. Package – artifact repository, application pre-deployment staging
  5. Release – change management, release approvals, release automation
  6. Configure – infrastructure configuration and management, infrastructure as code tools
  7. Monitor – applications performance monitoring, end-user experience

Note that there exist different interpretations of the DevOps toolchain (e.g. Plan, Create, Verify, Package, Release, Configure, and Monitor).

Some categories are more essential in a DevOps toolchain than others; especially continuous integration (e.g. Jenkins) and infrastructure as code (e.g. Puppet).[9][10]

Relationship to other approachesEdit

AgileEdit

The need for DevOps arose from the increasing success of agile software development,[citation needed] as that led to organizations wanting to release their software faster and more frequently.[citation needed] As they sought to overcome the strain[which?] this[which?] put on their release management processes, they had to adopt patterns such as application release automation, continuous integration tools, and continuous delivery.[need quotation to verify][11][12]

ArchOpsEdit

ArchOps presents an extension for DevOps practice, starting from software architecture artifacts, instead of source code, for operation deployment.[13]. ArchOps states that architectural models are first-class entities in software development, deployment, and operations.

Continuous deliveryEdit

Continuous delivery and DevOps have common goals and are often used in conjunction, but there are subtle differences.[14][15]

While continuous delivery is focused on automating the processes in software delivery, DevOps also focuses on the organization change to support great collaboration between the many functions involved.[14]

DevOps and continuous delivery share a common background in agile methods and lean thinking: small and frequent changes with focused value to the end customer.[16] They are well communicated and collaborated internally, thus helping achieve faster time to market, with reduced risks.[11][17]

DataOpsEdit

The application of continuous delivery and DevOps to data analytics has been termed DataOps. DataOps seeks to integrate data engineering, data integration, data quality, data security, and data privacy with operations.[18] It applies principles from DevOps, Agile Development and the statistical process control, used in lean manufacturing, to improve the cycle time of extracting value from data analytics.[19]

DevSecOpsEdit

DevSecOps is another practice that rose from DevOps that includes information technology security as a fundamental aspect in all the stages of software development.[20]

Site reliability engineeringEdit

In 2003, Google developed site reliability engineering (SRE), an approach for releasing new features continuously into large-scale high-availability systems while maintaining high-quality end user experience.[21] While SRE predates the development of DevOps, they are generally viewed as being related to each other.[22] Some aspects of DevOps have taken a similar approach.[23]

Systems administrationEdit

DevOps is often viewed as an approach to applying systems administration work to cloud technology.[24]

WinOpsEdit

WinOps is the term used for DevOps practices for a Microsoft-centric view.

GoalsEdit

The goals of DevOps span the entire delivery pipeline. They include:

  • Improved deployment frequency;
  • Faster time to market;
  • Lower failure rate of new releases;
  • Shortened lead time between fixes;
  • Faster mean time to recovery (in the event of a new release crashing or otherwise disabling the current system).

Simple processes become increasingly programmable and dynamic, using a DevOps approach.[25] DevOps aims to maximize the predictability, efficiency, security, and maintainability of operational processes. Very often, automation supports this objective.

DevOps integration targets product delivery, continuous testing, quality testing, feature development, and maintenance releases in order to improve reliability and security and provide faster development and deployment cycles. Many of the ideas (and people) involved in DevOps came from the enterprise systems management and agile software development movements.[26]

Views on the benefits claimed for DevOpsEdit

Companies that practice DevOps have reported significant benefits, including: significantly shorter time to market, improved customer satisfaction, better product quality, more reliable releases, improved productivity and efficiency, and the increased ability to build the right product by fast experimentation.[11]

However, a study released in January 2017 by F5 of almost 2,200 IT executives and industry professionals found that only one in five surveyed think DevOps had a strategic impact on their organization despite rise in usage. The same study found that only 17% identified DevOps as key, well below software as a service (42%), big data (41%) and public cloud infrastructure as a service (39%).[27]

Cultural changeEdit

DevOps initiatives can create cultural changes in companies [28] by transforming the way operations, developers, and testers collaborate during the development and delivery processes.[29] Getting these groups to work cohesively is a critical challenge in enterprise DevOps adoption.[30][31]

DevOps as a job titleEdit

While DevOps describes an approach to work rather than a distinct role (like system administrator), job advertisements are increasingly using terms like "DevOps Engineer".[32][33]

While DevOps reflects complex topics, the DevOps community uses analogies to communicate important concepts, much like "The Cathedral and the Bazaar" from the open source community.[34]

  • Cattle not Pets: the paradigm of disposable server infrastructure.[35]
  • 10 deployments per day: the story of Flickr adopting DevOps.

Building a DevOps cultureEdit

 
DevOps T-shirt worn at a computer conference.

DevOps principles demand strong interdepartmental communication. Team-building and other employee engagement activities are often used to create an environment that fosters this communication and cultural change within an organization.[36] Team–building activities can include board games, trust activities, and employee engagement seminars.[37]

DeploymentEdit

Companies with very frequent releases may require a DevOps awareness or orientation program. For example, the company that operates the image hosting website Flickr developed a DevOps approach, to support a business requirement of ten deployments per day;[38] this daily deployment cycle would be much higher at organizations producing multi-focus or multi-function applications. This is referred to as continuous deployment[39] or continuous delivery [40] and has been associated with the lean startup methodology.[41] Working groups, professional associations and blogs have formed on the topic since 2009.[42][43]

Architecturally significant requirementsEdit

To practice DevOps effectively, software applications have to meet a set of architecturally significant requirements (ASRs), such as: deployability, modifiability, testability, and monitorability.[44] These ASRs require a high priority and cannot be traded off lightly.

MicroservicesEdit

Although in principle it is possible to practice DevOps with any architectural style, the microservices architectural style is becoming the standard for building continuously deployed systems.[17] Because the size of each service is small, it allows the architecture of an individual service to emerge through continuous refactoring,[45] hence reducing the need for a big upfront design[citation needed] and allows for releasing the software early[citation needed] and continuously.

DevOps automationEdit

DevOps automation is a software engineering practice, which aims at eliminating manual handoffs, aligning siloed Dev and Ops departments, and delivering release-driven systems through the utilization of automation tools in development, test, stage, and production environments.[citation needed] DevOps automation can be achieved by repackaging platforms, systems, and applications into reusable building blocks through the use of technologies such as virtual machines and containerization. [46][47]

Implementation of DevOps automation in the IT-organization is heavily dependent on tools, [48] which are required to cover different areas of the systems development lifecycle (SDLC):

  1. Infrastructure as code — Ansible, Puppet, Chef
  2. CI/CD — Jenkins, Shippable, Bamboo
  3. Test automation — Selenium, Cucumber, Apache JMeter
  4. Containerization — Docker, Rocket, Unik
  5. OrchestrationKubernetes, Swarm, Mesos
  6. Deployment — Elastic Beanstalk, Octopus, Vamp
  7. Measurement — NewRelic, Kibana, Datadog
  8. ChatOps — Hubot, Lita, Cog

AdoptionEdit

Some articles in the DevOps literature assume or recommend significant participation in DevOps initiatives from outside an organization's IT department, e.g.: "DevOps is just the agile principle, taken to the full enterprise."[49]

A survey published in January 2016 by the SaaS cloud-computing company RightScale, DevOps adoption increased from 66 percent in 2015 to 74 percent in 2016. And among larger enterprise organizations, DevOps adoption is even higher – 81 percent.[50]

Adoption of DevOps is being driven by many factors – including:

  1. Use of agile and other development processes and methods;
  2. Demand for an increased rate of production releases – from application and business unit stakeholders;
  3. Wide availability of virtualized[51] and cloud infrastructure – from internal and external providers;
  4. Increased usage of data center automation[52] and configuration management tools;
  5. Increased focus on test automation[53] and continuous integration methods;
  6. A critical mass of publicly-available best practices.

See alsoEdit

ReferencesEdit

  1. ^ Loukides, Mike (7 June 2012). "What is DevOps?".
  2. ^ Bass, Len; Weber, Ingo; Zhu, Liming (2015). DevOps: A Software Architect's Perspective. ISBN 978-0134049847.
  3. ^ "Surprise! Broad Agreement on the Definition of DevOps". 2015-05-13.
  4. ^ Debois, Patrick. "Agile 2008 Toronto". Just Enough Documented Information. Retrieved 12 March 2015.
  5. ^ Debois, Patrick. "DevOps Days". DevOps Days. Retrieved 31 March 2011.
  6. ^ Gartner Market Trends: DevOps – Not a Market, but Tool-Centric Philosophy That supports a Continuous Delivery Value Chain (Report). Gartner. 18 February 2015.
  7. ^ Edwards, Damon. "Integrating DevOps tools into a Service Delivery Platform". dev2ops.org.
  8. ^ Seroter, Richard. "Exploring the ENTIRE DevOps Toolchain for (Cloud) Teams". infoq.com.
  9. ^ Theakanath, Thomas (2016-02-05). "DevOps Stack on a Shoestring Budget". devops.com.
  10. ^ "Stronger DevOps Culture with Puppet and Vagrant". Puppet Labs. Retrieved 22 October 2015.
  11. ^ a b c Chen, Lianping (2015). "Continuous Delivery: Huge Benefits, but Challenges Too". IEEE Software. 32 (2): 50–54. doi:10.1109/MS.2015.27.
  12. ^ Best Practices in Change, Configuration and Release Management (Report). Gartner. 14 July 2010.
  13. ^ Castellanos, Camilo; Correal, Dario (15 September 2018). Executing Architectural Models for Big Data Analytics. Lecture Notes in Computer Science. 11048. pp. 364–371. doi:10.1007/978-3-030-00761-4_24. ISBN 978-3-030-00760-7.
  14. ^ a b Humble, Jez; Farley, David (2011). Continuous Delivery: reliable software releases through build, test, and deployment automation. Pearson Education Inc. ISBN 978-0-321-60191-9.
  15. ^ Hammond, Jeffrey (9 September 2011). "The Relationship between DevOps and Continuous Delivery". Forrester Research.
  16. ^ Ambler, Scott W. (12 February 2014). "We need more Agile IT Now!". Dr. Dobb's the World of Software Development.
  17. ^ a b Chen, Lianping (2018). Microservices: Architecting for Continuous Delivery and DevOps. The IEEE International Conference on Software Architecture (ICSA 2018). IEEE.
  18. ^ "From DevOps to DataOps, By Andy Palmer - Tamr Inc". Tamr Inc. 7 May 2015. Retrieved 23 August 2017.
  19. ^ DataKitchen (15 March 2017). "How to Become a Rising Star with Data Analytics". data-ops. Retrieved 23 August 2017.
  20. ^ Weinberger, Matt (25 November 2014), Microsoft study finds everybody wants DevOps but Culture is a Challenge, Computerworld
  21. ^ Beyer, Betsy; Jones, Chris; Petoff, Jennifer; Murphy, Niall Richard (April 2016). Site Reliability Engineering. O'Reilly Media. ISBN 978-1-4919-2909-4.
  22. ^ "SRE vs. DevOps — a False Distinction? - DevOps.com". 18 May 2017.
  23. ^ Love DevOps? Wait until you meet SRE
  24. ^ "How to stay relevant in the DevOps era: A SysAdmin's survival guide".
  25. ^ "What is DevOps?". NewRelic.com. Retrieved 21 October 2014.
  26. ^ Nasrat, Paul. "Agile Infrastructure". InfoQ. Retrieved 31 March 2011.
  27. ^ Bourne, James (23 January 2017). "New research questions strategic importance of DevOps despite rise in usage". CloudTech.
  28. ^ Emerging Technology Analysis: DevOps a Culture Shift, Not a Technology (Report). Gartner.
  29. ^ Loukides, Mike (11 June 2012). What is Devops?. Oreilly Media.
  30. ^ "Gartner IT Glossary – devops". Gartner. Retrieved 30 October 2015.
  31. ^ Jones, Stephen; Noppen, Joost; Lettice, Fiona (21 July 2016). Proceedings of the 2nd International Workshop on Quality-Aware Dev Ops - QUDOS 2016. pp. 7–11. doi:10.1145/2945408.2945410. ISBN 9781450344111.
  32. ^ "Is DevOps a Title? - DevOps.com". DevOps.com. 20 March 2014. Retrieved 22 July 2017.
  33. ^ "DevOps: A Job Title or a School of Thought?". Monster Career Advice. Retrieved 22 July 2017.
  34. ^ "What are known useful and misleading memes in the DevOps culture?". devops.stackexchange.com. Retrieved 29 June 2017.
  35. ^ Sharwood, Simon. "Are Your Servers Pets or Cattle?". The Register. Retrieved 2 July 2018.
  36. ^ Walls, Mandi (15 April 2013). Building a DevOps Culture. OReilly Media. ISBN 9781449368364.
  37. ^ Roach, Patrick (2015-10-08). "Dice Breakers: Using DevOps principles and nerdery to reimagine Team building". DevOps.com.
  38. ^ "10+ Deploys Per Day: Dev and Ops Cooperation at Flickr". 2009-06-23.
  39. ^ "SAM SIG: Applied Lean Startup Ideas: Continuous Deployment at kaChing". SVForum.
  40. ^ Humble, Jez. "Why Enterprises Must Adopt Devops to Enable Continuous Delivery". Cutter IT Journal.
  41. ^ "Applied Lean Startup Ideas: Continuous Deployment at kaChing". 2010-05-26.
  42. ^ "DevOps Days 2009 Conference".
  43. ^ Edwards, Damon. "DevOps Meetup Recap".
  44. ^ Chen, Lianping (2015). Towards Architecting for Continuous Delivery. The 12th Working IEEE/IFIP Conference on Software Architecture(WICSA 2015). Montréal, Canada: IEEE. doi:10.1109/WICSA.2015.23.
  45. ^ Chen, Lianping; Ali Babar, Muhammad (2014). Towards an Evidence-Based Understanding of Emergence of Architecture through Continuous Refactoring in Agile Software Development. The 11th Working IEEE/IFIP Conference on Software Architecture(WICSA 2014). IEEE. doi:10.1109/WICSA.2014.45.
  46. ^ "Unleashing the Full Potential of Containerization for DevOps". Unleashing the Full Potential of Containerization for DevOps. 20 September 2017. Retrieved 20 June 2018.
  47. ^ "Containers vs. virtual machines: A simplified answer to a complex question".
  48. ^ "DevOps best practices: How much automation do you need?". TechBeacon. Retrieved 2018-11-14.
  49. ^ "DevOps is Agile for the Rest of the Company". DevOps.com. 2015-03-04.
  50. ^ Harvey, Cynthia (9 January 2017). "10 Ways DevOps is Changing the Enterprise". Datamation.
  51. ^ "Virtual Infrastructure products: features comparison". Welcome to IT 2.0: Next Generation IT infrastructures.
  52. ^ Ellard, Jennifer. "Bringing Order to Chaos through Data Center Automation". Information Management. SourceMedia. Archived from the original on 11 June 2010.
  53. ^ "Impact of DevOps on Testing". DevOps.com. 2015-08-21.

Further readingEdit

  • Davis, Jennifer; Daniels, Ryn (2016-05-30). Effective DevOps : building a culture of collaboration, affinity, and tooling at scale. Sebastopol, CA: O'Reilly. ISBN 9781491926437. OCLC 951434424.
  • Gene, Kim; Debois, Patrick; Willis, John; Humble, Jez; Allspaw, John (2015-10-07). The DevOps handbook : how to create world-class agility, reliability, and security in technology organizations (First ed.). Portland, OR. ISBN 9781942788003. OCLC 907166314.