A technique in which a new feature, or different variants of a feature, are made available to different sets of users and evaluated by comparing metrics and user behavior.
Typically high-level testing of the entire system carried out to determine whether the overall quality of both new and existing features is good enough for the system to go to production.
An agent is a program installed on specific physical servers in order to handle the execution of various processes on that server.
A precursor to Devops; Agile is a software development and, more broadly, business methodology that emphasizes short, iterative planning and development cycles to provide better control and predictability and support changing requirements as projects evolve.
Amazon Web Services (AWS) is a collection of remote computing services, also called web services, that make up a cloud computing platform offered by Amazon.com. These services are based out of 11 geographical regions across the world. The most central and well-known of these services are Amazon Elastic Compute Cloud and Amazon S3.
Bamboo is a continuous integration server from Atlassian, the makers of JIRA, Confluence and Crowd. Bamboo supports builds in any programming language using any build tool, including Ant, Maven, make, and any command line tools. Build notifications can be customized based on the type of event, and received via email, instant message, RSS, or pop-up windows in Eclipse-based IDEs and IntelliJ IDEA.
Bcfg2 (pronounced "bee-config") is a configuration management tool developed in the Mathematics and Computer Science Division of Argonne National Laboratory. Bcfg2 aids in the infrastructure management lifecycle – configuration analysis, service deployment, and configuration auditing.
A development methodology that asserts software should be specified in terms of the desired behavior of the application, and with syntax that is readable for business managers.
BigTable is a compressed, high performance, and proprietary data storage system built on Google File System, Chubby Lock Service, SSTable (log-structured storage like LevelDB) and a few other Google technologies.
Bitbucket is a web-based hosting service for projects that use either the Mercurial (since launch) or Git (since October 2011) revision control systems. Bitbucket offers both commercial plans and free accounts.
Nolio, which has since been acquired by CA, was an application service automation software for deploying and managing applications across data centers.
CA Release Automation is an enterprise-class, continuous delivery solution that automates complex, multi-tier release deployments through orchestration and promotion of applications from development through production.
CA Service Virtualization, formerly known as LISA, captures and simulates the behavior, data and performance characteristics of complete composite application environments, making them available for development and test teams throughout the software lifecycle, for faster time-to-market with quality software functionality at lower infrastructure cost.
Cacti is an open-source, web-based network monitoring and graphing tool designed as a front-end application for the open-source, industry-standard data logging tool RRDtool.
A go-live strategy in which a new application version is released to a small subset of production servers and heavily monitored to determine whether it behaves as expected. If everything seems stable, the new version is rolled out to the entire production environment.
A go-live strategy in which code implementing new features is released to a subset of the production environment but is not visibly, or only partially, activated. The code is exercised, however, in a production setting without users being aware of it.
Datadog is a SaaS-based monitoring and analytics platform for IT infrastructure, operations and development teams. It brings together data from servers, databases, applications, tools and services to present a unified view of the applications that run at scale in the cloud.
Datical’s mission is to radically improve and simplify the application release process by modernizing and automating the database release process. Datical solutions deliver the capabilities technology executives need to remove database deployments as a barrier to delivering new application innovation. With Datical, enterprises can eliminate the security vulnerabilities, costly errors, data loss and downtime often associated with current database deployment methods.
Automatically monitor the status of every database deployment across the enterprise. Given the opportunity for human error, manually tracking SQL script execution across all environments is not an ideal approach. Datical makes database auditing and deployment monitoring easy by automatically tracking and reporting on the status of every database deployment across the enterprise.
IBM DB2 is a family of database server products developed by IBM. These products all support the relational model, but in recent years some products have been extended to support object-relational features and non-relational structures like JSON and XML.
ElasticBox is a DevOps platform for agile enterprises. It's where developers and IT operations come together to define, deploy, and manage application automation agnostic of any infrastructure or cloud.
Elasticsearch is a search server based on Lucene. It provides a distributed, multitenant-capable full-text search engine with a RESTful web interface and schema-free JSON documents. Elasticsearch is developed in Java and is released as open source under the terms of the Apache License. Elasticsearch is the second most popular enterprise search engine.
ElectricFlow is a single DevOps platform that supports the entire end-to-end software development and delivery process. ElectricFlow Deploy is built on top of this powerful platform to automate deployments to accelerate time to market, reduce delivery costs, and increase quality, reliability and traceability.
EPAM Orchestrator combines the most optimal technology and service to create unified, dynamic, fully-managed cloud solutions. It is a comprehensive multiplatform, multi-cloud, federated application orchestration framework that advances lean engineering practices, enables full cycle, continuous solution delivery, reduces time to market and greatly improves quality.
Microsoft Excel is a spreadsheet application developed by Microsoft for Microsoft Windows, Mac OS X, and iOS. It features calculation, graphing tools, pivot tables, and a macro programming language called Visual Basic for Applications. It has been a very widely used as a release management tool in relation to DevOps.
Developer hours saved. Fastlane is the tool to release your iOS and Android app. It handles all tedious tasks, like generating screenshots, dealing with code signing, and releasing your application. Open docs.fastlane.tools for more information
FinalBuilder is Vsoft's build tool. With FinalBuilder you don't need to edit xml, or write scripts. Visually define and debug your build scripts, then schedule them with windows scheduler, or integrate them with Continua CI, Jenkins or any other CI Server.
Firebird is an open source SQL relational database management system that runs on Linux, Microsoft Windows, Mac OS X and a variety of Unix. The database forked from Borland's open source edition of InterBase in 2000, but since Firebird 1.5 the code has been largely rewritten.
FishEye is a revision-control browser and search engine owned by Atlassian, Inc. Although FishEye is a commercial product, it is freely available to open source projects and non-profit institutions.
FitNesse is a web server, a wiki, and an automated testing tool for software. It is based on Ward Cunningham's Framework for Integrated Test. FitNesse is designed to support acceptance testing rather than unit testing in that it facilitates detailed readable description of system function.
Ganglia is a scalable distributed system monitor tool for high-performance computing systems such as clusters and grids. It allows the user to remotely view live or historical statistics (such as CPU load averages or network utilization) for all machines that are being monitored.
Gatling is an open-source load testing framework based on Scala, Akka and Netty. The software is designed to be used as a load testing tool for analyzing and measuring the performance of a variety of services, with a focus on web applications.
Automated Security Testing. Gauntlt provides hooks to a variety of security tools and puts them within reach of security, dev and ops teams to collaborate to build rugged software. It is built to facilitate testing and communication between groups and create actionable tests that can be hooked into your deploy and testing processes.
Apache Geronimo is an open source application server developed by the Apache Software Foundation and distributed under the Apache license.
Gerrit is a free, web-based team code collaboration tool. Software developers in a team can review each other's modifications on their source code using a Web browser and approve or reject those changes. It integrates closely with Git, a distributed version control system.
SAP HANA is an in-memory, column-oriented, relational database management system developed and marketed by SAP SE. HANA's architecture is designed to handle both high transaction rates and complex query processing on the same platform. SAP HANA was previously called SAP High-Performance Analytic Appliance.
HBase is an open source, non-relational, distributed database modeled after Google's BigTable and written in Java. It is developed as part of Apache Software Foundation's Apache Hadoop project and runs on top of HDFS (Hadoop Distributed Filesystem), providing BigTable-like capabilities for Hadoop.
HP Helion is an enterprise cloud platform brand from Hewlett Packard consisting of hardware, software, and services hosted in the private, public, and hybrid cloud. HP Helion was announced and launched in May 2014. HP has stated it will commit 1 billion USD over two years to develop and market the platform.
Helix, a source code management (SCM) and content collaboration platform that brings distributed workflows, Git management, advanced threat detection and new deployment options to enterprises building Internet of Things devices and digital media.
Helix Core leverages the versioning engine that Perforce customers rely on for lightning-fast, file-level asset management. Helix Core securely manages all digital content—even large files—in a single repository, and delivers files quickly to large, distributed teams. The Helix Version Control System also includes Helix Swarm for code review and collaboration, and a bevy of Apps and Integrations.
IBM® Cloud is an open-standards, cloud platform for building, running, and managing applications. With IBM Cloud, developers can focus on building excellent user experiences with flexible compute options, choice of DevOps tooling, and a powerful set of IBM and third-party APIs and services.
Icinga is a scalable and extensible monitoring system which checks the availability of your resources, notifies users of outages and provides extensive BI data.
IDERA empowers database and IT professionals to design, monitor & manage data systems with complete confidence.
Internet Information Services (IIS, formerly Internet Information Server) is an extensible web server created by Microsoft for use with Windows NT family. IIS supports HTTP, HTTPS, FTP, FTPS, SMTP and NNTP.
IBM Informix is a product family within IBM's Information Management division that is centered on several relational database management system (RDBMS) offerings. The Informix products were originally developed by Informix Corporation, whose Informix Software subsidiary was acquired by IBM in 2001.
Perforce Jam is an open-source build system developed by Christopher Seiwald of Perforce Software. It can be used as a replacement for make. Its primary feature is its ability to express build patterns in an imperative language which supports structured namespaces (similar to Pascal records) and simple lists.
WildFly, formerly known as JBoss AS, or simply JBoss, is an application server authored by JBoss, now developed by Red Hat. WildFly is written in Java, and implements the Java Platform, Enterprise Edition (Java EE) specification. It runs on multiple platforms.
JBoss Data Virtualization is a data integration solution that sits in front of multiple data sources and allows them to be treated as a single source, delivering the right data, in the required form, at the right time to any application and/or user.
Unlimited PaaS and Container-Based IaaS in a Joint Cloud Solution for DevOps. Jelastic provides a turnkey Hybrid, Public and Private cloud platform that brings together enterprise PaaS and container-based IaaS. The platform provides certified containers for Java, PHP, Ruby, Node.js, Python and .NET and the ability to upload custom Docker containers. Jelastic offers agile deployment models, flexible scaling for stateless and stateful applications, collaboration and access control tools, billing and business analytics tools, while driving down TCO with high density and hardware utilization. Jelastic is a software company that enables cloud hosting service providers, systems integrators and enterprises to unleash the full potential of the cloud to generate superior ROI and efficiencies.
Kallithea is a free software source code management system that supports two leading version control systems, Mercurial and Git, and has a web interface that is easy to use for users and admins. You can install Kallithea on your own server and host repositories for the version control system of your choice.
Kibana is an open source data visualization plugin for Elasticsearch. It provides visualization capabilities on top of the content indexed on an Elasticsearch cluster. Users can create bar, line and scatter plots, or pie charts and maps on top of large volumes of data.
Kubernetes is an open source system for managing containerized applications across multiple hosts, providing basic mechanisms for deployment, maintenance, and scaling of applications.
LaunchDarkly allows software teams to move faster with less risk. Companies use this management platform to manage the whole feature lifecycle from launch to sunsetting. Teams have complete control over features at scale allowing them to release to specific users, collect feedback, and enable rollback.
“Lean manufacturing” or “lean production” is an approach or methodology that aims to reduce waste in a production process by focussing on preserving value. Largely derived from practices developed by Toyota in car manufacturing, lean concepts have been applied to software development as part of agile methodologies. The Value Stream Map (VSM), which attempts to visually identify valuable and wasteful process steps, is a key lean tool.
linuxcontainers.org is the umbrella project behind LXC, LXD, LXCFS and CGManager. The goal is to offer a distro and vendor neutral environment for the development of Linux container technologies. Our main focus is system containers. That is, containers which offer an environment as close to possible as the one you'd get from a VM but without the overhead that comes with running a separate kernel and simulating all the hardware. This is achieved through a combination of kernel security features such as namespaces, mandatory access control and control groups.
Liquibase is an open source database-independent library for tracking, managing and applying database schema changes. It was started in 2006 to allow easier tracking of database changes, especially in an agile software development environment.
Locust is an open source load testing tool that allows you to define user behavior with Python code, and swarm your system with millions of simultaneous users.
Make is a utility that automatically builds executable programs and libraries from source code by reading files called makefiles which specify how to derive the target program. Though integrated development environments and language-specific compiler features can also be used to manage a build process, Make remains widely used, especially in Unix.
Mantis Bug Tracker is a free and open source, web-based bug tracking system released under the terms of the GNU General Public License version 2. The most common use of MantisBT is to track software defects. However, MantisBT is often configured by users to serve as a more generic issue tracking system and project management tool.
Marathon is a production-grade container orchestration platform for Mesosphere's Datacenter Operating System (DCOS) and Apache Mesos.
MariaDB is a community-developed fork of the MySQL relational database management system intended to remain free under the GNU GPL. Being a fork of a leading open source software system, it is notable for being led by the original developers of MySQL, who forked it due to concerns over its acquisition by Oracle.
MarkLogic is a new generation database that is built with a flexible data model to store, manage, and search today’s data, without sacrificing any of the data resiliency and consistency features of last-generation relational databases. With these capabilities, MarkLogic is ideally suited for making heterogeneous data integration simpler and faster and for doing dynamic content delivery at massive scale.
Nagios, an open-source computer-software application, monitors systems, networks and infrastructure. Nagios offers monitoring and alerting services for servers, switches, applications and services. It alerts users when things go wrong and alerts them a second time when a the problem has been resolved.
NAnt is a free and open source software tool for automating software build processes. It is similar to Apache Ant, but targeted at the .NET environment rather than Java. The name NAnt comes from the fact that the tool is Not Ant.
Neo4j is an open-source graph database, implemented in Java. The developers describe Neo4j as "embedded, disk-based, fully transactional Java persistence engine that stores data structured in graphs rather than in tables". Neo4j is the most popular graph database.
New Relic is an American software analytics company based in San Francisco, California. Lew Cirne founded New Relic in 2008 and currently acts as the company's CEO. New Relic's technology, delivered in a software as a service (SaaS) model, monitors Web and mobile applications in real-time that run in cloud, on-premises, or hybrid environments
Nexus Pro gives you more information, more control, and better collaboration across your team than ever before. And it works with build tools like Ant, Ivy, Gradle, Maven, SBT and others. Use Nexus as the foundation for your complete Component Lifecycle Management approach.
Octopus Deploy is an automated deployment and release management server. It is designed to simplify deployment of ASP.NET applications, Windows Services and databases.
OneOps is a cloud management and application lifecycle management platform that developers use to both develop and launch new products, and to more maintain them throughout their entire lifecycle. OneOps enables developers to code their products in a hybrid, multi-cloud environment.
OpenShift is a platform as a service product from Red Hat. It is also an Infrastructure as a Service (IaaS), comparable to Google Storage and Amazon S3 online storage services.
OpenStack is a free and open-source cloud computing software platform. Users primarily deploy it as an infrastructure as a service (IaaS) solution.
OpenVZ (Open Virtuozzo) is an operating system-level virtualization technology for Linux. It allows a physical server to run multiple isolated operating system instances, called containers, virtual private servers (VPSs), or virtual environments (VEs.) OpenVZ is similar to Solaris Containers and LXC.
Packer is free and open-source software for creating identical machine images or containers for multiple platforms from a single source configuration. It was written by Mitchell Hashimoto and became one of the products in his company Hashicorp's software toolkits as open-source proprietary-managed software. It is associated with the Vagrant container management tool, also written by Hashimoto.
The PagerDuty Digital Operations Management Platform empowers teams to proactively mitigate customer-impacting issues by automatically turning any signal into the right insight and action, so you can innovate with confidence. Visualize every dimension of the customer experience with contextual insights and interactive applications, and optimize response orchestration, continuous development and delivery.
Pallet is a platform for agile and programmatic automation of infrastructure in the cloud, on server racks or directly on virtual machines. Pallet provides cloud provider and operating system independence, and allows for customization.
Centralized log management. Tracks down customer problems, error messages, app requests, slow DB queries, config changes.
Parasoft SOAtest automates complete end-to-end testing for business and security-critical transactions. Parasoft SOAtest is widely recognized as the leading enterprise-grade solution for API testing and API integrity. Thoroughly test composite applications with robust support for REST and web services, plus an industry-leading 120+ protocols/message types.
QuickBuild is PMease's build automation tool derived from LuntBuild. Like LuntBuild, QuickBuild is a powerful build automation and management tool. Continuous Integration or nightly builds can be easily set using a clean web interface. Executed builds are well managed using functions such as search, categorization, promotion, patching, deletion, etc. It also acts as a central build artifacts repository and download area for your whole team.
Rackspace Inc. is a managed cloud computing company based in Windcrest, Texas, USA, a suburb of San Antonio, Texas.
Rake is a software task management and build automation tool. It allows you to specify tasks and describe dependencies as well as to group tasks in a namespace. It is similar to SCons and Make, but it has a number of differences. The tool is written in the Ruby programming language and the Rakefiles (equivalent of Makefiles in Make) use Ruby syntax. It was originated by Jim Weirich.
Rally Software, founded in 2001, provides cloud-based solutions for managing Agile software development. Rally’s offerings include Application Lifecycle Management (ALM) and Project Portfolio Management (PPM) platform and products, Agile consulting services, courses through Agile University, and training courses focused on Agile and Lean practices.
Rancher is a complete, open source platform for deploying and managing containers in production. It includes commercially-supported distributions of Kubernetes, Mesos, and Docker Swarm, making it easy to run containerized applications on any infrastructure.
RapidDeploy is an application release and deployment automation tool built for DevOps teams and enterprise continuous delivery.
Sahi is an automation and testing tool for web applications coming in an open-source and a proprietary version. The open-source version includes a basic tools set sufficient for most testing purposes (Record on all browsers, Playback on all browsers, HTML playback reports, JUnit Style playback reports, Suites and batch run, Parallel playback of tests), whereas the Pro version includes further features such as test distribution and report customization.
Salt platform or SaltStack is a Python-based open source configuration management and remote execution application. Supporting the "infrastructure-as-code" approach to deployment and cloud management, it competes primarily with Puppet, Chef, and Ansible.
sbt is a build tool for Scala, Java, and more.
Scalyr's log management service is capable of aggregating terabytes per day and searching 100s of gigabytes per second. Scalyr is 100% cloud-based and was built from the ground up for performance. It includes tools for managing and parsing logs, plotting rich visualization, building dashboards, and setting comprehensive alerts. Scalyr is easy to setup with either a lightweight agent or a number of pre-built integrations (including CloudWatch metrics, CloudTrail logs, CloudFront logs, ELB access logs, and more.) Scalyr will help your entire team solve more DevOps problems, faster.
SecureAssist is a lightweight static analysis tool that automatically detects vulnerabilities and provides just-in-time security guidance to you as you code. With SecureAssist, you can eliminate the most common security problems, by checking your own code for security vulnerabilities, and using SecureAssist guidance to fix them.
Tableau Software is an American company based in Seattle. They make several tools for business intelligence and data visualization. Tableau focuses on producing fast data analytics and beautiful graphs and charts. In addition to enterprise-level software, Tableau offers free and low-cost tools for personal use.
Tasktop provides software integration, for all of your tools, while creating an integrated value stream for your organization and improving the way you deliver applications. Whether you’re connecting two tools or 20, just a few projects or hundreds, your integrations need to be straightforward to set up and manage. With Tasktop's model-based integration, you're able to use customized models for each artifact allowing you to reuse those models across multiple projects and tools.
Team Foundation Server (commonly abbreviated to TFS) is a Microsoft product that provides source code management, reporting, requirements management, project management, automated builds, lab management, testing and release management capabilities.
TeamCity is a Java-based build management and continuous integration server from JetBrains. It is a powerful continuous integration tool.
Tectonic, delivered by CoreOS, is an enterprise-ready platform for running Linux containers in a distributed environment. Tectonic combines Kubernetes and the CoreOS stack in a commercial distribution, prepackaged with an enterprise-ready management dashboard, an integrated container registry and a supported, continuously up-to-date distributed platform. Tectonic is available in any environment, cloud, or on-premise.
Code-level (i.e., does not require a fully installed end-to-end system to run) testing to verify the behavior of individual pieces of code. TDD makes extensive use of unit tests to describe and verify intended behavior.
IBM UrbanCode Build is a continuous integration and build management server optimized for the enterprise. It is designed to make it easy to scale the configuration and management of your build infrastructure and seamlessly plug into development, testing and release tooling.
IBM UrbanCode Deploy is a tool for automating application deployments through your environments. It is designed to facilitate rapid feedback and continuous delivery in agile development while providing the audit trails, versioning and approvals needed in production.
IBM UrbanCode Release, formerly called uRelease, is a collaborative release management tool that helps you handle the growing number and complexity of releases. You can plan, execute, and track a release through every stage of the delivery lifecycle. Based on lessons learned from working with our customers, UrbanCode Release reduces errors, while making large releases faster and more agile.
Vagrant, by HashiCorp, is an open-source tool that creates and configures virtual development environments. It can be seen as a wrapper around virtualization software such as VirtualBox, VMware, KVM, LXC and around configuration management software such as Ansible, Chef, Salt or Puppet.
A process visualization and improvement technique used heavily in lean manufacturing and engineering approaches. Value Stream Maps are used to identify essential process steps vs. “waste” that can be progressively eliminated from the process.
HashiCorp's Vault secures, stores, and controls access to tokens, passwords, certificates, API keys, and other sensitive resources in modern datacenters. For each resource, Vault handles leasing, revocation, rolling, and auditing.
vCloud Air is a public cloud platform built on the trusted foundation of vSphere, compatible with your on-premises data center, that includes infrastructure, disaster recovery, and various applications as service offerings. vCloud Air allows you to extend your workloads into the cloud with ease. You can migrate existing onsite virtual machines (VMs) to the public cloud or start up new application VMs directly in the cloud. You can also easily port VMs and other business-critical workloads back and forth to the location of your choice, all with the secure and capable foundation of vSphere.
Veracode is an application security company based in Burlington, Massachusetts. Founded in 2006, the company offers an automated cloud-based service for securing web, mobile and third-party enterprise applications.
A software development methodology based on a phased approach to projects, from “Requirements Gathering” through “Development” etc. to “Release”. Phases late in the process (typically related to testing and QA) tend to be squeezed as delays put projects under time pressure.
webhook is a lightweight configurable tool written in Go, that allows you to easily create HTTP endpoints (hooks) on your server, which you can use to execute configured commands. You can also pass data from the HTTP request (such as headers, payload or query variables) to your commands. webhook also allows you to specify rules which have to be satisfied in order for the hook to be triggered.
Oracle WebLogic Server is a Java EE application server currently developed by Oracle Corporation. Oracle acquired WebLogic Server when it purchased BEA Systems in 2008.
WebSphere Application Server (WAS) is a software product that performs the role of a web application server. More specifically, it is a software framework and middleware that hosts Java based web applications. It is the flagship product within IBM's WebSphere software suite.
A testing or quality assurance practice which is based on verifying the correct functioning of the internals of a system by examining its (internal) behavior and state as it runs.
XebiaLabs develops enterprise-scale Continuous Delivery and DevOps software, providing companies with the visibility, automation, and control to deliver software faster and with less risk. Headquartered in the U.S., XebiaLabs has a worldwide network of sales offices and partners.
XL Deploy is an agentless deployment automation tool that helps enterprises deliver value 10x faster to complex middleware environments. It allows users to deploy, rollback, and diagnose issues without writing or maintaining scripts or workflows.
XL Release is a release management tool specifically for CD. It enables teams across an organization to model & monitor releases, automate tasks within IT infrastructure, and cut release times by analyzing and improving release processes.