# Delivery Framework

# Outcome Delivery Framework



# Overview

[![DeliveryFramework.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/deliveryframework.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/deliveryframework.jpg)

# Ideation

<p class="callout info">~ 1 to 2 weeks</p>

> We have lots of insight from multiple sources we think might be worth exploring.

<table border="1" id="bkmrk-input-customer-insig" style="border-collapse: collapse; width: 100%; border-width: 0px; border-style: hidden;"><colgroup><col style="width: 50%;"></col><col style="width: 50%;"></col></colgroup><tbody><tr><td style="border-width: 0px;">### ➡ Input

- Customer insights
- Market Landscape
- Technology Landscape
- Business Objectives/ Strategy
- Service performance insight
- Idea capture form

</td><td style="border-width: 0px;">### Output ➡


- Identified sponsor
- Prioritised idea candidates to take forward into discovery
- Draft vision
- Value statement
- Idea description
- Strategic fit (relative value impact on existing OKRs)
- Key customer segments and jobs to be done
- Big assumptions to address
- Ideas backlog

The above outputs are typically summarised within an opportunity canvas

</td></tr><tr><td style="border-width: 0px;">### 🧵Golden Thread  
Practices

- [Brainstorming](https://pirate.cooking/books/practice-guides/page/brainstorming)
- [Visioning](https://pirate.cooking/books/practice-guides/page/visioning)
- [Value definition](https://pirate.cooking/books/practice-guides/page/value-definition)

</td><td style="border-width: 0px;">### 🧵Golden Thread  
Techniques

- [Amazon PR release](https://pirate.cooking/books/techniques-guide/page/amazon-pr-release)
- [Ideation workshop](https://pirate.cooking/books/techniques-guide/page/ideation-workshop)
- [Value proposition canvas](https://pirate.cooking/books/techniques-guide/page/value-proposition-canvas)
- [6 thinking hats](https://pirate.cooking/books/techniques-guide/page/6-thinking-hats)
- [OKR mapping](https://pirate.cooking/books/techniques-guide/page/okr-mapping-ndp)
- [Idea capture form](https://pirate.cooking/books/techniques-guide/page/idea-capture-form)

</td></tr></tbody></table>

[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 2.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-2.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-2.jpg)

[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 7.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)

# Discovery

<p class="callout info">~2 - 4 weeks</p>

> We have prioritised ideas we want to explore in more detail so we can confirm it solves a real problem for the customer

<table border="1" id="bkmrk-%E2%9E%A1-input-problems-to-" style="border-collapse: collapse; width: 100.001%; border-width: 0px;"><colgroup><col style="width: 50.045%;"></col><col style="width: 50.045%;"></col></colgroup><tbody><tr><td style="border-width: 0px;">### ➡ Input

Problems to Solve

or

Ideation output

- Ideas backlog
- Draft vision statement
- Agreed sponsor
- Capacity / Plan
- Opportunity Canvas
- Value statement

</td><td style="border-width: 0px;">### Output ➡

- Defined Problem Statement
- User Segmentation
- Hypotheses
- Research
- Data Insight
- Key unknowns / assumptions
- Indicative size of opportunity
- Baselined vision statement
- Refined Value Proposition
- High level outcome roadmap
- High level current technology baseline

The above outputs are typically summarised within a discovery paper


</td></tr><tr><td style="border-width: 0px;">### 🧵Golden Thread  
Practices

- [Visioning](https://pirate.cooking/books/practice-guides/page/visioning-IOH)
- [Root cause analysis](https://pirate.cooking/books/practice-guides/page/root-cause-analysis)
- [Generative research](https://pirate.cooking/books/practice-guides/page/generative-research-bhA)
- [Human centred design](https://pirate.cooking/books/practice-guides/page/human-centred-design-hcd)
- [Hypothesis thinking](https://pirate.cooking/books/practice-guides/page/hypothesis-thinking)
- [Value definition ](https://pirate.cooking/books/practice-guides/page/value-definition-ICI)
- [Value Prioritisation](https://pirate.cooking/books/practice-guides/page/value-prioritisation-pLE)

</td><td style="border-width: 0px;">### 🧵Golden Thread  
Techniques

[5 Whys](https://pirate.cooking/books/techniques-guide/page/5-whys)

[Value Proposition Canvas](https://pirate.cooking/books/techniques-guide/page/value-proposition-canvas-gps)

[Empathy Mapping](https://pirate.cooking/books/techniques-guide/page/empathy-mapping)

[User Journey Mapping ](https://pirate.cooking/books/techniques-guide/page/user-journey-mapping)

[OKR Mapping ](https://pirate.cooking/books/techniques-guide/page/okr-mapping)

[Problem Definition ](https://pirate.cooking/books/techniques-guide/page/problem-definition)

[Opportunity Solution Tree ](https://pirate.cooking/books/techniques-guide/page/opportunity-solution-tree)

[User interviews ](https://pirate.cooking/books/techniques-guide/page/user-interviews)

[Observational study ](https://pirate.cooking/books/techniques-guide/page/observational-study)

[Surveys ](https://pirate.cooking/books/techniques-guide/page/surveys)

[Assumption impact quad... ](https://pirate.cooking/books/techniques-guide/page/assumption-impact-quadrant-matrix)

</td></tr></tbody></table>

[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 3.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-3.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-3.jpg)[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 7.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)

# Validation

<p class="callout info">~ 2 to 4 weeks</p>

> We want to find a solution that demonstrably solves a valuable customer problem

<table border="1" id="bkmrk-%E2%9E%A1-input-prioritised-" style="border-collapse: collapse; width: 100.001%; border-width: 0px;"><colgroup><col style="width: 50.045%;"></col><col style="width: 50.045%;"></col></colgroup><tbody><tr><td style="border-width: 0px;">### ➡ Input

- Prioritised experiments (test and learn cards)
- Defined Problem Statement
- User Segmentation
- Hypothesis
- Supporting research
- Key unknowns / assumptions

</td><td style="border-width: 0px;">### Output ➡

- Business case
- Emergent Hypothesis
- Solution Approach + Options
- Solution architecture design
- Service Design
- Backlog (DEEP)
- Refined outcome roadmap
- Ruthless MVP candidate

</td></tr><tr><td style="border-width: 0px;">### 🧵Golden Thread  
Practices

- [Generative research ](https://pirate.cooking/books/practice-guides/page/generative-research)
- [Backlog refinement ](https://pirate.cooking/books/practice-guides/page/backlog-refinement-sZg)
- [Mobilisation ](https://pirate.cooking/books/practice-guides/page/mobilisation)
- [Lean experimentation ](https://pirate.cooking/books/practice-guides/page/lean-experimentation)
- [Prototyping ](https://pirate.cooking/books/practice-guides/page/prototyping)
- [Data driven decision m... ](https://pirate.cooking/books/practice-guides/page/data-driven-decision-making-dddm)
- [Value based prioritisa... ](https://pirate.cooking/books/practice-guides/page/value-based-prioritisation)

</td><td style="border-width: 0px;">### 🧵Golden Thread  
Techniques

- [Team Charter ](https://pirate.cooking/books/techniques-guide/page/team-charter)
- [Test and Learn Cards ](https://pirate.cooking/books/techniques-guide/page/test-and-learn-cards)
- [Hypothesis Creation ](https://pirate.cooking/books/techniques-guide/page/hypothesis-creation)
- [Cost of Delay Prioriti... ](https://pirate.cooking/books/techniques-guide/page/cost-of-delay-prioritisation)
- [Effort/Value Matrix (2... ](https://pirate.cooking/books/techniques-guide/page/effortvalue-matrix-22-prioritisation)
- [A/B Testing ](https://pirate.cooking/books/techniques-guide/page/ab-testing)
- [Card Sorting ](https://pirate.cooking/books/techniques-guide/page/card-sorting)
- [Data Analysis ](https://pirate.cooking/books/techniques-guide/page/data-analysis)
- [NPS/ CSAT metric ](https://pirate.cooking/books/techniques-guide/page/nps-csat-metric)
- [Lo-Fi Prototyping ](https://pirate.cooking/books/techniques-guide/page/lo-fi-prototyping)
- [Service Design Bluepri... ](https://pirate.cooking/books/techniques-guide/page/service-design-blueprint-mapping)
- [Usability testing ](https://pirate.cooking/books/techniques-guide/page/usability-testing)
- [User Story Mapping ](https://pirate.cooking/books/techniques-guide/page/user-story-mapping-zNv)
- 

</td></tr></tbody></table>

[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 4.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-4.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-4.jpg)[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 7.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)

# Delivery

<p class="callout info">Optimal velocity target is ~2 weeks</p>

> We prioritise our backlog of committed work to maximise delivery of value to our customers as early as possible

<table border="1" id="bkmrk-%E2%9E%A1-input-prioritised-" style="border-collapse: collapse; width: 100.001%; border-width: 0px;"><colgroup><col style="width: 50.045%;"></col><col style="width: 50.045%;"></col></colgroup><tbody><tr><td style="border-width: 0px;">### ➡ Input

- Prioritised Backlog
- Acceptance Criteria
- Test Scenarios
- Release Plan / Road Map
- Reference Solution Architecture
- Wireframe / Assets
- Service Guide / Maps
- Measures for success

</td><td style="border-width: 0px;">### Output ➡

- Deliverable Increment
- Test Cases
- Documentation (Min Viable Doc)
- Solution Architecture
- Service Guides
- Released solution
- End user documentation
- Internal and External Comms


</td></tr><tr><td style="border-width: 0px;">### 🧵Golden Thread  
Practices

- [Visualisation ](https://pirate.cooking/books/practice-guides/page/visualisation)
- [Value Prioritisation ](https://pirate.cooking/books/practice-guides/page/value-prioritisation)
- [Backlog refinement ](https://pirate.cooking/books/practice-guides/page/backlog-refinement)
- [Estimation ](https://pirate.cooking/books/practice-guides/page/estimation)
- [Incremental Delivery ](https://pirate.cooking/books/practice-guides/page/incremental-delivery)
- [CI/CD Continuous Integ... ](https://pirate.cooking/books/practice-guides/page/cicd-continuous-integration-continuous-deployment)
- [Source Control ](https://pirate.cooking/books/practice-guides/page/source-control)
- [Automated Testing ](https://pirate.cooking/books/practice-guides/page/automated-testing)
- [Release Management ](https://pirate.cooking/books/practice-guides/page/release-management)

</td><td style="border-width: 0px;">### 🧵Golden Thread  
Techniques

- [User Story Mapping ](https://pirate.cooking/books/techniques-guide/page/user-story-mapping)
- [3Cs (Backlog Refinement) ](https://pirate.cooking/books/techniques-guide/page/3cs-backlog-refinement)
- [User Story Writing ](https://pirate.cooking/books/techniques-guide/page/user-story-writing)
- [Cost of Delay Prioriti... ](https://pirate.cooking/books/techniques-guide/page/cost-of-delay-prioritisation-iBY)
- [Effort/Value Matrix (2... ](https://pirate.cooking/books/techniques-guide/page/effortvalue-matrix-22-prioritisation-zKq)
- [BDD - Behaviour Driven... ](https://pirate.cooking/books/techniques-guide/page/bdd-behaviour-driven-development)
- [Vertical Story Slicing ](https://pirate.cooking/books/techniques-guide/page/vertical-story-slicing)
- [User Story Splitting ](https://pirate.cooking/books/techniques-guide/page/user-story-splitting)
- [Estimation - Planning ... ](https://pirate.cooking/books/techniques-guide/page/estimation-planning-poker)
- [Sprint Planning ](https://pirate.cooking/books/techniques-guide/page/sprint-planning)
- [Sprint Retrospectives ](https://pirate.cooking/books/techniques-guide/page/sprint-retrospectives)
- [Sprint Review ](https://pirate.cooking/books/techniques-guide/page/sprint-review)
- [Infrastructure as Code... ](https://pirate.cooking/books/techniques-guide/page/infrastructure-as-code-iac)

</td></tr></tbody></table>

[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 5.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-5.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-5.jpg)[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 7.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)

# Run

### and improve through measuring and learning

<p class="callout info">ongoing</p>

> We measure metrics that matter, continually capture customer feedback and proactively identify new opportunities to improve the product experience

<table border="1" id="bkmrk-%E2%9E%A1-input-problems-to-" style="border-collapse: collapse; width: 100%; border-width: 0px;"><colgroup><col></col><col></col></colgroup><tbody><tr><td style="border-width: 0px;">### ➡ Input

- Service analytics
- Customer feedback analytics
- Operational analytics
- Customer service insight

</td><td style="border-width: 0px;">### Output ➡

- Idea candidates for discovery
- Defects backlog
- Operational improvements
- Candidates for experiments


</td></tr><tr><td style="border-width: 0px;">### 🧵Golden Thread  
Practices

- [Proactive monitoring ](https://pirate.cooking/books/practice-guides/page/proactive-monitoring)
- [Service Operations - I... ](https://pirate.cooking/books/practice-guides/page/service-operations-itil-framework-v4)
- [Continuous Discovery ](https://pirate.cooking/books/practice-guides/page/continuous-discovery)

</td><td style="border-width: 0px;">### 🧵Golden Thread  
Techniques

- [Cohort Analysis ](https://pirate.cooking/books/techniques-guide/page/cohort-analysis)
- [Logging and Monitoring ](https://pirate.cooking/books/techniques-guide/page/logging-and-monitoring)

</td></tr></tbody></table>

[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 6.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-6.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-6.jpg)[![D&I Value Outcome Delivery Lifecycle v1.0 - Frame 7.jpg](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)](https://pirate.cooking/uploads/images/gallery/2023-09/di-value-outcome-delivery-lifecycle-v1-0-frame-7.jpg)

# Perspectives



# Software Agile Delivery Overview

## Backlog Refinement and Sprint Planning

### Adding to the backlog

We run a flexible system where anyone in the project can add an issue to the backlog in Jira.

The backlog will contain a mix of technical tasks, bugs, user stories and spikes .

<sup id="bkmrk-%2Asee-below-1">\*see below</sup>

Larger pieces of work, that might span several sprints, are entered as Epics. Other issues can be assigned to an epic to show that they will contribute to it.

Just because an issue is in the backlog, does not necessarily mean that it will be worked on.

[![image.png](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/eoGimage.png)](https://pirate.cooking/uploads/images/gallery/2023-09/eoGimage.png)

### Refining the backlog

The dev elopement team must have a complete understanding of each ticket before they can agree to work on it. Each ticket must be understood at a business level and at a technical level.

Where the definition of done is not well understood, or there are edge cases that aren’t specified, the ticket will be referred to stakeholders for clarification.

Where the ticket is not understood technically, we will raise a time-boxed spike to investigate.

<sup id="bkmrk-%2A-1">\*</sup>

For these reasons we prefer to plan our sprints well in advance, so that all preliminary work can be undertaken first.

Once a ticket is well understood the development team will collaboratively ‘score’ the ticket, reaching a multi-faceted consensus on the amount of work, the complexity of the task and their experience with tasks of that nature.

Our Product Owner and the Stakeholders will collaborate to prioritise the backlog, with stories that are ‘Ready to Play’ at the top.

[![image.png](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/AqQimage.png)](https://pirate.cooking/uploads/images/gallery/2023-09/AqQimage.png)

### Sprint Planning

The top tickets in the backlog are moved into the current sprint until it contains tickets with a combined score equal to the team’s velocity (based on past experience).

It is worth noting that two, equally performant teams might allocate different scores to the same ticket, if they were both presented with it, and will have different sprint velocities accordingly. Our scoring system is deliberately unitless.

## During a Sprint

The functional test team will create a test plan from the User Stories in the backlog.

### Development

Developers will write code to fulfil the selected user stories, technical tasks and so on. Our code is supported by the automated tests we write, to prove our code works first in isolation and then when integrated with the rest of the solution.

In parallel to this, our automated testers will produce the scripts to validate the work produced at a UI level.

### Review

Once a ticket has been completed, we automatically run every unit and integration test for entire project, to make sure the changes we’ve made in one area of the project don’t adversely affect another.

The code is then subject to the review of at least two other development team members. We verify that the work completed is of good quality and that it will fulfil the definition of ready, as specified by the ticket in Jira.

### Internal Signoff

Our code is then deployed to a working environment where we can then run every UI test for the entire project.

If QA are happy with the result they will sign off the ticket. If bugs are found after this point, they must be added as new tickets on the backlog and go through the usual triaging process with the product owners and stakeholders.

[![image.png](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/wQLimage.png)](https://pirate.cooking/uploads/images/gallery/2023-09/wQLimage.png)

## Release management

As the development process continues, we accrue new completed work in our development environment, for internal sign off, that is not in our staging area, for external sign off.

### External Signoff

Stakeholders can communicate that they would like to see a new version of the product at any time.

The work that is signed off internally is bundled into a release build and migrated the external sign off environment. We will provide our own functional test plan to the stakeholders, as a good starting point, but the stakeholders are then free to test the system as they see fit.

### Going live

If the stakeholders are happy with the product then the version that is currently in our external testing environment is promoted to our live environment.

This process can happen at any time, although it is advisable to do this earlier in the week in case the need to rollback our work arises.

[![image.png](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/gLSimage.png)](https://pirate.cooking/uploads/images/gallery/2023-09/gLSimage.png)

## Q: Where are the Gant charts?

Our development, testing and infrastructure team practice continuous deployment.

We can deliver code to our external testing and production environments rapidly, and on demand. We can also roll back changes just as quickly.

Our formal meetings to review each sprint’s work may be a good time for stakeholders to request a new version of the product, although this could also happen at any other time.

The backlog in Jira delivers transparency over our work and allows for dynamic re-prioritisation of that work by the stakeholders.

[![image.png](https://pirate.cooking/uploads/images/gallery/2023-09/scaled-1680-/611image.png)](https://pirate.cooking/uploads/images/gallery/2023-09/611image.png)

# Research & Design: Discovery Plan

### Scoping, Resourcing &amp; Planning Discovery

## Pre-Discovery Planning

**Everything that needs to be in done by R&amp;D before Discovery Starts**

- Identify key Stakeholders
- Identify Key Services Involved.
- Plan &amp; Schedule Primary Research
- Kick-off brief session with Core Discovery team
- Plan Stakeholder / Service Workshops
- Define Discovery brief &amp; Manage expectations

#### Discovery Team

<table border="1" id="bkmrk-core-discovery-produ" style="border-collapse: collapse; width: 100.001%; border-width: 0px; height: 96.252px;"><colgroup><col style="width: 50%;"></col><col style="width: 50%;"></col></colgroup><tbody><tr style="height: 96.252px;"><td style="border-width: 0px; height: 96.252px;">Core Discovery

- Product / Project Manager
- User Researcher
- Service Designer

</td><td style="border-width: 0px; height: 96.252px;">Supportive Discovery

- Technical Architect
- Data Analyst
- UX Designer

</td></tr></tbody></table>

## Discovery Phase

**We can't make an informed decision**

- Primary Research
- Current State Blueprint
- Expert Review
- Competitor Analysis
- Existing Systems &amp; Processes
- Existing Analytics
- Identify best practice guidelines &amp; principles for the service
- Workshops with the Services, Contact Centre
- Technical Discovery

## Discovery Conclusion

**We can make an informed decision**

<table border="1" id="bkmrk-key-owner%3A-architect" style="border-collapse: collapse; width: 100.001%; border-width: 0px;"><colgroup><col style="width: 50%;"></col><col style="width: 50%;"></col></colgroup><tbody><tr><td style="border-width: 0px;">Key Owner: **Architect**, **UX, UR &amp; SD**

- Current State Blueprints
- Primary Research
- Existing Architecture
- Technical Discovery
- Expert Review
- Competitor analysis
- Existing Analytics

</td><td style="border-width: 0px;">Key Owner: **Product Manager**

- Defined problem statement
- Hypothesis
- Key unknowns &amp; Assumptions
- Refined Value Proposition
- High level outcome roadmap
- Experiment backlog
- Indicative size of opportunity

</td></tr></tbody></table>