DevOps World | Jenkins World: what to expect

DevOps World | Jenkins World: what to expect

Summer time, July lazily rolls into August and suddenly everyone becomes excited. And
just as the weather heats up. CloudBees very own DevOps World | Jenkins World is one
event which you should definitely circle on your calendar. And it’s just around the corner!

Here are the things we’re really looking forward to at DevOps World | Jenkins World 2019.

Jenkins Contributor Summit

We’re excited to see the return of the Jenkins Contributor Summit in San Francisco – a place where current and future contributors gather to discuss, learn and collaborate on the latest and greatest efforts within the Jenkins project. This year’s contributor summit will also form part of a joint Continuous Delivery Foundation [CDF] contributor summit.

The value from these sessions comes from hearing from the CloudBees themselves as it helps to understand what they feel is important for their product and their customers. It also gives us an insight into their proposed roadmap so we can begin to see where the product is going as a whole. With Kohsuke Kawaguchi, CloudBees Chief Scientist, Tracy Miranda, Director of Open Source Community and James Strachan looking to lead the project updates and BoF/Unconference ,this looks to be a real good kick0-start to the week.

Let’s Get Talking

Keynotes are probably one of the highlights of the week as you get to hear from some of the movers and shakers within the industry as they give their thoughts on where the industry is moving. With talks from Sacha Labourey, the CEO and Founder of CloudBees to Ben Williams, VP Product Management, we’re already anticipating an opportunity to see what’s next on the horizon for CloudBees and Jenkins during the show.

Not only that, but we will also be celebrating 15 years of Jenkins and the future of CI/CD, with talks from Tara Hernandez from Google, Chris Aniszczyk the CTO/COO of Cloud Native Computing Foundation and Andrew Glover a Director and engineer at Netflix to book end the celebrations!

DevSecOps Workshop: Security at a DevOps Speed

It’s 30 times cheaper to fix a security defect in Development vs. Production, yet Security is often treated as an afterthought and a bottleneck. It doesn’t have to be that way.

DJ Schleen’s hands-on workshop looks to address this misunderstanding head on, with promises to share tips and best practices for building better software, faster. Attendees can learn how to easily set up a Jenkins pipeline to automatically scan, detect, understand, and remediate known-vulnerable open source components. Attendees will also be given a chance to execute an attack against the same CVE that affected Equifax; then use Sonatype’s intelligence to understand and remediate the vulnerable libraries and verify the attack no longer works.

What’s more, DJ Schleen is a DevSecOps advocate at Sonatype making him best placed to run the workshop. Sonatype are one of the leaders in application security and are big advocates of shift-left security. As partners with Sonatype, we know what struggles some customer have with making sure the libraries and binaries they use to make up their mission critical application are and how they must guarantee their integrity. This is a talk which is guaranteed to give you some valuable takeaways to take back to your business.

Training

We love training. Especially when it comes from industry experts and with a CloudBees event like this – it’s an opportunity for attendees to get some hand-on training on their favourite products during the conference. Our very own Tom Chapman will be delivering training on Jenkins Pipeline and Fundamentals at this year’s event which is a real treat – be sure to sign up to his session! All training will be conducted on Monday 12th August in the morning. Other courses running include:

  • CloudBees Core Fundamentals
  • Continuous Delivery with Jenkins presented by Victor Farcic
  • Jenkins Admin 1 & 2 — Fundamentals presented by Bill Garret
  • DevSecOps Engineering fundamentals
  • DevOps Leader Certification Course
  • Jenkins Pipeline Fundamentals presented by Tom Chapman from ECS Digital

The Awards

The 2019 DevOps World | Jenkins World and CloudBees Innovation Awards look to honour the outstanding achievement of Jenkins Contributors and CloudBees customers around the globe – which is a great way of celebrating the open source nature of the tool.

In 2018, ECS Digital were proud to have won CloudBees’ Partner of the year award. It was a massive achievement for the business, with CloudBees recognising the hard work which had been put in by the team, on both sides throughout the year. 2019 marks a continued focus on moving the partnership between ECS Digital and CloudBees forward, providing world class consultancy and exercise to their customers.

In fact, we hosted a combined DevOps Playground just last week on Jenkins X – delivering a free hands-on session to attendees to enable others in the community to learn the basics of Jenkins X with CloudBees Jenkins X Distribution. Whilst Playgrounds only last 90mins, we managed to squeeze in the following:

  • Create a GKE cluster and install Jenkins X
  • Use Kubernetes™ GKE to deploy your application
  • Create a Quickstart Project from a build pack
  • Leverage Preview Environments for Pull Requests
  • Promote your changes into Production

If you missed the Playground, don’t fret. We will be releasing the event recording soon!

I guess the last thing to say is that we can’t wait to see everything that DevOps World | Jenkins World has to offer. It’s shaping up to be a fantastic four days (agenda can be found here) and we feel privileged to be part of it again – this year as sponsors and exhibitors. Whilst we sadly can’t send the whole team to sunny San Francisco, there will be a few friendly faces on our stand to answer all your DevOps, Digital transformation and/or training enquiries.

We look forward to hopefully seeing you there!

Benjamin ShonubiDevOps World | Jenkins World: what to expect
read more
Latest Enablement Pod offering unveiled…

Latest Enablement Pod offering unveiled…

ECS Digital announced the official unveiling of their Enablement Pod offering yesterday at DevOps World | Jenkins World, the annual gathering of DevOps practitioners using Jenkins for continuous delivery.

Understanding that business-wide transformations take time and involve multi-year programmes, ECS Digital have designed Enablement Pods to help clients effect change and realise value in the short and long term.

Enablement Pods are a collection of outcome-focused sprints that handpicks specialist teams to deliver the people, resources and capabilities their clients’ need, when they need them. These Pods help enterprises transform at scale by embedding – for short periods – in existing engineering teams to enable new ways of working, tooling and technology.

The unique feature of ECS Digital’s Enablement Pods is that they – and ECS Digital’s success – are measured against KPIs defined in Sprint Zero. By tying success to business outcomes, clients are guaranteed a real return on investment. And if ECS Digital don’t hit the agreed outcomes, customers get a return on the revenue invested.

Each additional sprint to the Sprint Zero provides an opportunity to showcase and review progress ensuring maximum value from all activities. Sprints last between two weeks and resources are dependent on specific project and sprint KPIs. Another unique feature of ECS Digital’s Enablement Pods is that their resource profile remains dynamic to satisfy the different skills requirements of sprint KPIs.

ECS Digital have begun using Enablement Pods as an essential tool to deliver transformation at scale for their prolific customers. In addition to exceeding project KPIs, ECS Digital have enhanced value by enabling internal teams so they become self-sufficient and architect solutions designed to survive tomorrow’s challenges, not just todays.

 

“ECS Digital’s input has added an extra level of intelligence which has enabled us to build on the capacity under their guidance. We have grown in our capabilities over these past 12 months and developed the skillsets of our internal team through additional training. If we have any DevOps or automation or platform requirements in the future, we won’t bother going to tender, we will go straight to ECS Digital.” Matthew Bates, IT Director at ThinkSmart

Enablement Pod outcomes:

  • For each £1 invested in us, we have delivered £3 of annualised savings in the development lifecycle of a Retail Bank core application
  • A 99% reduction of application environment configuration delivery timescales (from 7200 minutes to 3 minutes)
  • Increase quality of testing through automation as well as timescales of test cycles by over 50%
  • 12x reduction of application delivery cycle

About ECS Digital:

ECS Digital is an experienced digital transformation consultancy, helping clients deliver better products faster through the adoption of DevOps practices.

They are the digital practice of the ECS Group and have been leaders in digital transformation since 2003 – evolving their offerings to support their customers’ evolving needs. They believe in a better way to adopt and deliver new ways of working, processes and technology. A more valuable and outcome focused way of leveraging Enterprise DevOps and Agile testing to help build tomorrow’s enterprises today.

They’ve helped over 100 customers – including Lloyds Banking Group, ASOS, BP plc and Sky – realise the benefits of Enterprise DevOps and Agile Testing and have proactively remained relevant in the face of increasing challenges of customer expectation and market disruption. You can follow the ECS Digital community on LinkedIn and Twitter (@ECS_Digi).

Andy CuretonLatest Enablement Pod offering unveiled…
read more
AyeSpy, a new way to test for visual regressions

AyeSpy, a new way to test for visual regressions

Bill Gates famously said, “I will always choose a lazy person to do a difficult job because a lazy person will find an easy way to do it.”

At The Times, there is an incredible amount of business value placed on the aesthetics of the site. There have also been past incidents where CSS bugs have caused rollbacks.

With this in mind, traditional `automated` functional testing with selenium is ineffective to find these defects – in addition to being slow and high maintenance. To add to the problem, The Times release far too often to make manual verification possible.

This is where visual regression tools shine through. Their sole purpose is to give confidence that the applications under test are visually correct.

So what is visual regression?

There are 3 main parts to understanding how visual regression works.

  1. Baseline

A set of images that define how the application should look, based on previous recordings.

  1. Latest

A set of images detailing how the application currently looks.

  1. The comparison

Once we have both the baseline and the latest, we are able to perform a comparison between how the application is supposed to look and how it looks now. If there are differences, the build will fail, and you will need to approve the changes to update the baseline images once more.

We have used a number of visual regression tools within the Times Tooling team at News UK and each proved to have limitations.

A core testing principle that we believe at ECS Digital is you need to be testing as close to production/end users as possible.

Headless browsers such as phantomJS may give you a small performance increase when executing tests, but these browsers are far from how your end users will be interacting with the application under test.

Our first visual regression tool only supported headless browsers. We had several instances where it allowed bugs through, but this only occurred on Firefox and not PhantomJS. This loophole was the reason we decided to move on.

The second tool we tried was what we believed to be the industry open source favourite. After battling with it for well over a week we could not get it running stable or under 30 minutes, which as a developer is an unacceptable feedback loop.

As you can imagine, these inefficiencies didn’t sit well with the Times Tooling team and we decided to address the problem head-on and create our own “hand-rolled” visual regression tool.

Based on our previous painful visual regression experience, we were determined to build a tool that was:

  • Super performant
  • Lightweight and,
  • Made it easy to interpret results

A proof of concept was put together before fully refining the capabilities of the tool. We then waited for priority to allow before creating ‘AyeSpy’ in one sprint.

Four months down the line and AyeSpy has been successfully implemented, gaining approval from our clients and users on GitHub. Whilst the Times Tooling Team engineered AyeSpy, The Sun and data teams within News UK have since adopted it and it’s not hard to see why – AyeSpy takes less than 90 seconds to run 44 webpage comparisons. Other benefits include:

  • Only requires a .json config file to run
  • Maintenance is low
  • Able to explicitly wait for elements before screenshot is taken
  • Can integrate the Dom before screenshot
  • Drop cookies into browser
  • Remove dynamic elements from the DOM
  • Tests are farmed out to a containerised selenium grid for distributed testing and consistent state

When deciding to use visual regression, we have found in our experience that the tool works best on reasonably static sites that do not require long user journey to be completed before the screenshot. For example, clicking through a checkout journey would introduce a high level of risk and take away value from the tool. Ideally, you want to load the page, remove all dynamic elements, and then snapshot.

Where you can find the tool?

ECS Digital love to find value for our clients and give it back to the wider community, which is why we make these tools available on open source platforms such as GitHub and NPM.

I will also be hosting a hands-on session and demonstration of AyeSpy at an upcoming DevOps Playground on the 29th of November. Come along to learn more about what the AyeSpy has to offer!

Matt LowryAyeSpy, a new way to test for visual regressions
read more
Tooling and efficiency teams

Tooling and efficiency teams

ECS Digital has been operating in the DevOps space for over 20 years and this success is mostly down to our focus on self-improvement and innovating for the benefit of our clients. Our recent acquisition of QAWorks was largely initiated to support the continued efforts in the digital transformation sphere, focusing primarily on strengthening our expertise in software quality and delivery.

What we’ve seen since this coming-together is a greater offering for our clients – not to mention an increase in the number of smart-minds looking to evolve our existing tools and processes. This ‘fresh blood’ has a mix of experience – with some primarily working within big teams in large organisations where the division between development and test was not aligned to delivering business value.

As has been seen from successful adoptions of modern software delivery techniques, shifting left to a more agile methodology results in your development and operation teams working for each other. It also offers them more autonomy – resulting in smaller wait times and reduced feedback loops.

But what happens when you begin to scale this model within larger organisations?

For ECS Digital, the first step of any digital transformation is enabling you to successfully integrate an agile process. Part of this is helping you communicate and adopt a new culture, as well as introducing an engineering mindset to test– this can involve introducing SDETs to your development teams to ensure any feedback or strategies can be put in place quicker. Quicker feedback means improved lead-time and higher quality of applications.

Once you reach a level of confidence in your new process and are comfortable with the effectiveness of your teams and automated tools, our consultants begin to look at reusability – taking an in-depth view of your processes and offering recommendations of how to take them to the next level.

Focused primarily on larger organisations, our team has developed a quality assurance strategy that supports businesses who have around 25 or more working within the software delivery structure. Once you reach this magic number, an opportunity cost presents itself. 

This opportunity looks to do the following:

  • Reduce duplicated efforts,
  • Improve efficiencies of individuals and teams,
  • Recognise issues that are affecting more than one teamand create a reusable solution,
  • Remove the risk of gatekeeping behaviour by breaking down the silos and cultivating a culture of collaboration between teams 

Internally, this opportunity is known as introducing a ‘tooling and efficiency team’ (official name to be confirmed). Not only are these teams proving successful in current client work, they are a logical next step for those wishing to maximise their agile business model.

In short, this team consists of engineers with a broad skillset and sits within your business permanently. They are responsible for keeping a comprehensive eye over all your development and operation processes and specifically look for areas that are underperforming or no longer fit for purpose. Once identified, they create reusable solutions to combat individual and company-wide inefficiencies.

But if your agile methodology is already delivering on all your performance targets, why is this new team important?

Performance

By analogy, if you have a one-man operation and you invite an additional person to join this team, you are doubling your effectiveness. If work-demands require a third or fourth member of the team, you are again increasing your efficiencies – but as you scale, this math only works to a certain number. It is very much a balancing act, but what we’ve found whilst working with clients is once you reach a large development team of around 25, each new member starts to become less efficient.

By creating a one-stop-shop in the form of a tooling and efficiency team who can afford to spend the time looking for and creating tools to keep your business adapting, you are maximising ROI because you are making the most of the staff you have. This can be seen in our recent client work with NewsUK.

A reoccurring long-term objective for our clients is to increase the speed of delivery whilst maintaining quality. Quality assurance and automated testing are essential to helping them achieve this – and is the reason why a tooling and efficiency team is working so well. We work alongside our clients’ principal engineers to maintain a clear direction for this new team to move towards, measuring against agreed targets periodically. The benefits have so far been a strengthening in DevOps capabilities, as well as a strong improvement in development efficiencies and overall quality.

“ECS Digital consistently provide intelligent, hard-working and professional individuals who always manage to work well together. Kouros provides a strong organisational and delivery focused attitude that resonates through the team – who have made some invaluable and original open source products that will benefit us and others in the future. They are more than simply a QA team, but can-do developers who aren’t afraid of a challenge and putting the client first”

Craig Bilner, Principle Developer at NewsUK.

The transition to this efficiency model requires a level of collaborative consultancy to help oversee the adoption of the new team and integrate them with others already in the structure. ECS Digital engineers have the capability to enable adoption by working alongside your current team or by operating autonomously / self-managed within your business.

Their ability to constantly inspect, improve and adapt aligns with the very nature of agile methodologies, making it an ideal structural change to invest in long term.

Whilst our tooling and efficiency teams are an additional offering to our DevOps consultancy, it is a necessary next step for those wishing to take their agile business model to the next level.

ECS Digital is an experienced digital transformation consultancy that helps clients deliver better products faster through the adoption of modern software delivery methods. Our recent acquisition of the UK’s leading technical software testing organisation, QAWorks, means we’re well placed to offer expert advice about how tooling and efficiency teams can bolster your digital environments.

If you’d like to know more about how the tooling and efficiency approach could benefit your business, drop us a message here.

Kouros AliabadiTooling and efficiency teams
read more