ECS Digital at Cloud Expo Europe

ECS Digital at Cloud Expo Europe

This week saw thousands of IT professionals head to the Europe’s largest Cloud exhibition – including ECS Digital and our village of partners!

From blockchain and IoT vendors, to datacentre climate control systems manufacturers and cable suppliers, the crowds enticed anybody interested in Cloud-first, scaling up, refining, or just getting started with the tools and technology.

As has been echoed in previous events, Cloud Expo Europe is an unrivalled opportunity to meet with leading technology innovators and service providers, and network with your peers. Attendees also gain access to a wealth of knowledge and advice including emerging trends, tech deep dives, lessons learned and market forecasts.

ECS Digital once again have donned their conference apparel and deployed Europe’s only DevOps Partner Village, bringing together vendors from across the DevOps tool chain. This included Sonatype, New Relic and Storage OS – experts in application performance monitoring and artifact lifecycle management to dynamic container storage, all under one red, white and blue banner.

As you’ll probably know by now, ECS Digital is an agnostic DevOps and continuous delivery consultancy that provides professional and DevOps expertise to thousands of customers, and this year they have been showcasing the newest feather in their cap; Enablement Pods™.

Enablement PodsTM introduce a new way of working, processes and tooling. By remaining flexible in their resource profiling, our fixed priced outcome-based engagement model enables you to transform at scale by embedding – for short periods – in existing engineering teams to enable them to implement true change. What’s more, you decide the outcomes and objectives for each sprint, and we put our fees at risk to ensure we deliver.

It really is that simple.

During their talk on day one, Young DevOps Consultant of the Year 2018 Michel Lebeau and Pod Delivery Lead Tom Chapman described Enablement Pods™ as ECS Digital new weapon for making long-lasting and impactful changes in the Enterprise space. They also walked guests through how they are using Enablement Pods™, some of the challenge case studies and what Enablement Pods™ has achieved. If you missed the talk, you can learn more here.

ECS Digital also introduced a second, equally exciting initiative at Cloud Expo Europe. The DevOps Playground is supporting the tech community by giving enthusiasts a platform to explore new technology and tools. We’re also super chuffed that the Playground reached 4,000 members worldwide during the show – we’re giving credit to the talk our team delivered on day two!

I was fortunate enough to deliver the DevOps Playground story, describing how ECS Digital have used the DevOps Playground to build a tech community that encourages tech enthusiasts to not only learn about tools, but to gain hands-on experience under the supervision of engineers.

Each month, the DevOps Playground welcomes large numbers of tech-enthusiasts to one of our four worldwide locations – London, Singapore, Pune and Edinburgh. Each Playground lasts for around 2.5 hours, with a chunk of that time set aside for individuals to run and use the chosen tech / tools on their own laptop.

Attendees can expect to follow along with a structured and comprehensive exercise, designed to jumpstart new users with unfamiliar technologies and to highlight the best ways to use the technology. If this is the first you’ve heard of it, head over to the DevOps Playground website to find out more.

Other key takeaways from the show include:

  • Containers are driving the Cloud adoption of software development for 90% of the customers we spoke to
  • DevOps is the new standard for Cloud and agile working and is driving the need to modernise the more traditional methods
  • Cloud Expo is the one-stop-shop for all things Cloud – it was an eye opener seeing how much physical infrastructure goes into the ‘Cloud’

And that is just the tip of the iceberg. We will be revealing a mini-video series about Cloud Expo over the next couple of weeks to recapture some of the best moments from the show – watch this space!

Morgan AtkinsECS Digital at Cloud Expo Europe
read more
5 Common AWS EC2 Challenges – and How to Tackle Them!

5 Common AWS EC2 Challenges – and How to Tackle Them!

The Cloud revolution is well and truly underway, as demonstrated by the 44,000 attendees at the recent Amazon Web Services (AWS) re:invent conference. Many businesses have adopted a Cloud provider like AWS in some form or another.

AWS’s Elastic Compute Cloud (EC2) has been a service offering since 2006. It allows users to launch virtual computing environments on demand. EC2 is one of over 100 services from AWS, and each provides incredible value in your business’ journey to the Cloud.

Many businesses will be in the early stages of their Cloud adoption journey. We have seen some really successful transitions and some…not so great transitions. This post will explore some of the challenges with AWS EC2, and how they can be solved.

Challenges with AWS EC2

Resource Utilisation

Challenge: AWS EC2 makes it easy for businesses to scale. EC2 gives you complete control over your instances, with a range of instance types at your disposal. The challenge in these cases is how you manage the number of instances you have, so that costs aren’t impacted by large, long-running instances.

Solution(s):

  • Limit the number of acceptable instances, using Infrastructure as Code tools such as AWS’ CloudFormation or Hashicorp’s Terraform as a provisioning strategy. This will help display resource graphs to gain a further insight into your infrastructure.
  • Understand the type of instances you require. AWS has four payment options for instances: on-demand, reserved, spot and dedicated. These will significantly reduce cost and help a business understand if EC2 is being used in the right way. For example, if all your instances are dedicated, you are most likely not leveraging the true benefits of the Cloud.
  • Use AWS CloudWatch to detect and shut down idle instances. This will remove any long running instances that are not used, and ensure the environment is not cluttered.

Security: 

Challenge: Whilst EC2 places importance on security, many organisations still face challenges when ensuring that instances are running securely. What happens when you have an instance that is public-facing? Who has access, and how is this monitored?

Solution(s):

  • Use AWS CloudTrail. This will track all user and API usage. This, as a minimum, will help toward auditing and begin to satisfy compliance controls.
  • Create rules that restrict misconfigured instances, such as allowing for Public IPs. These could be integrated into your CloudFormation or Terraform
  • Use Amazon GuardDuty to monitor your AWS accounts and workloads. This uses intelligent threat detection to determine any malicious activity, and can take action with automated remediation.

Deploying at Scale

Challenge: Running hundreds (or even thousands) of instances can result in unmanageable and cluttered environments. This can make it difficult to determine who owns which instance, which regions are using it and what it’s being used for.

Solution(s):

  • As your business scales, separate it into different AWS accounts, to maintain control. AWS Organisations will enable policy-based management for these separate accounts.
  • Use CloudFormation or Terraform to enforce a tagging strategy for the separation of environments, applications, business units and more.

Configuration Management

Challenge: Businesses will use some of the default Amazon Machine Images (AMIs) provided by AWS. However, as adoption matures, many find that custom configurations need – such as additional users and patching – need to be made.

Solution(s):

  • Create a process to manage the lifecycle of your AMI, using the default AMIs. Then, use Hashicorp’s Packer, to make further changes to the image.
  • Use Cloud Init to handle the early initialisation of an instance. This, along with other config management tools such as Puppet and Ansible, can be used to make custom changes.

Serverless

Challenge: Managing EC2 instances! What if we could deploy code without worrying about the instances it has to get deployed to?

Solution: Use AWS Lambda. AWS Lambda lets you run code without provisioning or managing servers. With Lambda, you can run code for virtually any type of application or back-end service. Just upload your code, and Lambda will take care of everything required to run and scale your code with high availability. You can set up your code to automatically trigger from other AWS services, or call it directly from any web or mobile app. The learning curve for Lambda can be steep, but once you have passed that barrier, you will never look at code deployment in the same way again.

How to best adopt AWS Cloud

Many of the solutions we’ve mentioned in this post are tools available within AWS. When starting your Cloud journey, it’s important to understand these resources (and the many more) that are available in AWS, to ensure successful implementation.

Some additional general practices that should be considered when adopting any Cloud, include:

Cost Management

Using tools like AWS Cost explorer will enable you to see patterns and trends in your spend over time, that can help you understand Cloud costs. This data can then be used to forecast Cloud costs over the next quarter, which can be used to set budgets for your Cloud spend. Tools like AWS budgets can alert businesses when costs or usage are forecasted to exceed, and provide oversight over where overspend is occurring.

Build with fault tolerance in mind

Nowadays, companies who don’t achieve 99.99% uptime are in risk of grave loss of both business and client trust, simply because they’re not available (usually in a high-traffic periods). Tools such as AWS S3 guarantee 99.99% uptime for your static assets, while services like RDS and CloudFront are designed with failover in mind, to provide HA and data availability at any given time. AWS also publishes regular whitepapers that illustrate how to architect and build resilient applications, helping businesses to decrease infrastructure and ownership costs.

There will always be challenges and learnings involved in the adoption of new technology. To make sure your Cloud migration is as effective, efficient and valuable as possible, it’s important to consider potential challenges and solutions of Cloud configuration, migration and management, before you adopt. Being aware of the challenges your business might experience using AWS or any other Cloud platform will enable you to tackle any issues and recover much more quickly.

If you’re experiencing issues with your AWS implementation, or Cloud infrastructure in general, please get in touch. ECS Digital offers a Cloud Health Assessment to help businesses realise the potential of Cloud and ensure their applications are truly native in the Cloud.

Thivan Visvanathan5 Common AWS EC2 Challenges – and How to Tackle Them!
read more