Grafana Alerting

Nomad, Kubernetes, and a Pragmatic Look at Choosing Orchestrators

Written by HashiCorp

| Jan 14, 2022

3 MIN READ

While Kubernetes is leading the orchestration market, this blog explains why a growing number of customers choose Nomad as an alternative or use each tool where most appropriate.

Back in March 2019, Matthias Endler from Trivago posted a blog “Maybe You Don’t Need Kubernetes,” explaining his company’s decision to use HashiCorp Nomad for orchestration instead of Kubernetes. His article garnered more than 500 comments on Hacker News and reminded the community that even when one technology seems to dominate headlines, one tool never fits all.

In the past two years, we have seen a big rise in the number of enterprises that deploy Nomad in production. There are remarkable stories from companies running Nomad across the world: in traditional on-premises datacenters, cloud instances, agricultural smart farms, industrial factories, the world’s largest ground-based solar telescopes, and even biology laboratories. Yet no matter the environment, organizations choose Nomad as an alternative to Kubernetes for its two unique core strengths:

  • Simplicity in usage and maintainability
  • Flexibility to deploy and manage containerized and non-containerized applications

Simplicity at Any Scale

Operating as a single lightweight binary (~50MB as of the 1.0 release), Nomad excels on-premises and at the edge, providing the same ease-of-use as it does in the cloud. Its architectural simplicity, native federation capabilities, and operator-friendly design enable companies to scale and manage an orchestrator with little operational overhead.

“Nomad is easy to cluster up. We converted our Kubernetes deployment manifest to Nomad job files, then tested it. And since it’s a single binary, it’s simple to configure to our specific needs, which eliminates much of the complexity we faced with Kubernetes. More importantly, Nomad’s agnostic infrastructure resource pool and automated workflows let us deploy and manage our containers and apps across on-prem and any private or public cloud environment, which dramatically expands our datacenter options while still meeting our data residency obligations.” — From AmpleOrganics. Read the full article here.

“I’m a complete beginner when it comes to distributed computing and orchestration. Nomad virtually eliminates barriers to entry for developers who don’t have cloud computing expertise and makes it really easy to connect to the cluster, configure it, and run my jobs while having full visibility into the jobs’ status so I can restart them if need be.” — From Autodesk. Read the full article here.

Organizations are capable of translating the simplicity of Nomad into real business results. Our customer interviews showed that it takes teams 1 to 3 weeks on average to get Nomad from a technical proof of concept into production, no matter the company size.

Its simplicity also carries over into maintainability. It is quite common to hear stories about lean teams of 1 to 4 people being able to service hundreds of developers and applications, and achieve high uptime with self-hosted Nomad across organizations. Some of the recent great examples include:

  • Cloudflare, who routes 10% of the world’s internet traffic
  • Roblox, who serves more than 150 million monthly active video game players globally
  • Pandora, who streams audio content to more than 60 million users monthly

Bridging Legacy Applications with Modern Orchestration

While seeing the growing trends of containerization and app modernization, we observe that most companies are taking an incremental approach and require multi-year efforts to fully migrate. Nomad’s flexible workload support beyond Docker containers allows companies to migrate at their own pace and be able to maintain a single, unified deployment workflow during the whole journey.

Another key benefit is to bring modern orchestration capabilities to legacy applications without the need for rewrites, such as zero-downtime deployment, improved resource utilization, and automation with a self-service experience.

“Our system runs several Docker containers as well as Java applications that access hardware resources and require root. Nomad makes it easy to add machines like mass spectrometers by first fingerprinting through the exec driver, and then rolling out more specific drivers. This gives us a unified control plane, enabling hardware and driver rollouts using vendor’s drivers — be it a centrifuge, incubator, or mass spectrometer.” — From Radix. Read the full article here.

“A large portion of our applications are Windows-based, so we need both Windows and Linux support. Although we do prefer running containers, we don’t necessarily want a hard requirement to have to use them and we like the idea of directly running applications on VMs if the use case calls for it. We wanted to make improvements to the current workflow without massive and time-consuming application rewrites. Ultimately we chose Nomad because it met all of our requirements and made the most sense to our environments.” — From Q2. Watch the video here.

A Prescriptive Approach to Ecosystem

The ecosystem can be a deciding factor for companies when it comes to choosing orchestrators. While Nomad’s strengths lie in simple, flexible core scheduling, it will be hard to replicate the ever-growing ecosystem built around Kubernetes. The CNCF diagram showcases the breadth of the Kubernetes landscape. With additions like Helm charts, it is much easier for Kubernetes users to run some popular open source frameworks than it is on Nomad today.

 


Go to Top