SUSE pulls the plug on SES. What are your options now?
A few months back the news came that SUSE stops supporting its Ceph-based SUSE Enterprise Storage (SES) product to their customers. And, with one eye on Rancher, will promote Longhorn instead. As we support mostly very avid Ceph storage teams we dove into the options you have if you are now a SUSE Enterprise Storage […]
How to handle large omap objects
Every once in a while a customer will ask me what to do with these messages: health: HEALTH_WARN1 large omap objects First let’s see what this means: Most of the time when seeing the large omap warning is in relation to the RGW workload. The RGW or Rados Gateway provides a S3 and/or SWIFT compatible […]
5 more ways to break your Ceph cluster
While we’ve been working with customers using Ceph in a variety of ways, we have encountered some several ways to break your Ceph cluster. In that light, here is an update on five more ways to break your Ceph cluster as a continuation of the original presentation done by Wido den Hollander which is called; […]
ZFS and Ceph, what a lovely couple they make!
Stable, secure data storage is probably one of the most important things in today’s data-driven world. With the ability to scale fast. Combining two great storage solutions provides you with all those in one. ZFS and Ceph are a couple that cannot easily be beaten! Why is that? The short explanation is scalability. ZFS is […]
Creating a Management Routing Instance (VRF) on Juniper QFX5100
For a Ceph cluster I have two Juniper QFX5100 switches running as a Virtual Chassis. This Virtual Chassis is currently only performing L2 forwarding, but I want to move this to a L3 setup where the QFX switches use Dynamic Routing (BGP) and thus become the gateway(s) for the Ceph servers. This should work, but […]
Comparing two Ceph CRUSH maps
Sometimes you want to test if changes you are about to make to a CRUSH map will cause data to move or not. In this case I wanted to change a rule in CRUSH where it would use device classes, but I didn’t want any of the ~1PB of data in that cluster to move. […]
HAProxy in front of Ceph Manager dashboard
The Ceph Mgr dashboard plugin allows for an easy dashboard which can show you how your Ceph cluster is performing. In certain situations you can’t contact the Mgr daemons directly and you have to place a Proxy server between your computer and the Mgr daemons. This can be done easily with HAProxy and the following […]
VXLAN with VyOS and Ubuntu 18.04
VXLAN Virtual Extensible LAN uses encapsulation technique to encapsulate OSI layer 2 Ethernet frames within layer 4 UDP datagrams. More on this can be found on the link provided. For a Ceph and CloudStack environment I needed to set up a Proof-of-Concept using VXLAN and some refurbished hardware. The main purpose of this PoC is […]
Placement Groups with Ceph Luminous stay in activating state
Placement Groups stuck in activating When migrating from FileStore with BlueStore with Ceph Luminuous you might run into the problem that certain Placement Groups stay stuck in the activating state. 44 activating+undersized+degraded+remapped PG Overdose This is a side-effect of the new PG overdose protection in Ceph Luminous. Too many PGs on your OSDs can cause […]
Quick overview of Ceph version running on OSDs
When checking a Ceph cluster it’s useful to know which versions you OSDs in the cluster are running. There is a very simple on-line command to do this: ceph osd metadata|jq ‘.[].ceph_version’|sort|uniq -c Running this on a cluster which is currently being upgraded to Jewel to Luminous it shows: 10 “ceph version 10.2.6 (656b5b63ed7c43bd014bcafd81b001959d5f089f)” 1670 […]