Ceph

How to handle large omap objects

How to handle large omap objects 1506 1001 Wout van Heeswijk

Every once in a while a customer will ask me what to do with these messages: health: HEALTH_WARN1 large omap objects First lets see what this means: Ceph services are built on top of RADOSCeph stores data in relation to Ceph/Rados objects.Ceph/Rados objects can consist of three major parts:data: bytestreamkey/value pairs: omap dataeXtra ATTRibuteS: called…

read more

Creating a Management Routing Instance (VRF) on Juniper QFX5100

Creating a Management Routing Instance (VRF) on Juniper QFX5100 1414 1001 Wido den Hollander

For a Ceph cluster I have two Juniper QFX5100 switches running as a Virtual Chassis. This Virtual Chassis is currently only performing L2 forwarding, but I want to move this to a L3 setup where the QFX switches use Dynamic Routing (BGP) and thus become the gateway(s) for the Ceph servers. This should work, but…

read more

Setting noout flag per Ceph OSD

Setting noout flag per Ceph OSD 1630 1001 Wido den Hollander

Prior to Ceph Luminous you could only set the noout flag cluster-wide which means that none of your OSDs will be marked as out. On large(r) cluster this isn’t always what you want as you might be performing maintenance on a part of the cluster, but you sill want other OSDs which go down to…

read more

Comparing two Ceph CRUSH maps

Comparing two Ceph CRUSH maps 1500 1000 Wido den Hollander

Sometimes you want to test if changes you are about to make to a CRUSH map will cause data to move or not. In this case I wanted to change a rule in CRUSH where it would use device classes, but I didn’t want any of the ~1PB of data in that cluster to move.…

read more

HAProxy in front of Ceph Manager dashboard

HAProxy in front of Ceph Manager dashboard 1500 1000 Wido den Hollander

The Ceph Mgr dashboard plugin allows for an easy dashboard which can show you how your Ceph cluster is performing. In certain situations you can’t contact the Mgr daemons directly and you have to place a Proxy server between your computer and the Mgr daemons. This can be done easily with HAProxy and the following…

read more

VXLAN with VyOS and Ubuntu 18.04

VXLAN with VyOS and Ubuntu 18.04 1267 950 Wido den Hollander

VXLAN Virtual Extensible LAN uses encapsulation technique to encapsulate OSI layer 2 Ethernet frames within layer 4 UDP datagrams. More on this can be found on the link provided. For a Ceph and CloudStack environment I needed to set up a Proof-of-Concept using VXLAN and some refurbished hardware. The main purpose of this PoC is…

read more

Placement Groups with Ceph Luminous stay in activating state

Placement Groups with Ceph Luminous stay in activating state 1500 1001 Wido den Hollander

Placement Groups stuck in activating When migrating from FileStore with BlueStore with Ceph Luminuous you might run into the problem that certain Placement Groups stay stuck in the activating state. 44 activating+undersized+degraded+remapped PG Overdose This is a side-effect of the new PG overdose protection in Ceph Luminous. Too many PGs on your OSDs can cause…

read more

Quick overview of Ceph version running on OSDs

Quick overview of Ceph version running on OSDs 1500 1000 Wido den Hollander

When checking a Ceph cluster it’s useful to know which versions you OSDs in the cluster are running. There is a very simple on-line command to do this: ceph osd metadata|jq '.[].ceph_version'|sort|uniq -c Running this on a cluster which is currently being upgraded to Jewel to Luminous it shows: 10 "ceph version 10.2.6 (656b5b63ed7c43bd014bcafd81b001959d5f089f)" 1670…

read more

Do not use SMR disks with Ceph

Do not use SMR disks with Ceph 1500 1000 Wido den Hollander

Many new disks like the Seagate He8 disks are using a technique called Shingled Magnetic Recording to increase capacity. As these disks offer a very low price per Gigabyte they seem interesting to use in a Ceph cluster. Performance Due to the nature of SMR these disks are very, very, very bad when it comes…

read more

Testing Ceph BlueStore with the Kraken release

Testing Ceph BlueStore with the Kraken release 1506 1000 Wido den Hollander

Ceph version Kraken (11.2.0) has been released and the Release Notes tell us that the new BlueStore backend for the OSDs is now available. BlueStore The current backend for the OSDs is the FileStore which mainly uses the XFS filesystem to store it’s data. To overcome several limitations of XFS and POSIX in general the…

read more

Get

in touch.

    ConsultancyTrainingSupport
    Privacy Preferences

    When you visit our website, it may store information through your browser from specific services, usually in the form of cookies. Here you can change your Privacy Preferences. It is worth noting that blocking some types of cookies may impact your experience on our website and the services we are able to offer.

    Click to enable/disable Google Analytics tracking code.
    Click to enable/disable Google Fonts.

    Visit privacy policy Visit terms and conditions

    Our website uses cookies, mainly from 3rd party services. Define your Privacy Preferences and/or agree to our use of cookies.