Blogs

Hardware Sizing - Ceph Radosgw (RGW)

Hardware Sizing - Ceph Radosgw (RGW) I’m often asked, “what’s the best hardware to use for Ceph?” The answer is simple - it depends. With Ceph there are many moving parts such as: Ceph Monitor Nodes Ceph RGW Nodes Ceph Mgr Nodes Ceph OSD Nodes Ceph MDS Nodes In addition to those nodes you may also have software or hardware load-balancers in front of your RGW nodes. This discussion is centered around RGW nodes only.

Continue reading

AWS S3 vs On-Premises

AWS S3 vs On-Premises When you own Enterprise Storage or are asked to build enterprise class storage you find yourself more frequently having to cost justify against outside Cloud Storage vendors like AWS S3, GCE or Azure. So, how will you do that since you have to make capital expenditures vs OpEx that these providers discuss so much? When you break down the pricing of AWS S3 and others you find that the actual storage cost is not too bad (depending on amount of stored data).

Continue reading

Hyper-Converged Infrastructure (HCI) - Truth

Hyper-Converged Infrastructure (HCI) - Truth I happened to just stumble upon a few marketing oriented whitepapers from VMWare today (odd use of my time). All three were centered around Hyper-Converged Infrastructure (HCI). At Bloomberg, we run VMWare and OpenStack clusters. Our OpenStack clusters are currently fully Hyper-Converged. I have even given talks on them http://lambdastack.io/videos/openstack-austin/. If you look at the video and the presentation you will see why we no longer believe in this model for us.

Continue reading

CI/CD Risk

CI/CD Risk Portions of this content are from Randy Bias @ cloudscaling.com under creative commons In the DevOps mythos or worldview, continuous delivery (“CD”) is considered one of the holy mantras. Unfortunately, many take CD to an extreme that is unwarranted and not even reflected in how the DevOps originators (e.g. Amazon, Google) operate. This is one of those situations where folks are extrapolating and providing an interpretation of DevOps that isn’t really accurate.

Continue reading

SLA - Availability or Durability

SLA - Availability or Durability I seem to be getting more questions lately like, “how many 9s is your object store?” or “how do you calculate 9s?”. The questions need to be narrowed down since those are very broad. For example, when dealing with storage like an object store, there are two types of “9s”. One for durability and one for availability. If you look at AWS S3, they put on their primary site 11 9s of durability which is very good.

Continue reading

Erasure Coding vs Replica

Erasure Coding vs Replica Ceph RadosGW (RGW), Ceph’s S3 Object Store, supports both Replica and Erasure Coding. Most all examples of using RGW show replicas because that’s the easiest to setup, manage and get your head around. Replicas simply means that a default of 3 means that RGW stores the original plus two more copies spread out within the cluster based on the Crush Map, Ceph’s way of calculating where to store objects.

Continue reading

Which open source software license should I use?

NB: This article is from Opensource.com. I also use Apache 2 for my projects. I’ve recently been involved in several discussions that are variations on, “Which open source or free software license should I choose for my project?” Here is my way of looking at the large and growing collection of licenses in the wild. First, let’s make sure we all understand that I Am Not A Lawyer. This is not legal advice.

Continue reading

Open Organizations

Open Organizations I have been asked recently a number of times about how best to bring teams together (not physically) and get buy-in on important projects especially when the org structure is more Matrix. Of course, there is no silver bullet to speak of in this case. Each organization has it’s own political structure that may have to be navigated which is so unfortunate because most people are not comfortable with change.

Continue reading

Rust

Rust Programming A programming language from Heaven! Unlike the language of sorcerers, Ruby, Rust is a real language that gives you all of the speed and power benefits of C/C++, functional model of some scripting languages and true safety that only Rust can provide. C/C++ and Python I cut my teeth on C and C++ many years ago. I actually won many awards for writing Best C/C++ Middleware from Database Advisor Magazine (dating myself).

Continue reading

Ceph and SMR Drives - NO

Don’t use Ceph with SMR Drives! A while back at Ceph Day in NYC I saw a representative from a drive manufacturer talk about SMR drives. SMR stands for Shingled Magnetic Recording and the analogy given was ‘think about the shingles on a house’. It sounded very interesting but they were not on the market at the time. A very active community member, Wido den Hollander, posted his findings here.

Continue reading