https://dmsimard.com/categories/ceph/ Recent content in ceph on System Administration, Hosting, Cloud and technologies in between Hugo -- gohugo.io en-us Fri, 27 Mar 2015 00:00:00 +0000 https://dmsimard.com/2015/03/27/ceph-erasure-coding-overhead-in-a-nutshell/ Fri, 27 Mar 2015 00:00:00 +0000 https://dmsimard.com/2015/03/27/ceph-erasure-coding-overhead-in-a-nutshell/ Calculating the storage overhead of a replicated pool in Ceph is easy. You divide the amount of space you have by the “size” (amount of replicas) parameter of your storage pool. Let’s work with some rough numbers: 64 OSDs of 4TB each. Raw size: 64 * 4 = 256TB Size 2 : 128 / 2 = 128TB Size 3 : 128 / 3 = 85.33TB Replicated pools are expensive in terms of overhead: Size 2 provides the same resilience and overhead as RAID-1. https://dmsimard.com/2015/03/11/new-release-of-python-cephclient/ Wed, 11 Mar 2015 00:00:00 +0000 https://dmsimard.com/2015/03/11/new-release-of-python-cephclient/ I’ve just drafted a new release of python-cephclient on PyPi: v0.1.0.5. After learning about the ceph-rest-api I just had to do something fun with it. In fact, it’s going to become very handy for me as I might start to develop with it for things like nagios monitoring scripts. The changelog: dmsimard: Add missing dependency on the requests library Some PEP8 and code standardization cleanup Add root “PUT” methods Add mon “PUT” methods Add mds “PUT” methods Add auth “PUT” methods Donald Talton: https://dmsimard.com/2014/08/09/a-new-ceph-mirror-on-the-east-coast/ Sat, 09 Aug 2014 00:00:00 +0000 https://dmsimard.com/2014/08/09/a-new-ceph-mirror-on-the-east-coast/ I’m glad to announce that Ceph is now part of the mirrors iWeb provides. It is available in both IPv4 and IPv6 by: http on http://mirror.iweb.ca/ or directly on http://ceph.mirror.iweb.ca/ rsync on ceph.mirror.iweb.ca::ceph The mirror provides 4 Gbps of connectivity and is located on the eastern coast of Canada, more precisely in Montreal, Quebec. We feel this complements very well the principal ceph mirror at ceph. https://dmsimard.com/2014/06/21/a-use-case-of-tengine-a-drop-in-replacement-and-fork-of-nginx/ Sat, 21 Jun 2014 00:00:00 +0000 https://dmsimard.com/2014/06/21/a-use-case-of-tengine-a-drop-in-replacement-and-fork-of-nginx/ I’ve always been a fan of nginx, it was love at first sight. I tend to use nginx first and foremost as a reverse proxy server for web content and applications. This means that nginx sends your request to backend servers and forwards you their response. Some examples of backend servers I use: php5-fpm for PHP gunicorn or wsgi for Python PSGI/Plack or fastcgi for Perl Now, the cool thing is that these backend servers are good at what they do: serve code and applications written in specific languages. https://dmsimard.com/2014/05/03/inktank-redhat-to-open-source-calamari-the-ceph-web-interface/ Sat, 03 May 2014 00:00:00 +0000 https://dmsimard.com/2014/05/03/inktank-redhat-to-open-source-calamari-the-ceph-web-interface/ You might have heard this already but Redhat made an annoucement last week that they will be acquiring Inktank, the company behind Ceph. Inktank steered Ceph’s development, offered training and provided support through an entreprise package which included Calamari: a web interface to have insight on what is going on inside your cluster. You can have a peek at what Calamari looks like here - in a session from Portland’s Openstack Summit. https://dmsimard.com/2014/03/15/openstack-swift-ceph-openstack-montreal/ Sat, 15 Mar 2014 00:00:00 +0000 https://dmsimard.com/2014/03/15/openstack-swift-ceph-openstack-montreal/ The second meetup of Openstack Montreal, in collaboration with iWeb, Enovance and Savoir-faire Linux, will happen at the Université du Québec à Montréal (UQAM) monday march 17th. It’s with great pleasure that I accepted an invitation from my colleague Rafael Rosa (@rafaelrosafu) to talk about Ceph in the context of Openstack. Our friends at Enovance will be talking about Swift, the object storage project in Openstack. Should definitely be fun, it will in fact be my first public speech ever :D https://dmsimard.com/2014/01/18/python-cephclient-now-on-pypi/ Sat, 18 Jan 2014 00:00:00 +0000 https://dmsimard.com/2014/01/18/python-cephclient-now-on-pypi/ Back on January 1st, I wrote about my initiative regarding a client for the Ceph REST API made in python. I’m glad to announce that the client is now available on PyPi and I have just drafted the second release: v0.1.0.2. Check it out and let me know what you think ! https://dmsimard.com/2014/01/01/a-python-client-for-ceph-rest-api/ Wed, 01 Jan 2014 00:00:00 +0000 https://dmsimard.com/2014/01/01/a-python-client-for-ceph-rest-api/ After learning there was an API for Ceph, it was clear to me that I was going to write a client to wrap around it and use it for various purposes. It is still a work in progress and I feel it is not complete and clean enough to publish on pypi yet but I invite you to take a look and tell me what you think ! The client is available on Github under the Apache v2 license here: https://github. https://dmsimard.com/2014/01/01/documentation-for-ceph-rest-api/ Wed, 01 Jan 2014 00:00:00 +0000 https://dmsimard.com/2014/01/01/documentation-for-ceph-rest-api/ I learned that there was a Ceph REST API and I experimented with it a bit. I said the documentation was lacking and I take that back, I didn’t catch on that the API documentation was built into the application. I opened a pull request to make the documentation a bit more explicit about that: https://github.com/ceph/ceph/pull/1026 Here’s what the API documentation currently looks like: Enjoy ! https://dmsimard.com/2013/12/21/experimenting-with-the-ceph-rest-api/ Sat, 21 Dec 2013 00:00:00 +0000 https://dmsimard.com/2013/12/21/experimenting-with-the-ceph-rest-api/ Like I mentioned in my previous post, Ceph has a REST API now. That opens a lot of possibilities. The Ceph REST API is a WSGI application and it listens on port 5000 by default. This means you can query it directly but you probably want to put a webserver/proxy such a Apache or nginx in front of it. For high availability, you could run ceph-rest-api on several servers and have redundant load balancers pointing to the API endpoints. https://dmsimard.com/2013/12/06/ceph-has-a-rest-api/ Fri, 06 Dec 2013 00:00:00 +0000 https://dmsimard.com/2013/12/06/ceph-has-a-rest-api/ Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. It’s a technology I’ve been following and working with for the past couple months, especially around deploying it with puppet, I really have a feeling it is going to revolutionize the world of storage. I just realized Ceph has a REST API since the Dumpling (0.67) release. This API essentially wraps around the command line tools allowing you to monitor and manage your cluster.