In case you were wondering why there were so few posts on this blog in the past weeks: since we’ve set up a dedicated blog for openATTIC, a lot of my recent blogging activity has taken place there. You can find all my posts using the Posts by Lenz Grimmer view.
Tagged: storage Toggle Comment Threads | Keyboard Shortcuts
Back in September, I attended the Kieler Linux Tage, to talk (in German) about how to manage storage on Linux using openATTIC.
The presentation was recorded and the final result (in 4K) can now be viewed on YouTube. I hope you enjoy it!
Last week, 13. Kieler Open Source und Linux Tage (KieLux) in Kiel, Germany, to give a presentation (in German) about “ . I had an audience of ~25-30 people, a video recording of the session (in 4K!) will be published shortly. I had a great time at KieLux and learned a lot in the other sessions I attended. It was also nice meeting new people and touching base with long-time acquaintances again. Thanks to the KieLux organizers for arranging this event and for inviting me!
My slide deck is now available from SlideShare. Enjoy!
Last weekend, I gave a presentation titled “The Evolution of Storage on Linux” at this year’s FrOSCon 10 conference (Happy Anniversary!). In case you have missed it, you can find the slides and video recording below. Thanks to the FrOSCon team for having me, it’s always a pleasure to be there!
Unfortunately I had some technical issues in the beginning and was somewhat too ambitious with regards to the topics I wanted to cover, so I ran out of time. There is simply too much cool stuff happening in the storage space – but I hope that the audience still enjoyed it!
Today, I’ve started a new chapter in my career: I’ve left TeamDrive Systems after 1.5 years and joined it-novum in Fulda, where I will be responsible for their open source storage solution openATTIC as a Senior Product Manager in their infrastructure group.
While virtualization makes it pretty easy to spawn up new VMs quickly (e.g. for load balancing purposes), I always felt that providing concurrent file-based access to the same data to these VMs has been somewhat cumbersome, even though it’s still a requirement for many applications that need to share data between parts of the application, or multiple instances thereof.
If you didn’t have some kind of SAN/NAS solution in your data center, it usually involved
quirks creative solutions on the VM side (e.g. setting up a VM instance that acted as a central file service via NFS/SMB, or using a shared disk file system like GFS2 or OCFS2). But even if you did, the underlying virtualization technology did not provide any integration or API-based approach to this (at least that was my impression).
I recently stumbled over Amazon’s Elastic File System (EFS), which was announced on April 9th, 2015. EFS provides shared storage as a service (STaaS) via the NFSv4 protocol. This makes it pretty easy to mount the same share on multiple (Linux-based) VMs. Amazon only charges you for the storage that you actually use (billed monthly, based on the average used during the month), and the use of SSDs should make sure that latency (IOPS) does not suck too badly.
Interestingly, Microsoft has been offering something similar for almost a year now: Azure File Service was announced on May 12th, 2014 already. It provides shared access to files via the SMB protocol (which makes it suitable for both Windows and Linux-based VMs). In addition to that, Azure File Service also provides a REST API to access and manage objects stored on this service, which makes this service more versatile/flexible. Similar to Amazon, Microsoft only charges for the disk space you actually use.
Note that both EFS and Azure File Service are still labeled as “Preview” at the time of writing and have certain limitations you should be aware of (Unsupported NFSv4.0 Features in EFS, Amazon EFS Limits During Preview, Features Not Supported By the Azure File Service) – so make sure to have backups of any data you store on them 🙂
The Open Source community has noticed the requirement for shared file access, too – Red Hat recently announced their participation in OpenStack’s Manila project, which provides a shared file service for this emerging cloud technology. From what I can tell, Manila’s focus currently is more on providing shared storage for OpenStack compute nodes, it’s not entirely clear to me yet if there are any plans to establish this as a solution to provide shared file systems to virtual machines as well (in addition to the object and block storage capabilities they already offer).