RestFS: the Next Generation Cloud Storage
- Track: HPC and computational science devroom
- Room: AW1.126
- Day: Saturday
- Start: 14:05
- End: 14:25
RestFS is an experimental project to develop an open-source distributed filesystem for large environments. It is designed to scale up from a single server to thousand of nodes and delivering a high-availability storage system with special features for high i/o performance and network optimisation for work better in WAN environment. The Project is on the beginning stage, with some technology previews released.
The Restfs is pure-python, but several of the libraries that it depends upon use C extensions (sometimes for speed, sometimes to interface to pre-existing C libraries). The main characteristics of the RestFS are :
- Scalability, no limits on storage and clients size
- High availability, no single point of failure and data replication
- Adaptive, load balancing and uniform distribution
- High Performance, parallel transfer, local cache consistency , data transfer by difference
- Flexible, S3 compatibility interface, dedicated library for integration in web server and application layer
This talk describes the architecture, internals of RestFS and comparison among different free software solutions. The session will discuss our experience in this development and detailed information on performance and scalability
Speakers
Fabrizio Manfredi |