FOSDEM is the biggest free and non-commercial event organized by and for the community. Its goal is to provide Free and Open Source developers a place to meet. No registration necessary.

   
Speakers
Muharem Hrnjadovic
Schedule
Day Sunday
Room Ferrer
Capacity 288
Start time 11:40
End time 11:55
Duration 00:15
Info
Track Lightning Talks
Attachments
Scaling up OpenQuake (slides)

How we scaled up OpenQuake

Partitioning and executing seismic calculation in a compute network

Topics: partitioning of large calculations, computation networks, python, celery, rabbitmq, redis

The open source OpenQuake seismic calculation engine (http://openquake.org/) is developed and maintained by the GEM foundation (http://www.globalquakemodel.org/) which is a public-private partnership that drives a collaborative effort aimed at developing and deploying tools and resources for earthquake risk assessment worldwide.

Seismic hazard calculations can be massive making it necessary to partition and distribute them across a compute network. The OpenQuake engine (http://openquake.org/) partitions seismic calculation and uses

  • celery
  • rabbitmq
  • redis

to push the tasks into the compute network and to collect the results.

There were a number of lessons learned while scaling up OpenQuake to perform seismic calculation for the whole of Europe and I will touch upon the most important ones.

Links:

Concurrent events:

When Event Track Where
10:00-12:00 OpenSC codesprint Security H.2214
10:30-12:15 LPI Exam Session 3 Certification Guillissen
11:00-11:45 Being a good upstream - the syslog-ng PoV CrossDistribution H.1302
11:00-11:45 Towards a BSD C++11 Stack BSD K.4.201
11:00-11:45 Practical implementation of promise theory in CFEngine Configuration and Systems Management K.3.601
11:00-11:50 Caching and Tuning fun for high scalability System Janson
11:00-11:50 Internet of Threads Network and IO K.1.105
11:00-12:00 Aseba robot programming Embedded Lameere
11:00-12:00 Amber, the Smalltalk for web developers Smalltalk AW1.126
11:00-17:00 LPI Item Writing Workshop Certification UA2.114
11:05-11:45 Perlito Perl AW1.121
11:10-11:55 Birds of a feather - Graph processing, future trends! Graph Processing AW1.125
11:10-11:55 Introduction to HelenOS Microkernel OS K.3.201
11:15-11:55 From zero to VoIP provider in 15 minutes Telephony and Communications H.2213
11:30-11:55 oVirt Engine Core: Internals and Infrastructure Virtualization and Cloud Chavanne
11:30-11:55 Build simple and complex replication clusters with Tungsten Replicator MySQL and Friends H.1309
11:30-12:00 Introducing the Metrics Data Ping Mozilla UD2.218A
11:30-12:00 Wayland Q & A for toolkit developers. X.org+OpenICC K.3.401
11:30-12:00 Can I legally do that? Free Java K.4.401
11:30-12:30 Working with contributor communities (round table) CrossDistribution H.1301
11:40-12:30 qt-project.org and Qt 5 CrossDesktop H.1308
11:45-12:30 Integrating LLVM into FreeBSD BSD K.4.201
11:45-12:30 The Dynamic Data Driven Worlds of WorldForge Open Source Game Development AW1.120

Next (up to 3) talks in the same room (Ferrer):

When Event Track
12:00-12:05 OpenPGP keysigning Certification
12:05-14:00 CAcert Assurance Party CAcert
14:00-14:15 EPFSUG - everybody needs a hacker! Lightning Talks