BEGIN:VCALENDAR VERSION:2.0 PRODID:-//Pentabarf//Schedule 0.3//EN CALSCALE:GREGORIAN METHOD:PUBLISH X-WR-CALDESC;VALUE=TEXT:Testing and Automation devroom X-WR-CALNAME;VALUE=TEXT:Testing and Automation devroom X-WR-TIMEZONE;VALUE=TEXT:Europe/Brussels BEGIN:VEVENT METHOD:PUBLISH UID:12359@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T100000 DTEND:20220205T101000 SUMMARY:Welcome to Testing and Automation devroom DESCRIPTION:
A warm welcome from your devroom managers, practical information, lineup and administrivia. Happy Testing!
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/welcome/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Alexander Todorov":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Cyril Hrubis":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Anders Roxell":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Zaklina Stojnev":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12377@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T101500 DTEND:20220205T110500 SUMMARY:Automating Code Review with Sparse DESCRIPTION:How we use the Sparse C Abstract Syntax Tree and linearized Intermediate Representation to write custom checks for the Linux Test Project API.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/custom_c_static_analysis_with_sparse/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Richard Palethorpe":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12593@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T112000 DTEND:20220205T115500 SUMMARY:Unit testing Linux kernel drivers DESCRIPTION:The technical presentation is about how to use mocks to unit test Linux kernel drivers. The presentation explains how mocks help validating operational code. For instance by checking parameters passed to mocked function, or by configuring the mock to return an error code.
The presentation will include some unit test examples that use a mocking tool which is called EasyMock. I'm the author of EasyMock.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/unit_testing_linux_drivers/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Laurent Carlier":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12661@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T120000 DTEND:20220205T124000 SUMMARY:Continuous testing in a cloud based infrastructure using virtualization and real hardware in the loop DESCRIPTION:The concerns about code complexity, cybersecurity and LTS have made a continuous testing infrastructure a must have.
The tests must take place both in virtual and real target. Virtual target because developers never get enough physical boards to test from, and real in order to limit virtualization/reality deviation.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/continuous_testing_in_cloud/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Armand Bénéteau":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12821@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T140000 DTEND:20220205T144000 SUMMARY:Frisbee: An advanced suite for the automated testing of cloud apps over Kubernetes DESCRIPTION:As distributed systems evolve, the testing scale multiplies, asking for dozens of test cases, combined with different application benchmarks (e.g., performance, correctness), and arbitrary operating conditions. Kubernetes holds a promise to enable automation and process improvement directly contributing to a system's reliability. Establishing a declarative API and providing a cheap and disposable environment, Kubernetes makes it easy to create uniform experiments, which may run manually or be exercised multiple times over the development cycle through a CI/CD system. Despite their abundance, existing benchmarks and Chaos engineering tools work in isolation, thus restricting the complexity of testing scenarios we can build.
This talk will present Frisbee: an automated suite for the unified testing of distributed applications over Kubernetes. Frisbee simplifies a series of time-demanding activities, including the spin-up of the dependency stack required to bring the system into a steady state, the combined execution of workloads and faultloads, and the validation of the system's behavior via test cases. We will demonstrate Frisbee through a series of tests, focusing on uncertainties at the level of application (e.g., dynamically changing request patterns), infrastructure (e.g., crashes, network partitions), and deployment (e.g., saturation points).
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/frisbee/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Fotis Nikolaidis":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12666@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T144500 DTEND:20220205T153000 SUMMARY: LAVA + OpenQA = Automated, Continuous Full System Testing DESCRIPTION:Maintaining software systems for a long time is hard. Backporting kernel patches is a complex and expensive overhead. The Linux project's position is - quite rightly - to instruct down-streams to upgrade to the latest release.
In practice, upgrading is difficult, scary and sometimes avoided. It takes time and effort before there is enough confidence that new releases will work in context: full system testing in embedded environments can be arduous. What if we could have continuous, automated full system tests, from from UI, to OS, to kernel, on hardware?
This talk will provide an overview of how this can be achieved with a combination of OpenQA, LAVA and Continuous Integration pipelines. The talk will cover:- How the same tests can be used in both kernel space and user space testing- How the same tests can run in both virtualisation (with OpenQA and QEMU, developed originally for GNOME-OS) and also on hardware- How images are then deployed and tested in hardware (LAVA triggers OpenQA via VNC to begin testing on boards)
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/lava_openqa/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="James Thomas":invalid:nomail ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Laurence Urhegyi":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:13064@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T154500 DTEND:20220205T155500 SUMMARY:Oniro CI/Testing integration with LAVA DESCRIPTION:In this session we introduce and explain the integration between LAVA (Linaro Automated Validation Architecture) and GitLab as part of the testing efforts in the Oniro OS from Eclipse foundation. The session will cover brief introductions to LAVA and Oniro, integration with GitLab and also present on how we provide vendors the opportunity to test the full software stack on the live devices in-house in completely integrated manner with the main lab and have the test results available for reporting in the upstream gitlab instance.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/oniro_ci_with_lava/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Stevan Radaković":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12899@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T160000 DTEND:20220205T161500 SUMMARY:How (not) to make a mockery of trust DESCRIPTION:The ever-continuing push for digitalisation has increased our reliance on trust services of various kinds, filling various needs relating to document signing, code signing, authorization tokens, and so forth.Many of these trust services rely on public-key infrastructure (PKI) and X.509 certificates.
The sensitive nature of these tools makes them difficult to use in a testing environment. On the one hand, exposing access to production keys in your CI is obviously a terrible idea. But on the other hand, setting up and maintaining a fully functional "mock" PKI environment is also pretty tricky. What can you do about that?
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/mockery_of_trust/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Matthias Valvekens":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12454@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T162000 DTEND:20220205T163500 SUMMARY:Fuzzing, or How I Generated 1,000,000 New Emulator Test Cases in an Afternoon DESCRIPTION:Emulation of classic hardware is a solved problem and like all solved problems that are sufficiently fun it attracts countless new implementations every year. This has led to the creation of many public test suites — test suites independent of any particular emulator, which can usually even run on real hardware. But these suites tend to assume a lot of working functionality beyond the part they are specifically testing, being designed by an intelligent human being to test complete emulators holistically.
This presentation covers an alternative source and target of emulator tests: random numbers, to test individual processor instructions, so that future emulator authors can test from day one.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/1000000_test_cases/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Thomas Harte":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12978@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T164000 DTEND:20220205T164500 SUMMARY:History of Testing DESCRIPTION:As a side project the Kiwi TCMS team has started collecting facts about people who've made important contributions to the testing field. We're calling upon other testers for ideas and contributions.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/history_of_testing/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Alexander Todorov":invalid:nomail END:VEVENT BEGIN:VEVENT METHOD:PUBLISH UID:12371@FOSDEM22@fosdem.org TZID:Europe-Brussels DTSTART:20220205T165000 DTEND:20220205T175000 SUMMARY:5 OpenSource Test Automation tools in 45 minutes! DESCRIPTION:5 OpenSource Test Automation tools in 45 minutes! You will be left with a general oversight of various well known OpenSource Test Automation tools which are applicable in a large (or smaller) companies or OSS projects. With a working example demo where you see it in action. The talk will also score these tools (subjectively) among each other (installation, ease of use, stability, speed, etc) and provide insights on how to get started. When to use it, and when not to use it.
CLASS:PUBLIC STATUS:CONFIRMED CATEGORIES:Testing and Automation URL:https:/fosdem.org/2022/schedule/2022/schedule/event/10_oss_test_automation_tools/ LOCATION:D.testing ATTENDEE;ROLE=REQ-PARTICIPANT;CUTYPE=INDIVIDUAL;CN="Eric de Graaf":invalid:nomail END:VEVENT END:VCALENDAR