Automated Testing of Simulation Software in the Aviation Industry : An Experience Report
Garousi, Vahid ; Tasli, Seckin ; Sertel, Onur ; Tokgoz, Mustafa ; Herkiloglu, Kadir ; Arkin, Hikmet Ferda Ergunes ; Bilir, Osman - \ 2019
IEEE Software 36 (2019)4. - ISSN 0740-7459 - p. 63 - 75.
automated testing - aviation industry - simulation software - test automation
An industry-academia collaboration developed a test automation framework for aviation simulation software. The technology has been successfully deployed in several test teams.
Transitioning from Manual to Automated Software Regression Testing: Experience from the Banking Domain
Akin, Abdurrahman ; Senturk, Serafettin ; Garousi, Vahid - \ 2019
In: Proceedings - 25th Asia-Pacific Software Engineering Conference, APSEC 2018. - IEEE computer society - ISBN 9781728119700 - p. 591 - 597.
experience report - mobile software - regression testing - Software testing - test automation
Regression testing is needed when a software or the environment hosting that software changes. Motivated by a real-world industrial need in the context of a large financial (banking) corporation in Turkey, the authors and their colleagues developed and introduced an automated regression testing infrastructure for automated testing of one of the main mobile applications of the company. Before this project, regression testing was conducted manually which incurred a lot of costs and was by nature subjective. We report in this paper our experience in 'transitioning' from manual to automated regression testing, and in developing and introducing a set of large automated test suites (more than 16 KLOC in total), using best practices in state-of-the art and -practice, and to report its observed benefits by conducting cost-benefit analysis. The project was conducted based on the principles of case-study and 'action research' in which the real industrial needs drove the research. Among the best practices that we used are the followings: (1) modularity in test code, (2) creating test-specific libraries, and (3) separating test data from test logic. By serving as a success story and experience report in development and introduction of automated test suites in an industrial setting, this paper adds to the body of evidence in this area and it aims at sharing both technical (e.g., using automated test patterns) and process aspects (e.g., test process improvement) from our project with other practitioners and researchers.
What We Know About Smells in Software Test Code
Garousi, Vahid ; Kucuk, Baris ; Felderer, Michael - \ 2019
IEEE Software 36 (2019)3. - ISSN 0740-7459 - p. 61 - 73.
multivocal literature review - Software testing - systematic literature review - test anti-patterns - test automation - test scripts - test smells
As a type of anti-pattern, test smells are defined as poorly-designed tests and their presence negatively affects the quality of test suites and production code. There is a large body of knowledge on the subject of test smells. Thus, it is not practical for practitioners and researchers to synthesize and benefit from such a large literature. Motivated by the above need, we report a ‘multivocal’ literature mapping (classification) on 46 sources from the scientific literature and 120 grey literature sources. We present the largest catalogue of test smells, along with the summary of guidelines, techniques and tools to deal with test smells. This article will benefit practitioners and researchers by serving as an “index” to the vast body of knowledge in this area, and by helping them develop high-quality test scripts, and minimize occurrences of test smells and their negative consequences in test automation projects.