Transfer Learning for Performance Modeling of Configurable Systems: An Exploratory Analysis
Pooyan Jamshidi
Norbert Siegmund
Miguel Velez
Christian Kästner
Akshay Patel
Proceedings of the 32Nd IEEE/ACM International Conference on Automated Software Engineering

Abstract

Buildings traditionally consist of vertically integrated subsystems installed by multiple vendors without common understanding of the entire system. It results in unstructured metadata of thousands of data points, which third part vendors who seek to deploy applications like fault diagnosis need to map into a common schema. This mapping process requires deep domain expertise in both the schema and buildings with significant man-hours. Our framework, Scrabble, significantly reduces effort of mapping multiple buildings by introducing a two-stages active learning mechanism that exploits the structure present in a standard schema, Brick, and learns from buildings that have already been mapped to the schema. Scrabble maps characters of metadata into intermediate representation (IR) using conditional random fields and then to labels with a modified classifier chain. Introducing IR enables reusing the learned model for other buildings. Our model requires minimal input from domain experts for mapping. We have evaluated Scrabble reduces 60 {\%} of samples to achieve 95{\%} accuracy covering more labels with 2.54 times higher macro F1 at compared to a baseline.

Bibtex

@inproceedings{Jamshidi:2017:TLP:3155562.3155625,
    author = {Jamshidi, Pooyan and Siegmund, Norbert and Velez, Miguel and K{\"{a}}stner, Christian and Patel, Akshay and Agarwal, Yuvraj},
    pages = "497--508",
    booktitle = "Proceedings of the 32Nd IEEE/ACM International Conference on Automated Software Engineering",
    title = "Transfer Learning for Performance Modeling of Configurable Systems: An Exploratory Analysis",
    year = "2017"
}

Plain Text

Pooyan Jamshidi, Norbert Siegmund, Miguel Velez, Christian Kästner, Akshay Patel, and Yuvraj Agarwal. Transfer learning for performance modeling of configurable systems: an exploratory analysis. In Proceedings of the 32Nd IEEE/ACM International Conference on Automated Software Engineering, 497–508. 2017.