2019 Symposium Posters

Primary Investigator:
Saurabh Bagchi

Project Members
Naif Almakhdhub, Abraham Clements, Mathias Payer, and Saurabh Bagchi

Attacks against IoT systems are increasing at an alarming pace. Many IoT systems are and will be built using low-cost micro-controllers (IoT-uCs). Different security mechanisms have been proposed for IoT-uCs with different trade-offs. To guarantee a realistic and practical evaluation, the constrained resources of IoT-uCs require that defenses must be evaluated with respect to not only security, but to performance, memory, and energy as well. Evaluating security mechanisms for IoT-uCs is limited by the lack of realistic benchmarks or an evaluation framework. This burdens researchers with the task of developing not only the proposed defenses but applications on which to evaluate them. As a result, security evaluation for IoT-uCs is limited and ad-hoc. A sound benchmarking suite is essential to enable robust and comparable evaluations of security techniques on IoT-uCs. This paper introduces IoT2, a benchmark suite and evaluation framework to address pressing challenges and limitations for evaluating IoT-uCs security. IoT2 enables automatic evaluation of 14 metrics covering security, performance, memory usage, and energy consumption. The IoT2 benchmarks provide a curated set of five real-world IoT applications that cover both IoT-uCs with and without an OS. We demonstrate IoT2's ability by evaluating three defense mechanisms. All benchmarks and the evaluation framework will be open sourced.