How (not) to Use Welch’s T-test in Side-Channel Security Evaluations

Standaert, François-Xavier
(2019) 17th International Conference on Smart Card Research and Advanced Applications (CARDIS 2018) — Location: Montpellier (France) (12.November.2018)

Files

HownottoUseWelchsT-testinSide-ChannelSecurityEvaluations.pdf
  • Open Access
  • Adobe PDF
  • 397.66 KB
Download

Details

Authors
Abstract
The Test Vector Leakage Assessment (TVLA) methodology is a qualitative tool relying on Welch’s T-test to assess the security of cryptographic implementations against side-channel attacks. Despite known limitations (e.g., risks of false negatives and positives), it is sometimes considered as a pass-fail test to determine whether such implementations are “safe” or not (without clear definition of what is “safe”). In this note, we clarify the limited quantitative meaning of this test when used as a standalone tool. For this purpose, we first show that the straightforward application of this approach to assess the security of a masked implementation is not sufficient. More precisely, we show that even in a simple (more precisely, univariate) case study that seems best suited for the TVLA methodology, detection (or lack thereof) with Welch’s T-test can be totally disconnected from the actual security level of an implementation. For this purpose, we put forward the case of a realistic masking scheme that looks very safe from the TVLA pointof-view and is nevertheless easy to break. We then discuss this result in more general terms and argue that this limitation is shared by all “moment-based” security evaluations. We conclude the note positively, by describing how to use moment-based analyses as a useful ingredient of side-channel security evaluations, to determine a “security order”.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Standaert, F.-X. (2019). How (not) to Use Welch’s T-test in Side-Channel Security Evaluations. Proceedings of the 17th International Conference on Smart Card Research and Advanced Applications (CARDIS 2018). Published. 17th International Conference on Smart Card Research and Advanced Applications (CARDIS 2018), Montpellier (France). https://doi.org/10.1007/978-3-030-15462-2_5