{rfName}
Al

Analysis of institutional authors

Gracia-Moran, JoaquinCorresponding AuthorRuiz, Juan CarlosAuthorDe Andres, DavidAuthorSaiz-Adalid, Luis-JAuthor

Share

May 1, 2025
Publications
>
Proceedings Paper
No

Allocating ECC parity bits into BF16-encoded CNN parameters: A practical experience report

Publicated to: 75-80 - 2024-01-01 (), DOI: 10.1145/3697090.3697092

Authors:

Gracia-Moran, J; Ruiz, JC; de Andres, D; Saiz-Adalid, LJ
[+]

Affiliations

Univ Politecn Valencia, Inst ITACA, Valencia, Spain - Author
Univ Politecn Valencia, Valencia, Spain - Author

Abstract

Using low-precision data types, like the Brain Floating Point 16 (BF16) format, can reduce Convolutional Neural Networks (CNNs) memory usage in edge devices without significantly affecting their accuracy. Adding in-parameter zero-space Error Correction Codes (ECCs) can enhance the robustness of BF16-based CNNs. However, implementing this technique raises practical questions. For instance, when the available invariant1 and non-significant2 bits in parameters for error correction are sufficient for the required protection level, the proper selection and combination of these bits become crucial. On the other hand, if the set of available bits is inadequate, converting nearly invariant bits to invariants might be considered. These decisions impact ECC decoder complexity and may affect the overall CNN performance. This report examines such implications using Lenet-5 and GoogLenet as case studies.
[+]

Keywords

Bf16Convolutional neural networkError correction codes

Quality index

Leadership analysis of institutional authors

There is a significant leadership presence as some of the institution’s authors appear as the first or last signer, detailed as follows: First Author (Gracia Morán, Joaquín) and Last Author (Saiz Adalid, Luis Jose).

the author responsible for correspondence tasks has been Gracia Morán, Joaquín.

[+]

Awards linked to the item

DEFADAS project, Grant PID2020-120271RB-I00, funded by MCIN/AEI/10.13039/501100011033
[+]