Information Bottleneck Theory and Applications in Deep Learning

The celebrated information bottleneck (IB) principle of Tishby et al. has recently enjoyed renewed attention due to its application in the area of deep learning. This collection investigates the IB principle in this new context. The individual chapters in this collection: • provide novel insights in...

Olles dieđut

Furkejuvvon:
Bibliográfalaš dieđut
Eará dahkkit: Geiger, Bernhard (Doaimmaheaddji), Kubin, Gernot (Doaimmaheaddji)
Materiálatiipa: Elektrovnnalaš Girjji oassi
Giella:eaŋgalasgiella
Almmustuhtton: Basel, Switzerland MDPI - Multidisciplinary Digital Publishing Institute 2021
Fáttát:
Liŋkkat:DOAB: download the publication
DOAB: description of the publication
Fáddágilkorat: Lasit fáddágilkoriid
Eai fáddágilkorat, Lasit vuosttaš fáddágilkora!
Govvádus
Čoahkkáigeassu:The celebrated information bottleneck (IB) principle of Tishby et al. has recently enjoyed renewed attention due to its application in the area of deep learning. This collection investigates the IB principle in this new context. The individual chapters in this collection: • provide novel insights into the functional properties of the IB; • discuss the IB principle (and its derivates) as an objective for training multi-layer machine learning structures such as neural networks and decision trees; and • offer a new perspective on neural network learning via the lens of the IB framework. Our collection thus contributes to a better understanding of the IB principle specifically for deep learning and, more generally, of information-theoretic cost functions in machine learning. This paves the way toward explainable artificial intelligence.
Olgguldas hápmi:1 electronic resource (274 p.)
ISBN:books978-3-0365-0803-0
9783036508023
9783036508030
Beassan:Open Access