Capacity Upper Bounds for Deletion-type Channels. Cheraghchi, M. Journal of the ACM, Mar, 2019. Preliminary version in Proceedings of STOC 2018.Link Paper doi abstract bibtex 28 downloads We develop a systematic approach, based on convex programming and real analysis, for obtaining upper bounds on the capacity of the binary deletion channel and, more generally, channels with i.i.d. insertions and deletions. Other than the classical deletion channel, we give a special attention to the Poisson-repeat channel introduced by Mitzenmacher and Drinea (IEEE Transactions on Information Theory, 2006). Our framework can be applied to obtain capacity upper bounds for any repetition distribution (the deletion and Poisson-repeat channels corresponding to the special cases of Bernoulli and Poisson distributions). Our techniques essentially reduce the task of proving capacity upper bounds to maximizing a univariate, real-valued, and often concave function over a bounded interval. The corresponding univariate function is carefully designed according to the underlying distribution of repetitions and the choices vary depending on the desired strength of the upper bounds as well as the desired simplicity of the function (e.g., being only efficiently computable versus having an explicit closed-form expression in terms of elementary, or common special, functions). Among our results, we show the following: 1) The capacity of the binary deletion channel with deletion probability $d$ is at most $(1-d) łog ϕ$ for $d ≥ 1/2$, and, assuming that the capacity function is convex, is at most $1-d łog(4/ϕ)$ for $d<1/2$, where $ϕ=(1+\sqrt{5})/2$ is the golden ratio. This is the first nontrivial capacity upper bound for any value of $d$ outside the limiting case $d \to 0$ that is fully explicit and proved without computer assistance. 2) We derive the first set of capacity upper bounds for the Poisson-repeat channel. Our results uncover further striking connections between this channel and the deletion channel, and suggest, somewhat counter-intuitively, that the Poisson-repeat channel is actually analytically simpler than the deletion channel and may be of key importance to a complete understanding of the deletion channel. 3) We derive several novel upper bounds on the capacity of the deletion channel. All upper bounds are maximums of efficiently computable, and concave, univariate real functions over a bounded domain. In turn, we upper bound these functions in terms of explicit elementary and standard special functions, whose maximums can be found even more efficiently (and sometimes, analytically, for example for $d=1/2$).
@ARTICLE{ref:Che19:del,
author = {Mahdi Cheraghchi},
title = {Capacity Upper Bounds for Deletion-type Channels},
year = 2019,
journal = {Journal of the {ACM}},
volume = 66,
number = 2,
month = {Mar},
articleno = 9,
numpages = 79,
note = {Preliminary version in Proceedings of {STOC 2018}.},
doi = {10.1145/3281275},
url_Link = {https://dl.acm.org/doi/10.1145/3281275},
url_Paper = {https://arxiv.org/abs/1711.01630},
abstract = {We develop a systematic approach, based on convex
programming and real analysis, for obtaining upper
bounds on the capacity of the binary deletion
channel and, more generally, channels with
i.i.d. insertions and deletions. Other than the
classical deletion channel, we give a special
attention to the Poisson-repeat channel introduced
by Mitzenmacher and Drinea (IEEE Transactions on
Information Theory, 2006). Our framework can be
applied to obtain capacity upper bounds for any
repetition distribution (the deletion and
Poisson-repeat channels corresponding to the special
cases of Bernoulli and Poisson distributions). Our
techniques essentially reduce the task of proving
capacity upper bounds to maximizing a univariate,
real-valued, and often concave function over a
bounded interval. The corresponding univariate
function is carefully designed according to the
underlying distribution of repetitions and the
choices vary depending on the desired strength of
the upper bounds as well as the desired simplicity
of the function (e.g., being only efficiently
computable versus having an explicit closed-form
expression in terms of elementary, or common
special, functions). Among our results, we show the
following: 1) The capacity of the binary deletion
channel with deletion probability $d$ is at most
$(1-d) \log \phi$ for $d \geq 1/2$, and, assuming
that the capacity function is convex, is at most
$1-d \log(4/\phi)$ for $d<1/2$, where
$\phi=(1+\sqrt{5})/2$ is the golden ratio. This is
the first nontrivial capacity upper bound for any
value of $d$ outside the limiting case $d \to 0$
that is fully explicit and proved without computer
assistance. 2) We derive the first set of capacity
upper bounds for the Poisson-repeat channel. Our
results uncover further striking connections between
this channel and the deletion channel, and suggest,
somewhat counter-intuitively, that the
Poisson-repeat channel is actually analytically
simpler than the deletion channel and may be of key
importance to a complete understanding of the
deletion channel. 3) We derive several novel upper
bounds on the capacity of the deletion channel. All
upper bounds are maximums of efficiently computable,
and concave, univariate real functions over a
bounded domain. In turn, we upper bound these
functions in terms of explicit elementary and
standard special functions, whose maximums can be
found even more efficiently (and sometimes,
analytically, for example for $d=1/2$). },
keywords = {Coding theory, Synchronization error-correcting
codes, Channel coding}
}
Downloads: 28
{"_id":"EY5hn5PXgQhTngfd7","bibbaseid":"cheraghchi-capacityupperboundsfordeletiontypechannels-2019","authorIDs":["2n8MNophuzbeevTa8","3NEcSaujokmJYSDaa","3tFWxWs2qWeYAZx9a","4QNcMTdRiWr2gs8Sk","5KoQWR3vSjnsoZNz5","5i4QHRc5LGio8Mf5u","62bYDgAFwCxaQ4Q9T","685mTysGDdQJKGxEE","6sX76eTffL7p76peN","8NLx3B3FAvaK54hSK","9NZpjMJLG7dNWroGm","9aD4MPX9ELhsyJmaR","9aFgrqcc4j28kZn8n","A9wAgP7TPK9tw28qY","BJ6h7zrsT3L89RKSg","BWL9E9QxvrST7y7ym","Cht4qGZ9eYAvPygNC","D3NMRJpac7Z2oFz7x","EiL6Xv4GTWGB97B8H","F3Y934eNyTeEJsg6E","FDEj5Zwdm28pFcAnB","FJdyLy2TL3v973ge8","GxccwstJJuJ4rg7Dq","H4D7r27RcPALT5DCs","HP7szFXWBWFXXZhdA","HRX7xsd7ZkTNvr67D","Hj3KN5PTNMST8hD3b","JEvEPvDBYNNXgGBnp","JYpde2ppjXLva6cre","KFgC2dZG7jXYAgZ3T","NRg9mmaSB55QqzNnH","NWCEkq6XqRBCiGmMe","NpGaG45evixRFDMiF","NyDiXeBc7cuxdWrqh","P6pva6vpPZCz6ndh9","Py2jfYGNZKNt7nxL6","Q6E9aDkYPcbhngLMx","QYrXKExv3BPABZGyA","QupQWsidagmv2nu8Z","SGZ2YignSm7njeTxy","SSuyWxzudqBDgAosw","THz3CmRmH3zZ9Xfud","TTEBJzPHwrY4d2Qfi","Wzr7kB4bxMDqceidA","YedfCw6zcDLoWAWFL","YtTEuSL9GJ8pkKcZw","Z3w2d32WjDczZMeGo","aduB2YE7dcNtbHnAN","c8gPvTXFPd9NazgEw","d6HAadRZAtz97Y2so","dTBDNYCcYKNNdhqaR","ezDt3Lb3Q6Sbo2rfX","fXtxgjbjZswBmF45i","ftBpmnKRHoB2muB8u","gKxHau44e8gnmxs6v","hM29eSWZbASnmDdFf","hw7Q4GHDAHkLTAyeB","i6Ns5rSW8R3ifxeHg","jJcoL4QWRkJQ59LfW","kKvRZ55rH7sfbubS2","kdfqsAMqCFDhpuW3S","koPTGcsAkwhGbkAYe","manxWg6Q3ZC5vW4JE","pwN2yYKo5DdSDaZGs","qpSgMrJ8WQNupjbXX","sD5Wq95oeSzqGF9kn","uSGLWGoXjyDyozeEy","wCcpScxkvg5RkcmWm","xKz7kx4eXbnkHeNXP","xeiij9YsbXBbMjciP","yGxZz3yuu6krMRxgK","yjJrpKY5QmDe8SXvm","zaR6PwJ7aC9xWBpiy"],"author_short":["Cheraghchi, M."],"bibdata":{"bibtype":"article","type":"article","author":[{"firstnames":["Mahdi"],"propositions":[],"lastnames":["Cheraghchi"],"suffixes":[]}],"title":"Capacity Upper Bounds for Deletion-type Channels","year":"2019","journal":"Journal of the ACM","volume":"66","number":"2","month":"Mar","articleno":"9","numpages":"79","note":"Preliminary version in Proceedings of STOC 2018.","doi":"10.1145/3281275","url_link":"https://dl.acm.org/doi/10.1145/3281275","url_paper":"https://arxiv.org/abs/1711.01630","abstract":"We develop a systematic approach, based on convex programming and real analysis, for obtaining upper bounds on the capacity of the binary deletion channel and, more generally, channels with i.i.d. insertions and deletions. Other than the classical deletion channel, we give a special attention to the Poisson-repeat channel introduced by Mitzenmacher and Drinea (IEEE Transactions on Information Theory, 2006). Our framework can be applied to obtain capacity upper bounds for any repetition distribution (the deletion and Poisson-repeat channels corresponding to the special cases of Bernoulli and Poisson distributions). Our techniques essentially reduce the task of proving capacity upper bounds to maximizing a univariate, real-valued, and often concave function over a bounded interval. The corresponding univariate function is carefully designed according to the underlying distribution of repetitions and the choices vary depending on the desired strength of the upper bounds as well as the desired simplicity of the function (e.g., being only efficiently computable versus having an explicit closed-form expression in terms of elementary, or common special, functions). Among our results, we show the following: 1) The capacity of the binary deletion channel with deletion probability $d$ is at most $(1-d) łog ϕ$ for $d ≥ 1/2$, and, assuming that the capacity function is convex, is at most $1-d łog(4/ϕ)$ for $d<1/2$, where $ϕ=(1+\\sqrt{5})/2$ is the golden ratio. This is the first nontrivial capacity upper bound for any value of $d$ outside the limiting case $d \\to 0$ that is fully explicit and proved without computer assistance. 2) We derive the first set of capacity upper bounds for the Poisson-repeat channel. Our results uncover further striking connections between this channel and the deletion channel, and suggest, somewhat counter-intuitively, that the Poisson-repeat channel is actually analytically simpler than the deletion channel and may be of key importance to a complete understanding of the deletion channel. 3) We derive several novel upper bounds on the capacity of the deletion channel. All upper bounds are maximums of efficiently computable, and concave, univariate real functions over a bounded domain. In turn, we upper bound these functions in terms of explicit elementary and standard special functions, whose maximums can be found even more efficiently (and sometimes, analytically, for example for $d=1/2$). ","keywords":"Coding theory, Synchronization error-correcting codes, Channel coding","bibtex":"@ARTICLE{ref:Che19:del,\n author =\t {Mahdi Cheraghchi},\n title =\t {Capacity Upper Bounds for Deletion-type Channels},\n year =\t 2019,\n journal =\t {Journal of the {ACM}},\n volume =\t 66,\n number =\t 2,\n month =\t {Mar},\n articleno =\t 9,\n numpages =\t 79,\n note =\t {Preliminary version in Proceedings of {STOC 2018}.},\n doi =\t\t {10.1145/3281275},\n url_Link =\t {https://dl.acm.org/doi/10.1145/3281275},\n url_Paper =\t {https://arxiv.org/abs/1711.01630},\n abstract =\t {We develop a systematic approach, based on convex\n programming and real analysis, for obtaining upper\n bounds on the capacity of the binary deletion\n channel and, more generally, channels with\n i.i.d. insertions and deletions. Other than the\n classical deletion channel, we give a special\n attention to the Poisson-repeat channel introduced\n by Mitzenmacher and Drinea (IEEE Transactions on\n Information Theory, 2006). Our framework can be\n applied to obtain capacity upper bounds for any\n repetition distribution (the deletion and\n Poisson-repeat channels corresponding to the special\n cases of Bernoulli and Poisson distributions). Our\n techniques essentially reduce the task of proving\n capacity upper bounds to maximizing a univariate,\n real-valued, and often concave function over a\n bounded interval. The corresponding univariate\n function is carefully designed according to the\n underlying distribution of repetitions and the\n choices vary depending on the desired strength of\n the upper bounds as well as the desired simplicity\n of the function (e.g., being only efficiently\n computable versus having an explicit closed-form\n expression in terms of elementary, or common\n special, functions). Among our results, we show the\n following: 1) The capacity of the binary deletion\n channel with deletion probability $d$ is at most\n $(1-d) \\log \\phi$ for $d \\geq 1/2$, and, assuming\n that the capacity function is convex, is at most\n $1-d \\log(4/\\phi)$ for $d<1/2$, where\n $\\phi=(1+\\sqrt{5})/2$ is the golden ratio. This is\n the first nontrivial capacity upper bound for any\n value of $d$ outside the limiting case $d \\to 0$\n that is fully explicit and proved without computer\n assistance. 2) We derive the first set of capacity\n upper bounds for the Poisson-repeat channel. Our\n results uncover further striking connections between\n this channel and the deletion channel, and suggest,\n somewhat counter-intuitively, that the\n Poisson-repeat channel is actually analytically\n simpler than the deletion channel and may be of key\n importance to a complete understanding of the\n deletion channel. 3) We derive several novel upper\n bounds on the capacity of the deletion channel. All\n upper bounds are maximums of efficiently computable,\n and concave, univariate real functions over a\n bounded domain. In turn, we upper bound these\n functions in terms of explicit elementary and\n standard special functions, whose maximums can be\n found even more efficiently (and sometimes,\n analytically, for example for $d=1/2$). },\n keywords =\t {Coding theory, Synchronization error-correcting\n codes, Channel coding}\n}\n\n","author_short":["Cheraghchi, M."],"key":"ref:Che19:del","id":"ref:Che19:del","bibbaseid":"cheraghchi-capacityupperboundsfordeletiontypechannels-2019","role":"author","urls":{" link":"https://dl.acm.org/doi/10.1145/3281275"," paper":"https://arxiv.org/abs/1711.01630"},"keyword":["Coding theory","Synchronization error-correcting codes","Channel coding"],"metadata":{"authorlinks":{"cheraghchi, m":"https://mahdi.ch/writings/"}},"downloads":28,"html":""},"bibtype":"article","biburl":"http://mahdi.ch/writings/cheraghchi.bib","creationDate":"2020-05-28T19:59:01.135Z","downloads":28,"keywords":["coding theory","synchronization error-correcting codes","channel coding"],"search_terms":["capacity","upper","bounds","deletion","type","channels","cheraghchi"],"title":"Capacity Upper Bounds for Deletion-type Channels","year":2019,"dataSources":["YZqdBBx6FeYmvQE6D"]}