Generator matrix

In coding theory, a generator matrix is a matrix whose rows form a basis for a linear code. The codewords are all of the linear combinations of the rows of this matrix, that is, the linear code is the row space of its generator matrix.

Terminology

If G is a matrix, it generates the codewords of a linear code C by

w=sG

where w is a codeword of the linear code C, and s is any input vector. Both w and s are assumed to be row vectors.^[1] A generator matrix for a linear $[n,k,d]_{q}$ -code has format $k\times n$ , where n is the length of a codeword, k is the number of information bits (the dimension of C as a vector subspace), d is the minimum distance of the code, and q is size of the finite field, that is, the number of symbols in the alphabet (thus, q = 2 indicates a binary code, etc.). The number of redundant bits is denoted by $r=n-k$ .

The standard form for a generator matrix is,^[2]

G={\begin{bmatrix}I_{k}|P\end{bmatrix}}

,

where $I_{k}$ is the $k\times k$ identity matrix and P is a $k\times (n-k)$ matrix. When the generator matrix is in standard form, the code C is systematic in its first k coordinate positions.^[3]

A generator matrix can be used to construct the parity check matrix for a code (and vice versa). If the generator matrix G is in standard form, $G={\begin{bmatrix}I_{k}|P\end{bmatrix}}$ , then the parity check matrix for C is^[4]

H={\begin{bmatrix}-P^{\top }|I_{n-k}\end{bmatrix}}

,

where $P^{\top }$ is the transpose of the matrix $P$ . This is a consequence of the fact that a parity check matrix of $C$ is a generator matrix of the dual code $C^{\perp }$ .

G is a $k\times n$ matrix, while H is a $(n-k)\times n$ matrix.

Equivalent codes

Codes C₁ and C₂ are equivalent (denoted C₁ ~ C₂) if one code can be obtained from the other via the following two transformations:^[5]

arbitrarily permute the components, and
independently scale by a non-zero element any components.

Equivalent codes have the same minimum distance.

The generator matrices of equivalent codes can be obtained from one another via the following elementary operations:^[6]

permute rows
scale rows by a nonzero scalar
add rows to other rows
permute columns, and
scale columns by a nonzero scalar.

Thus, we can perform Gaussian elimination on G. Indeed, this allows us to assume that the generator matrix is in the standard form. More precisely, for any matrix G we can find an invertible matrix U such that $UG={\begin{bmatrix}I_{k}|P\end{bmatrix}}$ , where G and ${\begin{bmatrix}I_{k}|P\end{bmatrix}}$ generate equivalent codes.

Notes

^ MacKay, David, J.C. (2003). Information Theory, Inference, and Learning Algorithms (PDF). Cambridge University Press. p. 9. ISBN 9780521642989. Because the Hamming code is a linear code, it can be written compactly in terms of matrices as follows. The transmitted codeword $\mathbf {t}$ is obtained from the source sequence $\mathbf {s}$ by a linear operation,
$\mathbf {t} =\mathbf {G} ^{\intercal }\mathbf {s}$
where $\mathbf {G}$ is the generator matrix of the code... I have assumed that $\mathbf {s}$ and $\mathbf {t}$ are column vectors. If instead they are row vectors, then this equation is replaced by
$\mathbf {t} =\mathbf {sG}$
... I find it easier to relate to the right-multiplication (...) than the left-multiplication (...). Many coding theory texts use the left-multiplying conventions (...), however. ...The rows of the generator matrix can be viewed as defining the basis vectors.{{cite book}}: CS1 maint: multiple names: authors list (link)
^ Ling & Xing 2004, p. 52
^ Roman 1992, p. 198
^ Roman 1992, p. 200
^ Pless 1998, p. 8
^ Welsh 1988, pp. 54-55

References

Ling, San; Xing, Chaoping (2004), Coding Theory / A First Course, Cambridge University Press, ISBN 0-521-52923-9
Pless, Vera (1998), Introduction to the Theory of Error-Correcting Codes (3rd ed.), Wiley Interscience, ISBN 0-471-19047-0
Roman, Steven (1992), Coding and Information Theory, GTM, vol. 134, Springer-Verlag, ISBN 0-387-97812-7
Welsh, Dominic (1988), Codes and Cryptography, Oxford University Press, ISBN 0-19-853287-3

External links

Generator Matrix at MathWorld

[DrMacKayECC-1] MacKay, David, J.C. (2003). Information Theory, Inference, and Learning Algorithms (PDF). Cambridge University Press. p. 9. ISBN 9780521642989. Because the Hamming code is a linear code, it can be written compactly in terms of matrices as follows. The transmitted codeword $\mathbf {t}$ is obtained from the source sequence $\mathbf {s}$ by a linear operation,
$\mathbf {t} =\mathbf {G} ^{\intercal }\mathbf {s}$
where $\mathbf {G}$ is the generator matrix of the code... I have assumed that $\mathbf {s}$ and $\mathbf {t}$ are column vectors. If instead they are row vectors, then this equation is replaced by
$\mathbf {t} =\mathbf {sG}$
... I find it easier to relate to the right-multiplication (...) than the left-multiplication (...). Many coding theory texts use the left-multiplying conventions (...), however. ...The rows of the generator matrix can be viewed as defining the basis vectors.{{cite book}}: CS1 maint: multiple names: authors list (link)

[2] Ling & Xing 2004, p. 52

[3] Roman 1992, p. 198

[4] Roman 1992, p. 200

[5] Pless 1998, p. 8

[6] Welsh 1988, pp. 54-55

[1]

[2]

[3]

[4]

[5]

[6]

v t e Matrix classes
Explicitly constrained entries	Alternant Anti-diagonal Anti-Hermitian Anti-symmetric Arrowhead Band Bidiagonal Bisymmetric Block-diagonal Block Block tridiagonal Boolean Cauchy Centrosymmetric Conference Complex Hadamard Copositive Diagonally dominant Diagonal Discrete Fourier Transform Elementary Equivalent Frobenius Generalized permutation Hadamard Hankel Hermitian Hessenberg Hollow Integer Logical Matrix unit Metzler Moore Nonnegative Pentadiagonal Permutation Persymmetric Polynomial Quaternionic Signature Skew-Hermitian Skew-symmetric Skyline Sparse Sylvester Symmetric Toeplitz Triangular Tridiagonal Vandermonde Walsh Z
Constant	Exchange Hilbert Identity Lehmer Of ones Pascal Pauli Redheffer Shift Zero
Conditions on eigenvalues or eigenvectors	Companion Convergent Defective Definite Diagonalizable Hurwitz Positive-definite Stieltjes
Satisfying conditions on products or inverses	Congruent Idempotent or Projection Invertible Involutory Nilpotent Normal Orthogonal Unimodular Unipotent Unitary Totally unimodular Weighing
With specific applications	Adjugate Alternating sign Augmented Bézout Carleman Cartan Circulant Cofactor Commutation Confusion Coxeter Distance Duplication and elimination Euclidean distance Fundamental (linear differential equation) Generator Gram Hessian Householder Jacobian Moment Payoff Pick Random Rotation Seifert Shear Similarity Symplectic Totally positive Transformation
Used in statistics	Centering Correlation Covariance Design Doubly stochastic Fisher information Hat Precision Stochastic Transition
Used in graph theory	Adjacency Biadjacency Degree Edmonds Incidence Laplacian Seidel adjacency Tutte
Used in science and engineering	Cabibbo–Kobayashi–Maskawa Density Fundamental (computer vision) Fuzzy associative Gamma Gell-Mann Hamiltonian Irregular Overlap S State transition Substitution Z (chemistry)
Related terms	Jordan normal form Linear independence Matrix exponential Matrix representation of conic sections Perfect matrix Pseudoinverse Row echelon form Wronskian
Mathematics portal List of matrices Category:Matrices

Generator matrix

Terminology

Equivalent codes

See also

Notes

References

Further reading

External links

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.