MATM FINALS: CODING THEORY AND MODULAR ARITHMETIC Flashcards
____________-is the study of the properties ofcodesand their respective fitness for specific applications. Codes are used fordata compression,cryptography,error detection and correction,data transmissionanddata storage.
Coding theory
__________ are studied by various scientific disciplines, such asinformation theory,electrical engineering,mathematics,linguistics, andcomputer science—for the purpose of designing efficient and reliabledata transmissionmethods.
This typically involves the removal of redundancy and the correction or detection of errors in the transmitted data.
Codes
PROCESS OF CODING
SENDER > SOURCE ENCODER > COMMUNICATION CHANNEL > SOURCE DECODER > RECEIVER
Is the physical medium through which information is transmitted.
Ex: telephone lines, internet cables, fiber-optic lines, and air. Some storage data can be considered channels (CD-ROMS, hard drives).
Communication Channel
It alters the message in the channel that will cause disruption and error in the messages.
Noises
In transmitting messages, coding is defined as source coding and channel coding.
Source Coding and Channel Coding
Two Processes in Coding
__________ - is transforming messaged into bits of message that is Suitable in communication.
___________ - is the opposite process of encoding.
Encoding
Decoding
is defined as converting the message from the sender into bits suitable to the communication channel.
DATA COMPRESSION OR SOURCE ENCODING
_______________- is the smallest unit of measurement used to quantify computer data. It contains a single binary value of 0 or 1.
An example of this is the ASCII (AMERICAN STANDARD CODE) that converts each character int the message to a byte of 8 bits.
bit(short for “binary digit”)
a____- is a unit of data that is eight binary digits long.
is the unit most computers use to represent a character such as a letter, number or typographic symbol.
byte
With this problem at hand, additional process of encoding is required known as _______________
Is defined as adding some form of redundancy to the source encoded message so that the errors can be detected or even corrected.
Channel Coding.
is also called as “Vertical Redundancy Check (VRC)”
Where in single bit is added to the message as redundancy bit.
The goal in doing parity check is to end up with an even parity.
A bit string is said to have an________ if there is an odd number of 1s.
Even parity if there is an even number of 1s. We add redundancy bit to message such that it will become an ___________.
Parity Check
odd parity
even parity
“Perform the channel encoding by adding a redundancy bit of size 3.”
it is where you repeat the very last number to the given redundancy bit + while making sure it’s even
In coding theory, therepetition codeis one of the most basic error-correctingcodes.
In order to transmit a message over a noisy channel that may corrupt the transmission in a few places, the idea of therepetition codeis to just repeat the message several times.
Suppose that the source encoding is already done and that the encoded message is of fix length k. The channel encoding by repetition is performed by taking the k bits then repeating it 2r + 1, where r is greater than or equal to 1 is a fixed integer.
formula: 2r + 1 <— this is what you’ll use to get how many times you’ll repeat the message (input r value)
“source encoded message”
“k” is how many you’ll divide it in
(final answer is the 110110110110)
Repetition Code: ENCODING
Example: Assume that the message transmitted through a noisy channel and distorted. The received message is 111001101110010 .The channel encoding uses repetition code where k= 3. Decode the received message.
Solution: 111 001 101 110 010
First Bit - Consider the most frequent bit in positions 1,4,7,10, and 13
Second Bit – Consider the most frequent bit in positions 2,5,8,11,and 14
Third Bit – Consider the most frequents bit in positions 3, 6, 9, 12, and 15
111/001/101/110/010
1 2 3 / 4 5 6/7 8 9 /10 11 12 /13 14 15
Decoded Message : 111
do it like:
1st 2nd 3rd
1s:
0s:
then count how many
Repetition Code: DECODING