Let us try to understand the formula for Channel Capacity with an Average Power Limitation, described in Section 25 of the landmark paper A Mathematical Theory for Communication, by Mr. Claude Shannon. Further, the following writeup is based on Section 12.5.1 from Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi
In this post, let us try to derive the symbol error rate for 16-PSK (16-Phase Shift Keying) modulation. Consider a general M-PSK modulation, where the alphabets, are used. (Refer example 5-38 in [DIG-COMM-BARRY-LEE-MESSERSCHMITT]) Figure: 16-PSK constellation plot
In an earlier post, it was mentioned that delta modulator without the quantizer is identical to convolving an input sequence with . Let us first try to validate that thought using a small MATLAB example and using the delta modulator circuit shown in Figure 9.13a of DSP-Proakis [1]. % delta modulation xn = sin(2*pi*1/64*[0:63]); xhatn…
For curve fitting using linear regression, there exists a minor variant of Batch Gradient Descent algorithm, called Stochastic Gradient Descent. In the Batch Gradient Descent, the parameter vector is updated as, . (loop over all elements of training set in one iteration) For Stochastic Gradient Descent, the vector gets updated as, at each iteration the…
Question 47 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q47. Given that and , the value of is (A) (B) (C) (D) Solution To answer this question, we need to refer to Cayley Hamilton Theorem. This is discussed briefly in Pages 310-311 of Introduction to Linear Algebra, Glibert Strang (buy…
Following the discussion on thermal noise and it’s modeling and noise figure computation for a simple resistor network, in this article let us discuss the Noise Figure of cascaded stages.
In a previous post (here), we discussed in brief, Orthogonal Frequency Division Multiplexing (OFDM) transmission. Let us know probe bit more into the motivation of cyclic prefix (aka guard interval) associated with each OFDM symbol. What is cyclic prefix? Let us consider one subcarrier (subcarrier +1 specified in IEEE 802.11a specification) alone. In the figure…
Long back in time we discussed the BER (bit error rate) for BPSK modulation in a simple AWGN channel (time stamps states August 2007). Almost an year back! It high time we discuss the BER for BPSK in a Rayleigh multipath channel. In a brief discussion on Rayleigh channel, wherein we stated that a circularly…
Hi, Those visiting the blog might have noticed a fresh look to the dspLog. This new feel is thanks to the Thesis Magazine Skin provided by FourBlogger Skins. Click here to view more details. There some more tinkering required at some places. But, in general most of the settings are taken care. Hope you like…
Question 52 on communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q2. The power spectral density of a real process for positive frequencies is shown below. The values of and , respectively are (A) (B) (C) (D) Solution For a wide sense stationary function, the auto-correlation with delay is defined as,…
In problem 4.37 of DSP-Proakis [1], the task is to analyze the total harmonic distortion in quantized sinusoidal, where .
On July30th, 2008 I had sent a request for feedback to 93 subscribers who have opted to receive articles over email. As on 3rd August, I received the response from around 8 persons. Not bad, around 8.5% response. Thanks a lot for the feedback. I will summarize the response from the group and note down…
The post covers various neural network based word embedding models. Starting from the Neural Probabilistic Language Model from Bengio et al 2003, then reduction of complexity using Hierarchical softmax and Noise Contrastive Estimation. Further works like CBoW, GlOVe, Skip Gram and Negative Sampling which helped to train on much higher data.
Following a brief discussion with my friend Mr. Rethnakaran Pulikkoonattu on phase noise profiles, he pointed me to his write up on Oscillator Phase Noise and Sampling Clock Jitter . In this post, we will discuss the math behind integrating the phase noise power spectral density (in dBc/Hz) to find the root mean square jitter value.