Trying out LaTeX on Blogspot
Quick check of on Blogspot, thanks to the information provided here. Good ! It works…would like to have a better formatting though. Anyhow this will do for now.
Read More
GATE-2012 ECE Q36 (math)
Question 36 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q36. A fair coin is tossed till a head appears for the first time. The probability that the number of required tosses is odd, is (A) 1/3 (B) 1/2 (C) 2/3 (D) 3/4 Solution Let us start by…
Word Embeddings using neural networks
The post covers various neural network based word embedding models. Starting from the Neural Probabilistic Language Model from Bengio et al 2003, then reduction of complexity using Hierarchical softmax and Noise Contrastive Estimation. Further works like CBoW, GlOVe, Skip Gram and Negative Sampling which helped to train on much higher data.
Blog on DSP
I happened to visit ‘The Digital Signal Processing Blog’, maintained by Mr. Andres Kwasinski, Ph. D. In the blog one can find details about the upcoming IEEE conferences pertaining to communication and multimedia processing. Further, in some of the posts, author shares his thoughts on topics like fixed point arithmetic (here) and wavelets (here) etc….
Stochastic Gradient Descent
For curve fitting using linear regression, there exists a minor variant of Batch Gradient Descent algorithm, called Stochastic Gradient Descent. In the Batch Gradient Descent, the parameter vector is updated as, . (loop over all elements of training set in one iteration) For Stochastic Gradient Descent, the vector gets updated as, at each iteration the…
GATE-2012 ECE Q2 (communication)
Question 52 on communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q2. The power spectral density of a real process for positive frequencies is shown below. The values of and , respectively are (A) (B) (C) (D) Solution For a wide sense stationary function, the auto-correlation with delay is defined as,…
MSK transmitter and receiver
In a post on Minimum Shift Keying (MSK), we had discussed that MSK uses two frequencies which are separated by and phase discontinuity is avoided in symbol boundaries. In that post, we had discussed MSK as a continuous phase transmit signal and showed that phase changes through 0, 90, 180 and 270 degrees. In this…
Thermal Noise and AWGN
A friend called me up couple of days back with the question – How white is AWGN? I gave him an answer over phone, which he was not too happy about. That got me thinking bit more on the topic and the result is this post – brief write up on thermal noise and it’s…
Noise Figure of cascaded stages
Following the discussion on thermal noise and it’s modeling and noise figure computation for a simple resistor network, in this article let us discuss the Noise Figure of cascaded stages.
Understanding an OFDM transmission
Let us try to understand simulation of a typical Orthogonal Frequency Division Multiplexing (OFDM) transmission defined per IEEE 802.11a specification. Orthogonal pulses In a previous post (here ), we have understood that the minimum frequency separation for two sinusoidals with arbitrary phases to be orthogonal is , where is the symbol period. In Orthogonal Frequency…
Least Squares in Gaussian Noise – Maximum Likelihood
From the previous posts on Linear Regression (using Batch Gradient descent, Stochastic Gradient Descent, Closed form solution), we discussed couple of different ways to estimate the parameter vector in the least square error sense for the given training set. However, how does the least square error criterion work when the training set is corrupted by…
GATE-2012 ECE Q16 (electromagnetics)
Question 16 on electromagnetics from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q16. A coaxial cable with an inner diameter of 1mm and outer diameter of 2.4mm is filled with a dielectric of relative permittivity 10.89. Given , the characteristic impedance of the cable is (A) (B) (C) (D) Solution To…
Using Toeplitz matrices in MATLAB
The definition of Toeplitz matrix from [1] is: A matrix is said to be Toeplitz if the elements are determined completely by the difference .
Symbol Error Rate for 16PSK
In this post, let us try to derive the symbol error rate for 16-PSK (16-Phase Shift Keying) modulation. Consider a general M-PSK modulation, where the alphabets, are used. (Refer example 5-38 in [DIG-COMM-BARRY-LEE-MESSERSCHMITT]) Figure: 16-PSK constellation plot