Understanding gradients is essential in machine learning, as they indicate the direction and rate of change in the loss function with respect to model parameters. This post covers the gradients for the vanilla Linear Regression case taking two loss functions Mean Square Error (MSE) and Mean Absolute Error (MAE) as examples. The gradients computed analytically…
In the past, we had discussed BER for BPSK in flat fading Rayleigh channel. In this post, lets discuss a frequency selective channel with the use of Zero Forcing (ZF) equalization to compensate for the inter symbol interference (ISI). For simplifying the discussion, we will assume that there is no pulse shaping at the transmitter….
Question 36 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q36. A fair coin is tossed till a head appears for the first time. The probability that the number of required tosses is odd, is (A) 1/3 (B) 1/2 (C) 2/3 (D) 3/4 Solution Let us start by…
I noticed that the scripts provided from http://wolverinex02.googlepages.com/emoticonsforblogger2 for writing equations on blogger stopped working. Reason: The address of the public mimeTEX server is changed to /cgi-bin/mimetex.cgi? from Thursday, March15 2007.
Advanced Computing and Communication Society (ACS) of India is organizing ICCBN 2008 conference (International Conference on Communication, Convergence, and Broadband Networking) from July 17th to 20th 2008 at National Science Seminar Complex at Indian Institute of Science (IISc), Bangalore. ICCBN Conference aims to provide a premier forum for researchers, industry practitioners and educators to present…
The post covers various neural network based word embedding models. Starting from the Neural Probabilistic Language Model from Bengio et al 2003, then reduction of complexity using Hierarchical softmax and Noise Contrastive Estimation. Further works like CBoW, GlOVe, Skip Gram and Negative Sampling which helped to train on much higher data.
Question 34 on signals from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q34. Consider the differential equation with and The numerical value of is (A) -2 (B) -1 (C) 0 (D) 1
Quick check of on Blogspot, thanks to the information provided here. Good ! It works…would like to have a better formatting though. Anyhow this will do for now.
Following the discussion on thermal noise and it’s modeling and noise figure computation for a simple resistor network, in this article let us discuss the Noise Figure of cascaded stages.
Let us derive the theoretical 16QAM bit error rate (BER) with Gray coded constellation mapping in additive white Gaussian noise conditions. Further, the Matlab/Octave simulation script can be used to confirm that the simulation is in good agreement with theory.
In two previous posts, we have discussed Convolutional Coding and the associated hard decision Viterbi decoding. In this post lets extent Viterbi decoding algorithm to soft input decision scheme. The modulation used is BPSK and the channel is assumed to be AWGN alone.
We have quite a few articles discussing bit and symbol error rates for popular digital modulation schemes in Additive White Gaussian Noise (AWGN) channel. This post summarizes the articles discussing the theoretical and simulated error rates for the digital modulation schemes like BPSK, QPSK, 4–PAM, 16PSK and 16QAM. Further, Bit Error Rate with Gray coded…
Question 38 on Communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q38. A binary symmetric channel (BSC) has a transition probability of 1/8. If the binary transmit symbol X is such that P(X=0)=9/10, then the probability of error for an optimum receiver will be (A) 7/80 (B) 63/80 (C)…
This is a guest post by Jose Antonio Urigüen who is an Electrical and Electronic Engineer currently studying an MSc in Communications and Signal Processing at Imperial College in London. This guest post has been created due to his own curiosity when reviewing some concepts of BER for BPSK in Rayleigh channnel published in the…