In a multi class classification problem, the output (also called the label or class) takes a finite set of discrete values . In this post, system model for a multi class classification with a linear layer followed by softmax layer is defined. The softmax function transforms the output of a linear layer into values lying…
Last week, I received an email from Mr. Kishore. He was wondering about the physical significance of negative frequency. Does negative frequency really exist? Though I have seen conflicting views on the net (thread in complextoreal.com, thread in comp.dsp), my perspective is that negative frequency exist. The concept of negative frequency helps me a lot…
Those who are regular visitors to dsplog.com might have noticed the small FeedBurner chicklet on the side showing subscriber count showing 1000+ subscribers. Its a nice milestone to reach, one that looked so distant when I wrote the first post stating the objective of this blog on 26th February 2007. We now have around 86…
From the post on Closed Form Solution for Linear regression, we computed the parameter vector which minimizes the square of the error between the predicted value and the actual output for all values in the training set. In that model all the values in the training set is given equal importance. Let us consider the case where it is known…
In the past, we had discussed several posts on two transmit two receive MIMO communication, where the transmission was based on V-BLAST. The details about V-BLAST can be read from the landmark paper V-BLAST: An architeture for realizing very high data rates over the rich scattering wireless channel – P. W. Wolniansky, G. J. Foschini,…
Thanks to Mr. Raghava G D’s comments on the post discussing Question 38 on Communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper, realized that I had made an error in the solution. Have the updated the post with the right answer and additional explanations.
Advanced Computing and Communication Society (ACS) of India is organizing ICCBN 2008 conference (International Conference on Communication, Convergence, and Broadband Networking) from July 17th to 20th 2008 at National Science Seminar Complex at Indian Institute of Science (IISc), Bangalore. ICCBN Conference aims to provide a premier forum for researchers, industry practitioners and educators to present…
In a previous post, the variance of the in-band quantization noise for a first order sigma delta modulator was derived. Taking it one step furhter, let us find the variance of the quantization noise filtered by a second order filter. With a first order filter, the quantization noise passes through a system with transfer function…
This post discuss about the thermal noise in RC low pass filter. Using the noise equivalent model using resistor with a voltage source, which gets passed through a no noise RC low pass filter. The noise power at the output is computed by integrating the output voltage spectral density over all frequencies.
Let us try to understand the formula for Channel Capacity with an Average Power Limitation, described in Section 25 of the landmark paper A Mathematical Theory for Communication, by Mr. Claude Shannon. Further, the following writeup is based on Section 12.5.1 from Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi
Question 36 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q36. A fair coin is tossed till a head appears for the first time. The probability that the number of required tosses is odd, is (A) 1/3 (B) 1/2 (C) 2/3 (D) 3/4 Solution Let us start by…
In a classification problem, the output (also called the label or class) takes a small number of discrete values rather than continuous values. For a simple binary classification problem, where output takes only two discrete values : 0 or 1, the sigmoid function can be used to transform the output of a linear regression model…
In the post on Viterbi decoder and soft input Viterbi decoder, we discussed a convolutional encoding scheme with rate 1/2, constraint length and having generator polynomial and having generator polynomial . If the number of uncoded bits is , then the number of coded bits at the output of the convolutional encoder is . Decoding…
Question 52 on communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q2. The power spectral density of a real process for positive frequencies is shown below. The values of and , respectively are (A) (B) (C) (D) Solution For a wide sense stationary function, the auto-correlation with delay is defined as,…