Understanding gradients is essential in machine learning, as they indicate the direction and rate of change in the loss function with respect to model parameters. This post covers the gradients for the vanilla Linear Regression case taking two loss functions Mean Square Error (MSE) and Mean Absolute Error (MAE) as examples. The gradients computed analytically…
In this post, the objective is to figure out the minimum separation between two sinusoidals having frequencies , of duration each to be orthogonal. Let the phase difference between the sinusoidals is where can take any value from to (Refer Example 4.3 [DIG-COMM-SKLAR]). For the two sinuosidals to be orthogonal,
Its been a nice week for me, wherein I guest posted an article in DSPDesignLine.com. 🙂 The article derives the theoretical symbol error rate for M-QAM modulation. The theoretical results are further supplemented by Matlab/Octave simulation scripts. Those who are familiar with derivation of symbol error rate for 16-QAM modulation will find the equations easy…
Coding is a technique where redundancy is added to original bit sequence to increase the reliability of the communication. In this article, lets discuss a simple binary convolutional coding scheme at the transmitter and the associated Viterbi (maximum likelihood) decoding scheme at the receiver. Update: For some reason, the blog is unable to display the…
In signal processing blocks like power estimation used in digital communication, it may be required to represent the estimate in log scale. This post explains a simple linear to log conversion scheme proposed in the DSP Guru column on DSP Trick: Quick-and-Dirty Logarithms. The scheme makes implementation of a linear to log conversion simple and…
In the post on Rayleigh channel model, we stated that a circularly symmetric random variable is of the form , where real and imaginary parts are zero mean independent and identically distributed (iid) Gaussian random variables. The magnitude which has the probability density, is called a Rayleigh random variable. Further, the phase is uniformly distributed from…
In a previous post (here), we discussed in brief, Orthogonal Frequency Division Multiplexing (OFDM) transmission. Let us know probe bit more into the motivation of cyclic prefix (aka guard interval) associated with each OFDM symbol. What is cyclic prefix? Let us consider one subcarrier (subcarrier +1 specified in IEEE 802.11a specification) alone. In the figure…
After almost 6 months with the Smashing Theme template, its time for a change. Recently I stumbled upon the Deep Blue template from DailyBlogTips. I liked the clean blue-green-white combination and and felt it might be a good fit for www.dsplog.com. Hope you agree. One key feature which I like is addition of tag cloud…
Question 13 on analog electronics from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q13. The diodes and the capacitors in the circuit shown are ideal. The voltage across the diode is (A) (B) (C) (D) Solution The first half of the circuit is a negative clamper circuit and the second half…
My friend and colleague Mr. Vineet Srivastava pointed me to a nice article on  clock jitter – Clock Jitter Effects on Sampling : A tutorial – by Carlos Azeredo-Leme, IEEE Circuits and Systems Magazine, Third Quarter 2011. In this post, let us discuss the total Signal to Noise Ratio at the output of an analog to…
Quick check of on Blogspot, thanks to the information provided here. Good ! It works…would like to have a better formatting though. Anyhow this will do for now.
Minimum shift keying (MSK) is an important concept to learn in digital communications. It is a form of continuous phase frequency shift keying . In minimum phase shift keying, two key concepts are used. (a) The frequency separation of the sinusoidals used for representing bits 1’s and 0’s are , where is the symbol period….
This post discuss about the thermal noise in RC low pass filter. Using the noise equivalent model using resistor with a voltage source, which gets passed through a no noise RC low pass filter. The noise power at the output is computed by integrating the output voltage spectral density over all frequencies.