The post covers various neural network based word embedding models. Starting from the Neural Probabilistic Language Model from Bengio et al 2003, then reduction of complexity using Hierarchical softmax and Noise Contrastive Estimation. Further works like CBoW, GlOVe, Skip Gram and Negative Sampling which helped to train on much higher data.
Given that we have went over the symbol error probability for 4-PAM and symbol error rate for 4-QAM , let us extend the understanding to find the symbol error probability for 16-QAM (16 Quadrature Amplitude Modulation). Consider a typical 16-QAM modulation scheme where the alphabets (Refer example 5-37 in [DIG-COMM-BARRY-LEE-MESSERSCHMITT]). are used.
In this post, the objective is to figure out the minimum separation between two sinusoidals having frequencies , of duration each to be orthogonal. Let the phase difference between the sinusoidals is where can take any value from to (Refer Example 4.3 [DIG-COMM-SKLAR]). For the two sinuosidals to be orthogonal,
This post attempts to build further on the MIMO equalization schemes which we have discussed – (a) Minimum Mean Square Error (MMSE) equalization, (b) Zero Forcing equalization with Successive Interference Cancellation (ZF-SIC) and (c) ZF-SIC with optimal ordering. We have learned that successive interference cancellation with optimal ordering improves the performance with Zero Forcing equalization….
The definition of Toeplitz matrix from [1] is: A matrix is said to be Toeplitz if the elements are determined completely by the difference .
We have discussed about probable transmit pulse shaping filter and have observed that raised cosine filtering filtering allows a simpler implementation, albeit at the cost of increased bandwidth. Let us know understand the eye diagram, which is a useful graphical tool to quantify the degradation of the signal due to filtering. Eye diagram An eye…
Coding is a technique where redundancy is added to original bit sequence to increase the reliability of the communication. In this article, lets discuss a simple binary convolutional coding scheme at the transmitter and the associated Viterbi (maximum likelihood) decoding scheme at the receiver. Update: For some reason, the blog is unable to display the…
Hi, Those visiting the blog might have noticed a fresh look to the dspLog. This new feel is thanks to the Thesis Magazine Skin provided by FourBlogger Skins. Click here to view more details. There some more tinkering required at some places. But, in general most of the settings are taken care. Hope you like…
In an earlier post, it was mentioned that delta modulator without the quantizer is identical to convolving an input sequence with . Let us first try to validate that thought using a small MATLAB example and using the delta modulator circuit shown in Figure 9.13a of DSP-Proakis [1]. % delta modulation xn = sin(2*pi*1/64*[0:63]); xhatn…
This is a guest post by Jose Antonio Urigüen who is an Electrical and Electronic Engineer currently studying an MSc in Communications and Signal Processing at Imperial College in London. This guest post has been created due to his own curiosity when reviewing some concepts of BER for BPSK in Rayleigh channnel published in the…
In DSP-Proakis, I found the problem 2.56 interesting as it provides insight into delta modulation. The task is to show that, where is any discrete time signal and is the unit step function.
In previous posts, we have discussed convolutional codes with Viterbi decoding (hard decision, soft decision and with finite traceback). Let us know discuss a block coding scheme where a group of information bits is mapped into coded bits. Such codes are referred to as codes. We will restrict the discussion to Hamming codes, where 4…
Question 25 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q25. If , then the value of is, (a) (b) (c) (d) 1
In a previous post (here), we discussed in brief, Orthogonal Frequency Division Multiplexing (OFDM) transmission. Let us know probe bit more into the motivation of cyclic prefix (aka guard interval) associated with each OFDM symbol. What is cyclic prefix? Let us consider one subcarrier (subcarrier +1 specified in IEEE 802.11a specification) alone. In the figure…