The post covers various neural network based word embedding models. Starting from the Neural Probabilistic Language Model from Bengio et al 2003, then reduction of complexity using Hierarchical softmax and Noise Contrastive Estimation. Further works like CBoW, GlOVe, Skip Gram and Negative Sampling which helped to train on much higher data.
My friend Mr. Balaji volunteers for Vibha, a non-profit organization whose mission is to ensure that every underprivileged child attains his or her right to education, health and opportunity. Vibha, which was founded in 1991 has a volunteer network of 825 members spread across Atlanta, Austin, Bay Area, Boston, Chicago, Dallas, Houston, Jacksonville, Los Angeles,…
Let us derive the theoretical 16QAM bit error rate (BER) with Gray coded constellation mapping in additive white Gaussian noise conditions. Further, the Matlab/Octave simulation script can be used to confirm that the simulation is in good agreement with theory.
Question 25 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q25. If , then the value of is, (a) (b) (c) (d) 1
In the past, we had discussed BER for BPSK in flat fading Rayleigh channel and BER for BPSK in a frequency selective channel using Zero Forcing Equalization. In this post, lets discuss a frequency selective channel with the use of Minimum Mean Square Error (MMSE) equalization to compensate for the inter symbol interference (ISI). For…
TETRA (TErrestrial Trunked RAdio) is a wireless specification intended to be used by government agencies, public health services, rail transport, military etc. TETRA specification comes from ETSI (European Telecommunication Standards Institute). We plan to start a post series on the building blocks of TETRA physical layer and radio specifications and this is the first post…
Question 3 on Communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q3. In a baseband communications link, frequencies upto 3500Hz are used for signalling. Using a raised cosine pulse with 75% excess bandwidth and for no inter-symbol interference, the maximum possible signaling rate in symbols per second is, (A)…
Wishing all the readers of dsplog.com a great year 2010 ! Its been a mixed year for dsplog. Some key milestones a) Crossing 1000 subscribers with 1100+ comments in March 2009 b) Crossing 100 posts with 2200 subscribers and 2600+ comments in October 2009 c) As I write this, we have 102 posts with 2603…
Given that we have discussed symbol error rate probability for a 4-PAM modulation, let us know focus on finding the symbol error probability for a QPSK (4-QAM) modulation scheme. Background Consider that the alphabets used for a QPSK (4-QAM) is (Refer example 5-35 in [DIG-COMM-BARRY-LEE-MESSERSCHMITT]). Download free e-Book discussing theoretical and simulated error rates for…
In typical digital signal processing applications, there arises need to increase the sampling frequency of a signal sequence, where the higher sampling frequency is an integer multiple of the original sampling frequency i.e for a signal sequence with a sampling frequency , change the sampling frequency to , where is an integer.
An important milestone for the dspLog happened on Oct 21st 2008. On this day last year, the blog migrated from the Blogger platform to the independently hosted platform at www.dsplog.com ! Belated birthday wishes for the blog!!! 🙂 Looking back, the first year was satisfying – both in terms of contents and traffic. We started…
While trying to derive the theoretical bit error rate (BER) for BPSK modulation in a Rayleigh fading channel, I realized that I need to discuss chi square random variable prior. What is chi-square random variable? Let there be independent and identically distributed Gaussian random variables with mean and variance and we form a new random…
In this post, the objective is to figure out the minimum separation between two sinusoidals having frequencies , of duration each to be orthogonal. Let the phase difference between the sinusoidals is where can take any value from to (Refer Example 4.3 [DIG-COMM-SKLAR]). For the two sinuosidals to be orthogonal,
In the post on Soft Input Viterbi decoder, we had discussed BPSK modulation with convolutional coding and soft input Viterbi decoding in AWGN channel. Let us know discuss the derivation of soft bits for 16QAM modulation scheme with Gray coded bit mapping. The channel is assumed to be AWGN alone.