User talk:Rbj

Critical frequency

A family of sinusoids at the critical frequency, all having the same sample sequences of alternating +1 and –1. That is, they all are aliases of each other, even though their frequency is not above half the sample rate.

The Nyquist rate is defined as twice the bandwidth of the continuous-time signal. The sampling frequency must be strictly greater than the Nyquist rate of the signal to achieve unambiguous representation of the signal. This constraint is equivalent to requiring that the system's Nyquist frequency (also known as critical frequency, and equal to half the sample rate) be strictly greater than the bandwidth of the signal. If the signal contains a frequency component at precisely the Nyquist frequency then the corresponding component of the sample values cannot have sufficient information to reconstruct the Nyquist-frequency component in the continuous-time signal because of phase ambiguity. In such a case, there would be an infinite number of possible and different sinusoids (of varying amplitude and phase) of the Nyquist-frequency component that are represented by the discrete samples.

As an example, consider this family of signals at the critical frequency:

$x(t)={\frac {1}{\cos(\theta )}}\cos \left(2\pi {\frac {f_{s}}{2}}t+\theta \right)\$

Where the samples

$x[n]\ \equiv \ x(nT)=\cos(\pi n)=(-1)^{n}\$

are in every case just alternating –1 and +1, for any phase θ. There is no way to determine either the amplitude or the phase of the continuous-time sinusoid x(t) that x[n] was sampled from. This ambiguity is the reason for the strict inequality of the sampling theorem's condition.

Mathematical basis for the theorem

A Dirac comb, modulated by the sample values of a signal

The Nyquist–Shannon sampling theorem states that, given a bandlimited continuous-time signal x(t) that is uniformly sampled at a sufficient rate, even if all of the information in the signal between samples is discarded, there remains sufficient information in the samples that the original continuous-time signal can be mathematically reconstructed perfectly from only those discrete samples. To prove this, a different function is first constructed, conceptually, from the whole original signal, but preserving information from just the sample instants:

$x_{s}(t)=x(t)\cdot \left(T\cdot \operatorname {\text{Ш}} _{\,T}\right)\$

x(t) is the original continuous-time signal.

x_s(t) is a function that depends only on the values of x(t) at discrete moments of time

Ш_T(t) is the sampling operator called the Dirac comb and, being periodic with period T, can be formally expressed as a Fourier series:

$T\cdot \operatorname {\text{Ш}} _{\,T}\,$	$\ \equiv \ T\cdot \sum _{n=-\infty }^{\infty }\delta (t-nT)\$
	$=T\cdot \sum _{k=-\infty }^{\infty }{\frac {1}{T}}e^{i2\pi kt/T}\$
	$=\sum _{k=-\infty }^{\infty }e^{i2\pi kf_{s}t}\$

f_s = 1/T is the sampling frequency and is the fundamental frequency of the periodic function Ш_T(t).

δ(t-nT) is a dirac impulse delayed to time nT.

The (implied) limit in the Fourier summation is not in the pointwise sense but in the sense of tempered distributions, see also Dirichlet kernel.

Since the Dirac impulse is zero except where its argument is zero, Ш_T(t) takes a value of zero except for values of t that are at the sampling instants, nT, for integer n. Therefore x_s(t) also takes on zero values for all t except for the sampling instants nT. Multiplying x(t) by Ш_T(t) effectively discards all of the information between sampling instants and retains information only at the sampling instants nT. x_s(t) can be represented in terms of the samples:

$x_{s}(t)\,$	$=x(t)\cdot T\sum _{n=-\infty }^{\infty }\delta (t-nT)\$
	$=T\sum _{n=-\infty }^{\infty }x(t)\cdot \delta (t-nT)\$
	$=T\sum _{n=-\infty }^{\infty }x(nT)\cdot \delta (t-nT)\$
	$=T\sum _{n=-\infty }^{\infty }x[n]\cdot \delta (t-nT)\$

where x[n] = x(nT) are the samples. The sequence of sample impulses x_s(t) can also be written in terms of the Fourier series of the Dirac comb,:

$x_{s}(t)\,$	$=x(t)\cdot \sum _{k=-\infty }^{\infty }e^{i2\pi kf_{s}t}\$
	$=\sum _{k=-\infty }^{\infty }x(t)\cdot e^{i2\pi kf_{s}t}\$

Using the frequency shifting property of the continuous Fourier transform,

$X_{s}(f)\,$	$\ \equiv \ {\mathcal {F}}\left\{x_{s}(t)\right\}=\int _{-\infty }^{\infty }x_{s}(t)e^{-i2\pi ft}\,dt\$
	$={\mathcal {F}}\left\{\sum _{k=-\infty }^{\infty }x(t)\cdot e^{i2\pi kf_{s}t}\right\}\$
	$=\sum _{k=-\infty }^{\infty }{\mathcal {F}}\left\{x(t)\cdot e^{i2\pi kf_{s}t}\right\}\$
	$=\sum _{k=-\infty }^{\infty }X(f-kf_{s})\$

where X(f) is the Fourier transform of x(t). This says that the spectrum of the baseband signal being sampled is shifted and repeated forever at integral multiples of the sampling frequency, f_s. These repeated copies are called images of the original signal spectrum.

Now constrain x(t) to be bandlimited to B (that is, X(f) = 0 for all |f| > B), and consider what condition precludes overlapping of the adjacent images X(f-kf_s) :

right edge of kth image of X( f )	$<\$ left edge of (k+1)th image
$kf_{s}+B\,$	$<(k+1)f_{s}-B=kf_{s}+f_{s}-B\$
$B\,$	$<f_{s}-B\$
$2B\,$	$<f_{s}={\frac {1}{T}}\$

With that condition satisfied, there is no overlap of images in X_s(f) and X(f) (and thus x(t)) can be reconstructed from X_s(f) (or x_s(t)) by low pass filtering out all of the images of X(f) in X_s(f) except for the original image at the baseband. To do that, f_s > 2B (to prevent overlap) and the frequency response of the reconstruction filter H(f) must be:

$H(f)={\begin{cases}1&|f|\leq B\\0&|f|\geq f_{s}-B\end{cases}}$

The reconstruction low-pass filter transition band is between B and f_s-B and the filter response need not be precisely defined in that region (since there is no non-zero spectrum in that region). However, the worst case is when the bandwidth B is virtually as large as the Nyquist frequency f_s/2 and in that worst case, the reconstruction filter H(f) must be:

$H(f)=\mathrm {rect} \left({\frac {f}{f_{s}}}\right)={\begin{cases}1&|f|<{\frac {f_{s}}{2}}\\0&|f|>{\frac {f_{s}}{2}}\end{cases}}$

where $\mathrm {rect} (u)\$ is the rectangular function.

With H(f) so defined, it is clear that

$X(f)=H(f)\cdot X_{s}(f)\$

Spectrum, X_s(f), of a properly sampled bandlimited signal (blue) and images (green) that do not overlap. A "brick-wall" low-pass filter, H(f), removes the images, leaves the original spectrum, X(f), and recovers the original signal from the samples.

and the spectrum of the original signal that was sampled, X(f), is recovered from the spectrum of the sampled signal, X_s(f). This means, in the time domain, that the original signal that was sampled, x(t), is recovered from the sampled signal, x_s(t).

This completes the proof of the Nyquist–Shannon sampling theorem. It says that if the sampling frequency, f_s, is strictly greater than twice the bandwidth, B, of the continuous-time baseband signal, x(t), then no information is lost (or "aliased") by sampling.

To reconstruct x(t) from the samples x[n], a reconstruction filter (a brick-wall low-pass filter) with response H(f) is constructed. The impulse response of the reconstruction filter is the inverse Fourier transform of H(f):

$h(t)\,$	$={\mathcal {F}}^{-1}\left\{H(f)\right\}\$
	$=\int _{-\infty }^{\infty }H(f)e^{i2\pi ft}\,df\$
	$=\int _{-\infty }^{\infty }\mathrm {rect} \left({\frac {f}{f_{s}}}\right)e^{i2\pi ft}\,df\$
	$=\int _{-f_{s}/2}^{f_{s}/2}e^{i2\pi ft}\,df\$
	$={\frac {1}{i2\pi t}}e^{i2\pi ft}{\bigg |}_{-f_{s}/2}^{f_{s}/2}\$
	$={\frac {1}{\pi t}}{\frac {\left(e^{i\pi f_{s}t}-e^{-i\pi f_{s}t}\right)}{2i}}\$
	$={\frac {\sin(\pi f_{s}t)}{\pi t}}\$
	$=f_{s}\ \mathrm {sinc} (f_{s}t)\$,   in terms of the normalized sinc function.

This function is the impulse response of the reconstruction filter with input the sampled signal x_s(t), which is just a collection of dirac impulses, δ(t-nT), each delayed to the time of their sampling instance, nT and weighted by a value proportional to the value of the continuous-time signal that was sampled at that instance, x[n]=x(nT). Since the reconstruction filter is a linear, time-invariant system, each impulse at time nT generates its own impulse response delayed to the same time, and the output of the reconstruction filter is the sum of outputs driven by each weighted impulse separately. For each input impulse, the component of the output is the impulse response delayed to the same time of that input impulse, h(t-nT), and weighted by the same coefficient attached to that input impulse, T•x[n]. That is, the output of the reconstruction filter is:

$x(t)\,$	$=h(t)*x_{s}(t)\$,   where $\quad *\$ is the convolution operator
	$=h(t)*\sum _{n=-\infty }^{\infty }T\cdot x[n]\cdot \delta (t-nT)\$
	$=\sum _{n=-\infty }^{\infty }x[n]\cdot T\cdot \left[h(t)*\delta (t-nT)\right]\$
	$=\sum _{n=-\infty }^{\infty }x[n]\cdot T\cdot h(t-nT)\$
	$=\sum _{n=-\infty }^{\infty }x[n]\cdot (Tf_{s})\ \mathrm {sinc} \left(f_{s}(t-nT)\right)\$
	$=\sum _{n=-\infty }^{\infty }x[n]\cdot \mathrm {sinc} \left({\frac {t-nT}{T}}\right)\$

This shows explicitly how the samples x[n] are combined to reconstruct the original function x(t).