**[http://www.youtube.com/watch?v=mhEFJr5qvLo Douglas Harder Lecture on Functions as Vectors]
*[[Energy in a signal|Finding the Energy in a Signal]]
*[[Energy in a signal|Finding the Energy in a Signal]]
**[[Rayleigh's Theorem]]
**[[Rayleigh's Theorem]]
Line 19:
Line 20:
*[https://ccrma.stanford.edu/~jos/sasp/sasp.html Spectral Audio Signal Processing, by Julius O. Smith III]
*[https://ccrma.stanford.edu/~jos/sasp/sasp.html Spectral Audio Signal Processing, by Julius O. Smith III]
*[http://www.dspguide.com/ The Scientist and Engineer's Guide to Digital Signal Processing by Steven W. Smith, Ph.D.] The professor likes this one.
*[http://www.dspguide.com/ The Scientist and Engineer's Guide to Digital Signal Processing by Steven W. Smith, Ph.D.] The professor likes this one.
*[http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-003-signals-and-systems-spring-2010/readings/ Discrete Time Signals & Systems]
*[http://sar.kangwon.ac.kr/gisg/FFT_book.pdf The Fast Fourier Transform by E. O. Brigham] This was one of the professor's textbooks when he took this class.
*[http://faculty.uml.edu/cbyrne/SP1text.pdf Mathematics of Signal Processing: A First Course, by Charles L. Byrne] Good chapters on Computer Aided Tomography (CAT Scan) as well as a lot of other interesting things.
*[http://www.orchardpublications.com/9781934404232ex.pdf Signals & Systems, with MATLAB/Simulink, Karris]
===Fourier Series===
===Fourier Series===
Line 29:
Line 34:
===Dirac Delta Function and Convolution===
===Dirac Delta Function and Convolution===
*[http://web.mit.edu/2.14/www/Handouts/Convolution.pdf MIT handout on Dirac Delta Function and Convolution]
*[http://web.mit.edu/2.14/www/Handouts/Convolution.pdf MIT handout on Dirac Delta Function and Convolution]
*[http://homedir.jct.ac.il/~shlomoe/Public/LinSysStuff/IntroLinSys.pdf Linear Time Invariant Systems by Shlomo Engelberg]
[http://www.ws.binghamton.edu/fowler/fowler%20personal%20page/EE521_files/IV-05%20Polyphase%20FIlters_2007.pdf Slides from a Presentation on Polyphase Decimation and Interpolation by Mark Fowler]
[http://www.ws.binghamton.edu/fowler/fowler%20personal%20page/EE521_files/IV-05%20Polyphase%20FIlters_2007.pdf Slides from a Presentation on Polyphase Decimation and Interpolation by Mark Fowler]
Line 38:
Line 44:
===FIR Filters===
===FIR Filters===
[http://www.dspguru.com/dsp/faqs/fir This is a very easy-to-understand summary of FIR basics, properties, design, and implementation]
*[http://www.dspguru.com/dsp/faqs/fir This is a very easy-to-understand summary of FIR basics, properties, design, and implementation]
[http://www.dspguru.com/dsp/faqs/multirate/decimation Another easy-to-understand article about decimation]
*[http://www.dspguru.com/dsp/faqs/multirate/decimation Another easy-to-understand article about decimation]
[http://www.dspguru.com/dsp/faqs/multirate/interpolation Another easy-to-understand article about interpolation]
*[http://www.dspguru.com/dsp/faqs/multirate/interpolation Another easy-to-understand article about interpolation]
*[http://inst.eecs.berkeley.edu/~ee123/fa11/docs/FastConv.pdf Fast Convolution Based on the FFT] This reference shows how end effects are dealt with. To use the FFT for convolution, you need to do it in blocks, which leads to end effects, and more latency, but if your blocks are big enough, it speeds up the convolution.
*The truncated Fourier series or DFT method of FIR filter design gives the best approximation of the desired frequency response in a least squared error sense, but it is not very good near discontinuities. [http://itee.uq.edu.au/~elec4600/elec4600_lectures/1perpage/lectremez.pdf The Parks-McClellan] (Remez) iterative algorithm gives equal ripple in the pass band and stop band. This is the best in terms of minimizing the maximum error in each area, which is usually better in the real world. MATLAB/octave have automated functions to do that. See [http://octave.sourceforge.net/signal/function/remez.html remez() in the Signals package of octave.]
*[http://eeweb.poly.edu/iselesni/EL713/remez/ A nice detailed description of the Parks McClellan algorithm with MATLAB/octave code.]
*[https://www.youtube.com/watch?v=bmOvHjSBlnc This is a nice demo of using a head related impulse response and FIR filters to give sound a nice 3D effect.]
*[http://recherche.ircam.fr/equipes/salles/listen/index.html Listen Head Related Transfer Function (HRTF) Database]
**[http://recherche.ircam.fr/equipes/salles/listen/sounds.html Selection of binaural sounds processed through different head related transfer functions.] You can pick the HRTF that is closest to your own here.
===Adaptive FIR Filters===
===Adaptive FIR Filters===
[https://www.youtube.com/watch?v=dE-pOYuu6go Your professor's cheesy video to explain Adaptive FIR Filters]
[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.42.6386&rep=rep1&type=pdf Introduction to Adaptive Filters, Simon Haykin]
[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.42.6386&rep=rep1&type=pdf Introduction to Adaptive Filters, Simon Haykin]
[http://saba.kntu.ac.ir/eecd/taghirad/E%20books/TOC/Adaptive%20Filters.pdf Simon Haykin's book chapter]
[http://saba.kntu.ac.ir/eecd/taghirad/E%20books/TOC/Adaptive%20Filters.pdf Simon Haykin's book chapter]
[http://www.latticesemi.com/documents/doc22982x20.pdf?jsessionid=f0308ccf0f735471e49a6054323c5c177969 Adaptive LMS it an FPGA]
[http://www.latticesemi.com/documents/doc22982x20.pdf?jsessionid=f0308ccf0f735471e49a6054323c5c177969 Adaptive LMS in an FPGA]
[http://dsp-book.narod.ru/DSPMW/18.PDF Scott Douglas' chapter on Adaptive Filters has some interesting applications, among them linear predictive coding (LPC) used in speech codecs.]
[http://www.mathworks.com/help/dsp/ug/overview-of-adaptive-filters-and-applications.html Adaptive Filters and Applications (Mathworks)]
[http://www.dspalgorithms.com/aspt/asptnode26.html More Applications of Adaptive Filters]
====Constant Modulus Algorythm====
====Constant Modulus Algorythm====
[http://ens.ewi.tudelft.nl/Education/courses/et4147/sheets/cma_leus.pdf Using the CMA on antenna arrays]
[http://ens.ewi.tudelft.nl/Education/courses/et4147/sheets/cma_leus.pdf Using the CMA on antenna arrays]
===Math Editors for Your Notebook===
You can make your notebook here on the wiki, but there are other options, including things like writing you notes on paper and using photo processing software to make notes like the [http://people.wallawalla.edu/~Rob.Frohne/ClassNotes/engr455index.htm old class notes]. You can also make screencasts or videos for your notebook.
*[https://jupyterlab.readthedocs.io/en/stable/ JupyterLab:] This is my current favorite for making notebooks with a "literate programming" approach. It allows you to mix prose and other things with your equations in LaTex or python or octave code that illustrate the concepts.
*LaTex: I suggest opening opening the following [http://www.math.duke.edu/computing/tex/templates/samplefile.tex sample file] with any of the LaTex editors below. LaTex is a document processing language that you compile like C or other compiled languages. It does produce the nicest looking documents, but it takes a bit of expertise to do that. If you are bound for graduate school, it is well worth learning.
**[http://www.texstudio.org/ TexStudio] works with Windows, Linux, and OS X, has a previewer, menus to help newbies, and is about the most featured LaTex editor I have tried.
**[http://www.xm1math.net/texmaker/ Texmaker] is a LaTex editor with preview and a bunch of menus that help to figure out what you need to type to get the effects you want. It works on Linux, Windows, and OS X.
**[https://en.wikipedia.org/wiki/Gummi_(software) Gummi] is a LaTex editor with preview for Linux and Windows.
**[https://www.codecogs.com/latex/eqneditor.php Online LaTeX Editor] especially for equations. This is useful for other systems that take LaTex input when you don't know LaTex yet.
*[http://lurchmath.org/ Lurch] is a math editor for your desktop that will check your logic. For this class it is primarily useful as an easy editor for mathematical subjects.
*[https://andrejv.github.io/wxmaxima/index.html wxMaxima] is a document based GUI for the Maxima computer algebra system. You can do quite a bit of algebra and calculus in wxMaxima. The notebooks it produces look good, but not as good as LaTex documents, however, you can easily change them, and it will redo all the math with the changes. I found a [https://bugs.launchpad.net/ubuntu/+source/wxmaxima/+bug/1311770 bug] in the version that come with Ubuntu 15.04 where it segfaults when you type in a parenthesis to one of the helpful windows that come up when using the menus. I solved it by using the [https://launchpad.net/~peterpall/+archive/ubuntu/wxmaxima-nightlies nightly builds] from Peter Pall. As with most of the tools here, it will [http://www.matrix44.net/blog/?p=1029 integrate in with LaTex].
*[http://www.sagemath.org/ SageMath] is a computer algebra system similar to wxMaxima that uses python, maxima and other tools to make a very nice and powerful tool for making a notebook. In order to make it work with the octave kernel, I had to use the latest version, which I obtained at [https://help.ubuntu.com/community/SAGE the Ubuntu Sage wiki] where I the instructions to install the upstream binary like this:
sudo apt-add-repository -y ppa:aims/sagemath
sudo apt-get update
sudo apt-get install sagemath-upstream-binary
*[https://cloud.sagemath.com SageMath on the cloud] uses sage (a computer algebra system) and latex to make your document. It has a nice preview that shows you what you get with your LaTex code. It also has a Linux terminal that you can use for octave and other things. You can create all kinds of files. It works well with the online LaTex editor below.
**[http://www.sagemath.org/help-video.html Some SageMath Videos] I found the two Introduction videos very useful.
*[http://www.ptc.com/engineering-math-software/mathcad?ab_eid=491&ab_vid=94189&gclid=CjwKEAjw1f6vBRC7tLqO_aih5WISJAAE0CYwihsuWeadsqwBL38_IQofPffXZUCfFMmau725f_zk-BoCbkrw_wcB PTC Mathcad] works for Windows and costs something, but is available on the campus network.
*LibreOffice is an open source word processor.
*Microsoft Word is a fancy word processor that I think you can get for free or minimal cost when you are a WWU student.
*[https://www.maplesoft.com Maple] is a commercial symbolic mathematics package similar to maxima. It will do notebooks. It is available on the school network.
*[https://www.wolfram.com/mathematica/ Mathematica] is another commercial symbolic software package. I don't think it is available on the school network.
*[https://www-fourier.ujf-grenoble.fr/~parisse/giac.html Xcas is my current favorite open source alternative to Maple or Mathematica.] Xcas uses syntax compatible with the TI-89, or Maple, or muPad, or the TI NSpire CAS or Voyager 200. It runs on Windows, Linux, or OS X and is also available on Android for your phone, and I use it that way sometimes too. It is based on Giac which was chosen for the recent fancy HP CAS calculator, and for [https://www.geogebra.org/ Geogebra].
===Course Pages===
===Course Pages===
Line 65:
Line 116:
==Articles==
==Articles==
===Octave Tutorials===
===Octave Tutorials and Scripts for Learning===
[[Installing Octave on a Mac]] (Chris Lau)
====Octave Scripts for Learning====
[[An octave/MATLAB u(t) function example]]
[[An octave/MATLAB RC circuit example with Fourier series]] that shows how to use the ideas of the linear time invariant systems game and phasors to find the output due to a square wave input
[[An octave/MATLAB script to show the relation]]: <math>\int_{-\infty}^\infty e^{j2\pi ft} df = \delta(t)</math>
[[An octave/MATLAB script to show the Fourier series of a string of impulse functions]] is given by: <math>\sum_{k=-\infty}^\infty \delta(t-kT) = \sum_{k=-\infty}^\infty e^{-j2\pi kt/T}</math>
[[This octave/MATLAB script shows the effect of not sampling fast enough.]] You can also see how the bandpass sampling theorem works from the plot this produces if you are clever.
[[Octave and Scilab on a Mac]] (Ben Henry)
[[A octave/MATLAB script to show how Nyquist's formula]] for <math>x(t)</math> in terms of sample points <math>x(nT)</math>
[[ASN2 - Octave Tutorial]] (Jodi S. Hodge)
An [[FIR Filter Example Code for Octave]]/MATLAB
[[A u(t) function example]]
[[Demonstration of an Oversampling FIR Filter]]
[[FIR Filter Example Code for Octave]]
[[FIR Filter Design and Testing Using the DFT]]
[[Leakage Example Octave Script]]
[[Leakage Example Octave Script]]
[[Interpolation using the DFT Example Script]]
[[Interpolation using the DFT Example Script]]
[[An example showing how convolution is just a dot product]] or matrix multiply
[[Tuner Upper Removal Demonstration]]
[[Tuner Upper Removal Demonstration]]
[[Airplane Noise Removal Demonstration]]
[[Airplane Noise Removal Demonstration]]
====Octave/MATLAB Tutorials====
[http://people.duke.edu/~hpgavin/matlab.html A nice list of MATLAB tutorials from Duke University]
[http://octave-online.net/ Online Octave] This works in your browser.
[[Installing Octave on a Mac]] (Chris Lau)
[[Octave and Scilab on a Mac]] (Ben Henry)
[[Installing Octave (with the GUI) from source on Ubuntu]]
Fast Convolution Based on the FFT This reference shows how end effects are dealt with. To use the FFT for convolution, you need to do it in blocks, which leads to end effects, and more latency, but if your blocks are big enough, it speeds up the convolution.
The truncated Fourier series or DFT method of FIR filter design gives the best approximation of the desired frequency response in a least squared error sense, but it is not very good near discontinuities. The Parks-McClellan (Remez) iterative algorithm gives equal ripple in the pass band and stop band. This is the best in terms of minimizing the maximum error in each area, which is usually better in the real world. MATLAB/octave have automated functions to do that. See remez() in the Signals package of octave.
You can make your notebook here on the wiki, but there are other options, including things like writing you notes on paper and using photo processing software to make notes like the old class notes. You can also make screencasts or videos for your notebook.
JupyterLab: This is my current favorite for making notebooks with a "literate programming" approach. It allows you to mix prose and other things with your equations in LaTex or python or octave code that illustrate the concepts.
LaTex: I suggest opening opening the following sample file with any of the LaTex editors below. LaTex is a document processing language that you compile like C or other compiled languages. It does produce the nicest looking documents, but it takes a bit of expertise to do that. If you are bound for graduate school, it is well worth learning.
TexStudio works with Windows, Linux, and OS X, has a previewer, menus to help newbies, and is about the most featured LaTex editor I have tried.
Texmaker is a LaTex editor with preview and a bunch of menus that help to figure out what you need to type to get the effects you want. It works on Linux, Windows, and OS X.
Gummi is a LaTex editor with preview for Linux and Windows.
Online LaTeX Editor especially for equations. This is useful for other systems that take LaTex input when you don't know LaTex yet.
Lurch is a math editor for your desktop that will check your logic. For this class it is primarily useful as an easy editor for mathematical subjects.
wxMaxima is a document based GUI for the Maxima computer algebra system. You can do quite a bit of algebra and calculus in wxMaxima. The notebooks it produces look good, but not as good as LaTex documents, however, you can easily change them, and it will redo all the math with the changes. I found a bug in the version that come with Ubuntu 15.04 where it segfaults when you type in a parenthesis to one of the helpful windows that come up when using the menus. I solved it by using the nightly builds from Peter Pall. As with most of the tools here, it will integrate in with LaTex.
SageMath is a computer algebra system similar to wxMaxima that uses python, maxima and other tools to make a very nice and powerful tool for making a notebook. In order to make it work with the octave kernel, I had to use the latest version, which I obtained at the Ubuntu Sage wiki where I the instructions to install the upstream binary like this:
SageMath on the cloud uses sage (a computer algebra system) and latex to make your document. It has a nice preview that shows you what you get with your LaTex code. It also has a Linux terminal that you can use for octave and other things. You can create all kinds of files. It works well with the online LaTex editor below.
PTC Mathcad works for Windows and costs something, but is available on the campus network.
LibreOffice is an open source word processor.
Microsoft Word is a fancy word processor that I think you can get for free or minimal cost when you are a WWU student.
Maple is a commercial symbolic mathematics package similar to maxima. It will do notebooks. It is available on the school network.
Mathematica is another commercial symbolic software package. I don't think it is available on the school network.
Xcas is my current favorite open source alternative to Maple or Mathematica. Xcas uses syntax compatible with the TI-89, or Maple, or muPad, or the TI NSpire CAS or Voyager 200. It runs on Windows, Linux, or OS X and is also available on Android for your phone, and I use it that way sometimes too. It is based on Giac which was chosen for the recent fancy HP CAS calculator, and for Geogebra.
HW #6 - Pick a property of the Fourier Transform & present it on the Wiki. Make a table with all your properties. Interpret your property. (Ben Henry)(Chris Lau)(Victor Shepherd)
HW #9 - Add to #8 writeup how to do a decimating filter and figure out how many multiply & adds are needed for a n/2 decimating low pass filter.(Jodi S. Hodge)(Chris Lau)(Victor Shepherd)
HW #10 - Use Octave (or Mathlab or Silab) to plot the frequency response of low pass filters with cut off frequencies of 1/32T, 1/8T, and 1/4T and compare how many coeffficients are needed with an eye to answer the question "Is it less calculation to decimate and then filter, or better to put the filter in the pre-decimation filter?" (Jodi S. Hodge)(Victor Shepherd)
HW #11 - Is our method the same as Mark Fowler's? See
HW #12 - Experiment with a variety of signals having a 3Khz bandwidth to determine the resolution you can get when doing a cross correlation . You can generate the signals randomly and filter them to obtain the band-limited signals. (Jodi S. Hodge)
