Had to look up the origin of this bad boy:
One theory holds that the term comes from the common diet of poor whites. According to the 1911 edition of the Encyclopedia Britannica, it is a term of contempt for the "poor" or "mean whites," particularly of Georgia and Florida. Britannica notes that the term dates back to the American Revolution, and is derived from the cracked corn which formed their staple food.[2] (In British English "mean" is also a term for tightfistedness,[3] with no malice implied.)
http://en.wikipedia.org/wiki/Cracker_(pejorative)
Interesting, is cracked corn the same as cornmeal though?