Anderson Acceleration

Anderson acceleration, also known in quantum chemistry as Pulay mixing or direct inversion in the iterative subspace (DIIS), is a technique for accelerating the convergence of a fixed-point iteration. It has been widely used in electronic structure computations, but does not seem to be well known to numerical analysts.

Anderson’s original paper is from 1965 and is well cited, as Google Scholar shows: and65-gs.jpg I learned about Anderson acceleration in the minisymposium Anderson Acceleration and Applications organized by Tim Kelley at the SIAM Conference on Computational Science and Engineering in Salt Lake City in March 2015. Tim gave an excellent overview of the topic in the opening talk. The slides for that talk are available on Tim’s website.

PhD student Nataša Strabić and I have shown that Anderson acceleration works very well for speeding up the alternating projections method for computing the nearest correlation matrix. It typically gives a reduction in the number of iterations by a factor at least 2 for the standard nearest correlation matrix problem and by at least a factor 3 when additional constraints are imposed on the matrix (specified elements fixed and a lower bound on the smallest eigenvalue). In some cases the reduction is by a factor of as much as 25. Since the overhead of Anderson acceleration is small, significant speedups are obtained.

In my 2013 post The Nearest Correlation Matrix I included a MATLAB code nearcorr.m. In place of this I now recommend our new accelerated code nearcorr_aa.m, which is available from the repository anderson-accel-ncm on GitHub. Our paper describing this work is available on MIMS EPrints.

For me this project is an excellent illustration of the importance of going to conferences in order to learn of new ideas and new developments.

Posted in research | Tagged , , | Leave a comment

The Princeton Companion to Applied Mathematics

For the last five and a half years I have been editing and writing The Princeton Companion to Applied Mathematics. I’m pleased to announce that the project is at the final stage, with the PDF file delivered to Princeton University Press and the book scheduled for publication in September 2015.

Over the coming months I will produce a variety of posts on this blog about the book. The book also has a Twitter feed, @ThePCAM, which will contain relevant news and links.


What does The Companion do? Briefly, it

  • introduces applied mathematics and its history, and explains what applied mathematicians do,
  • describes key concepts and equations, functions, and laws,
  • describes the main areas of current research,
  • presents a selection of mathematical modelling problems,
  • gives short examples of applied mathematics problems,
  • describes applications at the interface with other areas, and
  • covers general aspects of writing, teaching and promoting mathematics.

Here are some statistics:

Pages xvii + 994 + 16 color plates
Articles 186
Authors 165 from 23 countries
Figures 196 monochrome + 23 colour
Cross references 751
Index 2842 entries over 33 pages

The target audience for The Companion is mathematicians at undergraduate level or above, students, researchers, and professionals in other subjects who use mathematics, and mathematically interested lay readers. Some articles will also be accessible to students studying mathematics at pre-university level.

The book was edited by me and associate editors

Copy editing, typesetting, and project management were done by Sam Clark (T&T Productions, London), and the indexer was Julie Shawvan. The Princeton University Press editors were Anne Savarese and Vickie Kearn. For an interview with Vickie, see The Science of Loving Math.

The Companion already has pages on and from which it can be pre-ordered, and it is in the Fall 2015 PUP catalogue (page 62).

Here is a word cloud for the book, generated using Wordle (also available in a high resolution PDF version):


Posted in Princeton Companion | Tagged | 1 Comment

50 Years of the Biennial Conference on Numerical Analysis

Last week (June 23-26, 2015) around 200 numerical analysts congregated in Glasgow for the 26th Biennial Conference on Numerical Analysis, held at the University of Strathclyde. This was the 50th anniversary of this biennial conference, the first of which was held in 1965 at St. Andrews University. The original meeting, organized by Ron Mitchell, Mike Osborne, Donald Kershaw and Jack Lambert, was titled Symposium on the Solution Of Differential Equations, lasted two days, and attracted about 25 people. Ron Mitchell moved in 1967 to a chair at Queen’s College, Dundee, which become the University of Dundee in the same year, so the conference continued at Dundee, where it stayed until 2007, organized by Alistair Watson and David Griffiths.

Since 2009 the meeting has been hosted at the University of Strathclyde. The Conference Organizing Committee of Philip Knight, John Mackenzie, and Alison Ramage have introduced various innovations, such as minisymposia and, this year, Scottish country dancing (optional!). This year also saw the introduction of the Fletcher-Powell Lecture, honouring Mike Powell (who sadly passed away earlier this year) and Roger Fletcher, given by Michael Saunders (Stanford). In his introduction to the lecture, Nick Gould emphasized the crucial role that Fletcher and Powell played in developing the field of nonlinear optimization, starting in the 1960s. A Storify is available summarizing tweets about the conference.

An excellent history of the conference was written by Alistair Watson in 2006 and is available on his website. Alistair’s article was invaluable in preparing my after-dinner speech. The conference dinner was held in the impressive Òran Mór, a converted church in the west end of Glasgow. The dining area is seen in the photo below, from the vantage point of a balcony.


Posted in conferences | Leave a comment

My Dot Emacs

I have been using Emacs on Unix systems since the 1980s. The vast majority of my work is done on PCs, though, and from about 1988 until 2011 I used an editor for the PC called Qedit, later renamed TSE Pro, from The SemWare Corporation. TSE Pro is small, fast, and highly customizable via its own macro language. I customized it to my preferences over many years, in particular for use with \LaTeX, and wrote four books and many papers with it. When I acquired a Mac laptop in 2009 I realized that I needed to switch to an editor that runs on both Windows and Mac, so after trying Vim and Emacs (and temporarily using TextMate on the Mac) I switched to Emacs.

My past use of Emacs had mainly been to send emails or edit web pages, often over a terminal connection, and I had not realized how fast Emacs was—nor that one could issue commands by typing Alt- instead of the two consecutive keys Esc .


Emacs interrupted by a train, courtesy of

Since 2011 I have used Emacs exclusively and have built up my dot emacs to its current size of nearly 3000 lines. For non-Emacs users, a dot emacs (.emacs) file is an Emacs Lisp file that is read and executed when Emacs loads, and it is where one sets customizations and loads packages.

I have now made my dot emacs file available on Github.

A few notes:

  • Some of the code uses conditional tests to see whether Emacs is running on a Windows machine or a Mac machine and take different action in each case.
  • The code is lightly documented with links to sources for the things I am using.
  • I have recently started using John Wiegley’s use-package for loading packages. Not everything is converted and I may convert other package to load this way. Use-package has several advantages:
    • It makes the dot emacs more readable.
    • It makes it easy to disable a package, by adding a line “:disabled t”.
    • It speeds up the loading of Emacs by delaying loading of packages until they are first used. When I first started using use-package my Emacs load time dropped from 8 seconds to 5 seconds.
  • I do not use the Emacs package manager, but rather download packages manually and place them in ~/dropbox/elisp. The one exception is the Helm package, which I was unable to install manually.
  • I spend most of my time in Emacs in org-mode, latex-mode, or bibtex-mode, so quite a lot of my dot emacs concerns those modes.
  • I recently started using Oleh Krehel’s hydra package, which was released at the start of the year. It provides a nice way to set up key bindings based on a prefix key and provides a reminder at the bottom of the screen about possible subsequent keypresses.

You should not expect to be able to take my dot emacs and use it as is, because many of the packages that are loaded will not be present on your system in the expected location. However, the main benefit of sharing Emacs configurations is that one can copy and adapt pieces of code.

My dot emacs is long, and I have trouble remembering all the features I have set up, even though I have an even longer file that contains notes and a summary of my customized keypresses.

I still use TSE Pro: to edit my dot emacs file when an error introduced therein causes Emacs to fail to start properly! (Of course, I could also use emacs -q, which inhibits loading of the .emacs, but I like to keep my hand in with TSE Pro).


Posted in Emacs | Tagged | Leave a comment

Numerical Methods That (Usually) Work

A book that inspired me early in my career is Numerical Methods That Work by Forman S. Acton, published in 1970 by Harper and Row. Acton, a professor in the electrical engineering department at Princeton University, had a deep understanding of numerical computation and the book captures his many years of experience of practical problem solving using a combination of hand computations and early computers.


Although written in the 1960s, Acton’s book is more about the 1950s world of computation; it makes only brief mention of the QR algorithm for eigenvalues and does not cover the singular value decomposition or variable step size ODE solvers. Moreover, the author has an aversion to library routines and to rigorous error bounds. Acton states that the students who have attended his numerical methods course have mostly “been Engineers and Scientists. (Mathematicians at Princeton are proudly Pure while most Computer Scientists find an obligatory decimal point to be slightly demeaning.)”. What, then, is special about this book from an applied mathematics point of view?


(c) Princeton University Press Office of Communications

The book promotes timeless principles that are taught less and less nowadays. A general theme is to analyze a problem and exploit its structure, before applying the simplest suitable numerical method. One example that has stuck with me is the idea of trying to treat a given equation as a perturbation of an easier equation. For example, a quadratic equation \epsilon a x^2 + bx + c = 0 with small |\epsilon| can be thought of as a small perturbation of the linear equation bx + c = 0. Then simple fixed point iteration can be used to solve the quadratic with -c/b as a (good) starting value.


The book is particularly strong on estimation or evaluation of integrals, dealing with singularities in functions, solving scalar nonlinear equations, exploiting asymptotic series, and avoiding instabilities. Several of these issues arise in the “railroad rail problem” presented at the start of the book, which every serious user of numerical methods should have a go at solving.

The pièce de résistance of the book is undoubtedly the 13-page “Interlude: What Not to Compute”. Described as a “cathartic essay” by James Daniel in SIAM Review in 1971, this essay is as relevant as ever, though Acton’s professed dislike of recursive calculations seems dated now that most programming languages fully support recursion.

Contemporary reviewers all note the practical slant of the book. I particularly like H. F. Trotter’s comment that “this reviewer, for one, would find it easier to supply theoretical discussion to supplement this text than to supply the lively practicality that is not always present in other books on this subject” (American Scientist, 59 (4), 1971). As this comment indicates, not only is the book full of excellent advice, but it is written in a distinctive and highly entertaining style. Here are a few examples:

  • “Newton’s predilection for wandering off to East Limbo on encountering a minimum” (On Newton’s method for solving nonlinear equations.)
  • “Only a socially irresponsible man would ignore such computational savings.” (On methods with operation counts proportional to n^2 versus n^3, respectively.)
  • “Many theorems are available for your pleasure.” (About positive definite matrices.)

The typesetting is excellent. One could hardly do better in \LaTeX. Moreover the diagrams are a paragon of good, minimal design and would not be easy to equal with today’s drawing packages.

In the original book the title on the cover is embossed in silver and the word “Usually” has been inserted, unembossed, just before “Work”. In the 1990 reprint by the Mathematical Association of America the “Usually” is in feint grey text. The reprint includes an extra “Preface-90”, an “Afterthoughts” (the quote in the first paragraph is taken from the latter), and some extra problems. The reprint is available on Google Books


In 1996 Acton, by then an emeritus professor of computer science, published a second book Real Computing Made Real: Preventing Errors in Scientific and Engineering Calculations with Princeton University Press. It contains similar material on a smaller range of topics, and didn’t have the same impact on me as Numerical Methods that Work. Indeed, being published 26 years later it feels much more out of date. Unlike the first book, this one does mention Gaussian quadrature, but only to advise against its use. This book is now out of print at PUP but is available from Dover and at Google Books.

Acton died in 2014. Some brief biographical information can be found at a Wikipedia page, a Princeton University obituary, and a tribute from a former student.

Posted in books | Tagged | Leave a comment

Michael J. D. Powell (1936–2015)

I would like to share a couple of photos of Mike Powell, FRS, who passed away last month. The photos are from early and late in his career.

The first is one of a set of contact prints from a role of Kodak black and white film that I came across in a collection of photos belonging to Gene Golub, which I was able to look through after Gene’s death in 2007. It is clear from the complete set of images that they were taken in or around the Courant Institute. The photos are undated, but Olof Widlund (who appears in some of them) tells me that the photos are most likely from 1965-1966.


The second image is from June 2013 and was taken at the banquet at the Biennial Conference in Numerical Analysis at the University of Strathclyde. Mike is flanked on his right by Iain Duff and on his left by Juan Meza. Mike was a regular attendee at this conference and starting at next month’s conference there will be a regular Fletcher-Powell Invited Lecture, honouring Roger Fletcher and Mike Powell’s contributions to numerical analysis and, particularly, nonlinear optimization.


A memorial web site for Mike has been set up.

Posted in people | Tagged | Leave a comment

Publication Peculiarities: Titles


In this post in my series on publication peculiarities I look at titles (the first post was about papers as a whole). The paper titles below all have something interesting about them.

I have tried to give links to all the papers mentioned. Where one is not given the paper is (to my knowledge) not officially available on the web, although it may be nevertheless findable using Google Scholar.

Shortest Title

Here are some contenders for the shortest title (the first and third of these are taken from page 146 of my Handbook of Writing for the Mathematical Sciences, SIAM, 1998, second edition). Note that the following titles are all clickable, even though they are not underlined.

Charles McCarthy, c_p, Israel J. Math. 5(4), 249-271, 1967.

F. Brezzi, L. P. Franca, T. J. R. Hughes and A. Russo, b = \int g, Comput. Methods Appl. Mech. Engrg. 145(3-4), 329-339, 1997.

Norman Meyers and James Serrin, H=W, Proc. Natl. Acad. Sciences USA 51, 1055-1056, 1964.

Mitchell Feigenbaum and David Mermin, E=mc^2, American Journal of Physics 56, 18-21, 1988.

The last three titles have the virtue of forming a complete sentence with subject, verb and object.

Title Inspired by Film

Olivier Ledoit and Michael Wolf, Honey, I Shrunk the Sample Covariance Matrix, J. Portfolio Management 30(4), 110-119, 2004.

The next paper, referring to The Blair Witch Project (1999), uses a photo of Tony Blair to compare different colour maps:

Bernice E. Rogowitz and Alan D. Kalvin, The “Which Blair Project”: A Quick Visual Method for Evaluating Perceptual Color Maps, 183-556, in Proceedings of IEEE Visualization 2001, 2001.

Typo in Title

It is quite rare for a title to contain a typo. Here is an example

S. W. Ellacott and E. B. Saff, On Clenshaws’s Method and a Generalisation to Faber Series, Numer. Math., 52, 499-509, 1988.

In the body of the paper (in particular on the last line of the first page) the correct usage “Clenshaw’s” appears.

In the next example “Lambert W” is correctly spelled in the body of the paper, though not in the title:

M. M. Sherrif, N. S. Ravindran and P. Krishnapriya, Stability Analysis For Tumour Growth Model Through the Lambertz W Function, Journal of Advances in Mathematics 7(1), 1140-1146, 2014.

This paper has an incorrect spelling of Riccati:

George E. Trapp, Jr., The Ricatti Equation and the Geometric Mean, pages 437-445, in B. N. Datta, e.d., Linear Algebra and Its Role in Systems Theory, Contemporary Math., 47, 1985.

The next paper has a common grammatical error in the title:

A. A. Gurjar, S. Ladhake and A. Thakare, Analysis Of Acoustic of “OM” Chant To Study It’s Effect on Nervous System, International Journal of Computer Science and Network Security 9, 363-367, 2009.

The original 1942 edition of

Paul Halmos, Finite-Dimensional Vector Spaces, viii+200, Springer-Verlag, 1958.

was titled Finite Dimensional Vector Spaces, without the hyphen. Halmos explained that he became convinced of the need for the hyphen by the time of 1958 edition.

Finally, one should be aware that there can be errors in metadata if not in a paper itself. The title of

B. Wie, H. Weiss and A. Arapostathis, Quaternion Feedback Regulator for Spacecraft Eigenaxis Rotations, Journal of Guidance, Control, and Dynamics 12, 375-380, 1989.

has no typos, but the journal’s metadata at the above link, including the title displayed on the web page, has the typo “quarternion”.


Authors like enumerating things. Here we count to ten in paper titles.

H. F. Baker, The Reciprocation of One Quadric into Another, Proc. Cambridge Philos. Soc. 23, 22-27, 1925.

Donald Knuth, Two Notes on Notation, Amer. Math. Monthly, 99, 403-422, 1992.

Thomas Quinn, Scott Tremaine and Martin Duncan, A Three Million Year Integration of the Earth’s Orbit, Astron. J. 101, 2287-2305, 1991.

K. Appel and W. Haken, Every Planar Map is Four Colorable. Part I: Discharging, Illinois J. Math. 21, 429-490, 1977.

David Anderson, Tom Kilburn: A Tale of Five Computers, Comm. CACM, 57, 35-38, 2014.

Ergin Elmacioglu and Dongwon Lee, On Six Degrees of Separation in DBLP-DB and More, SIGMOD Rec. 34, 33-40, 2005.

Brian McCartin, Seven Deadly Sins of Numerical Computation, Amer. Math. Monthly, 105, 929-941, 1998.

E. C. Berkeley, Eight Hundred People Interested in Mechanical Brains, Amer. Statist., 4, 11-12, 1950.

Desmond Higham, Nine Ways to Implement the Binomial Method for Option Valuation in MATLAB, SIAM Review, 44, 661-677, 2002.

Gian-Carlo Rota, Ten Lessons I Wish I Had Been Taught, Notices Amer. Math. Soc., 44, 22-25, 1997.

As for continuing beyond 10, I will just pick out two specific cases.

Joseph Lee Rodgers and Alan Nicewander, Thirteen Ways to Look at the Correlation Coefficient, Amer. Statist., 42, 59-66, 1988.

Cleve B. Moler and Charles F. Van Loan, Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five years Later, SIAM Review, 45, 3-49, 2003.


This category refers to titles that are looking at a topic from a higher perspective.

Michael Berry, Why Are Special Functions Special?, Physics Today 54, 11-12, 2001.

Barbara Kitchenham, Pearl Brereton, David Budgen, Mark Turner, John Bailey and Stephen Linkman, Systematic Literature Reviews in Software Engineering—A Systematic Literature Review, Information and Software Technology 51, 7-15, 2009.

The final article is somewhat controversial: see The Tears of Donald Knuth.

Martin Campbell-Kelly, The History of the History of Software, IEEE Annals of the History of Computing 29, 40-51, 2007.

Shakespearean Titles

Now we are looking for titles that make reference to a Shakespearean play.

R. W. Bemer, Towards Standards for Handwritten Zero and Oh: Much Ado About Nothing (and a Letter), or a Partial Dossier on Distinguishing Between Handwritten Zero and Oh, Comm. ACM 10, 513-518, 1967.

William Kahan, Branch Cuts for Complex Elementary Functions or Much Ado About Nothing’s Sign Bit, in A. Iserles and M. J. D. Powell, eds, The State of the Art in Numerical Analysis, Oxford University Press, 1987, pages 165-211.

Peter Hall, A Comedy of Errors: The Canonical Form for a Stable Characteristic Function, Bull. London Math. Soc. 13, 23-27, 1981

Joel David Hamkins, Destruction or Preservation as You Like It, Annals of Pure and Applied Logic 91, 191-229, 1998


Someone whose titles I have often admired is William (Velvel) Kahan (he has already appeared in the previous section). I particular like his alliterative

William Kahan, Conserving Confluence Curbs Ill-Condition, Technical Report number 6, Computer Science Department, University of California, Berkeley, 1972.

and the pun in

William Kahan and Beresford N. Parlett, Can You Count on Your Calculator?, Memorandum No. UCB/ERL M77/21, Electronics Research Laboratory, College of Engineering, University of California, 1977.

If you know of further interesting titles please add them to the comments below.

Posted in writing | 1 Comment

Publication Peculiarities: Papers

I read a lot of papers. I also glance at many papers in journal contents pages and Google search results. From time to time I notice a paper that has an interesting title, author list, abstract, or some other notable feature. This post is the first in a series collecting such publication peculiarities. It concerns papers with striking features other than the title, author list, or abstract. The rules of the game are that I prefer examples from mathematics and related areas and that I must be able to provide a link to the article in question.

If you know of other good examples, please add them in the comments box at the end of this post.

The Letter W

The paper

Brian Hayes, Why W?, American Scientist 93, 104-108, 2005,

which is about the Lambert W function, has the remarkable feature that every sentence contains at least one instance of the letter “w” (as the author admits in the final section). There does not appear to be a word for the result of this constrained writing, but it is a kind of opposite of a lipogram: a text in which a certain letter is avoided entirely.

A Computer Program

Charles Lindsey was a Senior Lecturer in the Department of Computer Science at the University of Manchester and was one of the designers of the language Algol 68. I took a course on programming languages from him when I was a student. His paper

Charles H. Lindsey, ALGOL 68 with fewer tears, Comput. J. 15 (2), 176-188, 1972

is a syntactically valid Algol 68 program. Nowadays we would call this literate programming!


The paper

Clifford Truesdell, Solutio Generalis et Accurata Problematum Quamplurimorum de Motu Corporum Elasticorum incomprimibilium in Deformationibus valde Magnis, Arch. Rational Mech. Anal. 11, 106-113, 1962

has been described by Ball and James (in The Scientific Life and Influence of Clifford Ambrose Truesdell III) as “perhaps the only serious scientific paper published in Latin in the 20th century”.

Shortest Paper

A contender for shortest paper is

L. J. Lander and T. R. Parkin, Counterexample to Euler’s Conjecture on Sums of Like Powers, Bull. Amer. Math. Soc. 72, 1079, 1966,

which consists of just two sentences. However, brevity is taken to extremes in the next paper, for which writer’s block led to an empty body:

Dennis Upper, The Unsuccessful Self-Treatment of a Case of “Writer’s Block”, Journal of Applied Behavior Analysis 7, 497, 1974.

This experiment has been successfully replicated:

Geoffrey Molloy, The Unsuccessful Self-Treatment of a Case of “Writer’s Block”: A Replication, Perceptual and Motor Skills 57, 566, 1983,

Robert Didden, Jeff Sigafoos, Mark O’Reilly, Giulio Lancioni and Peter Sturmey, A Multisite Cross-Cultural Replication of Upper’s (1974) Unsuccessful Self-Treatment of Writer’s Block, J. Appl. Behav. Anal. 40, 773, 2007.

Order of Authors

Most fields have conventions about the order in which author names appear. The authors of the paper

M. P. Hassell and R. M. May, Aggregation of Predators and Insect Parasites and its Effect on Stability, Journal of Animal Ecology 43, 567-594, 1974

state that “The order of authorship was determined from a twenty-five-game croquet series held at Imperial College Field Station during summer 1973.”

First Word

The first word of the first article in the journal Nature was, appropriately, “Nature”:

T. H. Huxley, Nature: Aphorims by Goethe, Nature 1(1), 9-11, 1869.


Occasionally, a paper contains something the authors meant to remove before publication. The originally published version of the paper

Zachary W. Culumber, Christian E. Bautista-Hernández, Scott Monks, Lenin Arias-Rodriguez and Michael Tobler, Variation in Melanism and Female Preference in Proximate but Ecologically Distinct Environments, Ethology 120, 1090-1100, 2014

contained the sentence

Although association preferences documented in our study theoretically could be a consequence of either mating or shoaling preferences in the different female groups investigated (should we cite the crappy Gabor paper here?),

Some time after the paper was published it was updated, with the parenthetical phrase replaced by “(Gabor 1999)”.

Posted in writing | 2 Comments

Numerical Linear Algebra Group 2014

The Manchester Numerical Linear Algebra group was very active in 2014. This post summarizes what we got up to. Publications are not included here, but many of them can be found on MIMS EPrints under the category Numerical Analysis.

A new venture for several of us this year was to make our software available on GitHub: Deadman, Higham, Relton, Sego, Zhang.


PhD Students

Three students successfully defended their theses:

Sam and Leo are now postdoctoral Research Associates in the group. Ramaseshan is a Senior Engineer at Arup, working in the Manchester office.

Weijian Zhang joined the group in September as a PhD student working with Nick Higham.

Sam Relton and Mary Aprahamian served as President and Treasurer, respectively, of the Manchester SIAM Student Chapter.

Postdoctoral Research Associates (PDRAs)

Jennifer Pestana joined the group in January, from Oxford University, to work with Françoise Tisseur.

Javier Perez joined the group in September, to work with Françoise Tisseur.

Tim Butters joined the group in January to work as a postdoctoral Knowledge Transfer Associate with Stefan Guettel and Nick Higham, in a project with Sabisu.

Lijing Lin (2007-2014) left the group in September to take up a Research Associate position in the Faculty of Life Sciences at The University of Manchester.

Amal Khabou (2013-2014) left in September to take up a Maître de conférences position at Université Paris Sud.

Meisam Sharify (2013-2014) left in May to take up a post as Assistant Professor in the Department of Computer Science, Shahid Beheshti University, G.C. Tehran, Iran.


Members of the group gave presentations at the the following conferences and workshops.

IMA Conference on the Mathematical Challenges of Big Data, London, December 16-17, 2014 (Higham).

Structured Numerical Linear and Multilinear Algebra: Analysis, Algorithms and Applications, Kalamata, Greece, September 8-12 2014 (Noferini).

Spectral Theory Workshop to celebrate the 70th birthday of Brian Davies, King’s College London, 30 October 2014 (Tisseur).

4th IMA Conference on Numerical Linear Algebra and Optimisation, Birmingham, September 3-5, 2014 (Aprahamian, Berljafa, Khabou, Pestana, Relton, Strabić, Tisseur).

11th World Congress on Computational Mechanics, Barcelona, 20-25 July 2014 (Kannan).

International Workshop on Operator Theory and Applications, Amsterdam, July 14-18, 2014 (Tisseur).

SIAM Annual Meeting, Chicago, July 7-11, 2014 (Aprahamian, Deadman, Guettel, Lotz, Zhang).

First Joint International Meeting RSME-SCM-SEMA-SIMAI-UMI, Bilbao, June 30-July 4, 2014 (Noferini).

Householder Symposium XIX on Numerical Linear Algebra, Spa, Belgium, June 8-13, 2014 (Deadman, Guettel, Higham, Khabou, Lin, Noferini, Pestana, Taslaman, Tisseur).

10th International Workshop on Accurate Solution of Eigenvalue Problems (IWASEP10), Dubrovnik, Croatia, June 2-5 (Sego, Strabić).

Structured Matrix Days, XLIM, Université de Limoges, France, May 26-27, 2014 (Noferini).

Advances in Numerical Algorithms and High Performance Computing, University College London, April 14-15, 2014 (Deadman, Higham, Relton).

Napier 400th Anniversary Celebrations: Computation in Mathematics Workshop, ICMS, Edinburgh, April 2, 2014 (Higham: Video podcast).

Workshop on Nonlinear Eigenvalue Problems, The University of Manchester, April 23-25, 2014 (organized by Tisseur, Pestana, Kressner and Michiels and attended by the whole group).

Annual Meeting of the International Association of Applied Mathematics and Mechanics, Erlangen, March 10-14, 2014 (Guettel).

International Workshop on Eigenvalue Problems: Algorithms; Software and Applications, in Petascale Computing March 7-9, 2014 Tsukuba, Japan (Guettel, Tisseur).

2014 SET for BRITAIN exhibition at the House of Commons (Mary Aprahamian presented a poster).

Conference and Workshop Organization

The group organized three events in Manchester.

Several minisymposia were organized:


Vedran Sego visited the group throughout 2014.

Zhi-Gang Jia from Jiangsu Normal University, China, visited the group August 2013-July 2014.

Philip Gill (UC San Diego) and Margaret Wright (New York University) both visited for two weeks in March.

Jan Papež, a PhD student at the Academy of Sciences of the Czech Republic, Prague, visited for a week in November.

Marcel Schweitzer, a PhD student at the Universit of Wuppertal, visited the group for one week in September 2014.

Vladimir Druskin (Schlumberger-Doll Research Center, Cambridge, USA) visited the group for one week in June 2014.

Daniel Ruprecht (Università della Svizzera Italiana) and Robert Speck (Jülich Supercomputing Centre) visited the group for one week in February 2014.

Massimiliano Fasi, an M.Sc. student at the University of Bologna, Italy, visited for a week in November. He will join the group as a PhD student in September 2015, funded by a University of Manchester President’s Doctoral Scholarship Award.

Caterina Fenu, a PhD student at the University of Cagliari, Italy, visited for a week in November.

Knowledge Transfer

In The Knowledge Transfer Partnership with Sabisu, involving KTP Associate Tim Butters, Stefan Guettel, Nick Higham, and Jon Shapiro (School of Computer Science), an alarm management system has been developed and launched as a product.

Recognition and Service

Françoise Tisseur was awarded a Royal Society Wolfson Research Merit Award (2014-2019) to support her work on the numerical solution of nonlinear eigenvalue problems.

Former PDRA Yuji Nakatsukasa (2011-2013) was awarded the Householder Prize 2014 for his PhD thesis “Algorithms and Perturbation Theory for Matrix Eigenvalue Problems and the Singular Value Decomposition” (2011), written at the University of California, Davis.

Nick Higham served on Subpanel 10, Mathematical Sciences, in the Research Excellence Framework (REF) 2014.

Françoise Tisseur served as

  • Vice-President of the UK & Republic of Ireland SIAM Section,
  • Program Director of the SIAM Activity Group on Linear Algebra,
  • Member of the Householder Prize Committee 2014.
Posted in research | 1 Comment

More Tips on Book and Thesis Writing

Following my earlier post Top Five Tips on Book Writing, here are seven more tips. These apply equally well to writing a thesis.


Book sculpture at Fudan University, Shanghai.

1. Signpost Citations

In academic writing we inevitably include a fair number of citations to entries in the bibliography. In a book, even more so than in a paper, we do not want the reader to have to turn to the bibliography every time a citation is reached in order to understand what is being cited. So a sentence such as

The matrix logarithm appears in a wide variety of applications
[2], [8], [14].

is better phrased as the more informative

The matrix logarithm appears in a wide variety of applications,
such as reduced-order models [2], image registration [8],
and computer animations [14].

Likewise, instead of

Versions of the algorithm have been developed by several authors
[1], [3], [7].

I would write

Versions of the algorithm have been developed by Chester [1], 
Hughes [3, Sec. 2], and Smith and Jones [7].

Even that example lacks information about the date of publication. In my books I have used my own version of the \LaTeX \cite macro that allows me to include the year:

Versions of the algorithm have been developed by Baker and
Chester [1, 2006], Hughes [3, 2001, Sec. 2], 
and Smith and Jones [7, 2004].

The macro is


(which puts the year in the distinctive math italic font) and the first two citations in the previous sentence would be typed as \ycite[2006]{bach06} and \ycite[2001, Sec.~2]{hugh01}.

2. Produce a Good Index

A good index is essential, since it is the main way that readers can find content. The vast majority of books that I read have an inadequate index, as I have noted in my post A Call for Better Indexes at SIAM Blogs. Usually the index is too small. Occasionally the index is of about right length but is flawed. The main problems are

  • Items that should be indexed are absent from the index.
  • An index entry does not point to all (significant) occurrences of the term.
  • Related entries are not grouped properly.

Advice on producing an index can be found in Section 13.4 of my Handbook of Writing for the Mathematical Sciences and various other sources (try a Google search), and I intend to wrote a post on indexing soon.

\LaTeX, through its \index command, used in conjunction with the MakeIndex program, provides an excellent way to produce an index.

3. Use the Backref \LaTeX package

Backref.sty is a \LaTeX package that adds to each bibliography entry the text “cited on pages” and then lists the pages on which that item was cited. It costs nothing to use it, but it adds great value to the bibliography, which then functions as a separate index into the book. I started using backref with my book MATLAB Guide (2005). To a large extent it removes the need for an author index, and if I do a third edition of Accuracy and Stability of Numerical Algorithms I will probably use backref and drop the author index.

The backref package is not widely used, though a number of SIAM books have made use of it.

4. Use Hyperlinks

For a book provided in PDF form, hyperlinks from an equation reference to the equation, a citation to the bibliography entry, a URL to the web page, and so on, are a great aid to the reader. In \LaTeX obtaining the hyperlinks is usually just a matter of adding \usepackage{hyperref} in the pre-amble.

5. Make Figures Readable and Consistent

It’s very easy nowadays to produce figures containing plots of functions or computational results. But it’s much harder to produce a set of figures that

  • are clearly legible,
  • have labels, legends, and annotations that are of similar size to the main text,
  • are consistent in format (axes, line thicknesses etc.)

All too often I see figures in which the text is so small that I cannot read it at a normal reading distance. My experience (which is mainly with MATLAB, and with the \LaTeX packages TikZ and PGFplots) is that it is a time-consuming process to produce high quality plots. But it is worth the effort.

6. Use Short Captions in the List of Figures/Tables

The general form of the \LaTeX caption command is \caption[short caption]{long caption}. The short caption is what is printed in the List of Figures or List of Tables at the front of the book, if you are printing those lists. The short caption will be read in isolation from the figure or table so it should omit all unnecessary detail, such as explaining line or marker types. All too often, the short and long captions are the same, resulting in unnecessarily long and detailed lists of figures or tables.

Here is an example (simplified, with other macros removed) of the caption from a figure in my book Functions of Matrices:

\caption[Illustration of condition (b) of Theorem~11.4.]%
        {Illustration of condition (b) of Theorem~11.4,
         which requires every eigenvalue of $B$ to lie in the
         open half-plane (shaded) of the corresponding eigenvalue
         of $A^{1/2}$.}

7. Make the Header Contain the Section and Chapter Number and Title

I like to know where I am when I am reading a book, so I expect the page headers to tell me the section number and chapter number, and preferably their titles as well. I cannot understand why some books omit this information. Without it, phrases such as “as discussed in the previous chapter” become harder to follow up, and searching for a particular section is more difficult.

Posted in books, LaTeX, writing | Leave a comment