[ci] Sort out Travis configuration

Use a matrix to avoid a gazillion if's.
3 files changed