"This is an amazing service"
— Matthew Snider What They Say

How can I make the calendar start the week on Sunday?

You can go to Settings > General to make Week Starts On Sunday instead of Monday (the WordPress default).