Use Collapsiblock Module.
It allows you to set site wide definitions regarding default collapsing behavior, and also to set block specific definitions.
To set individual blocks, go to Administration » Structure » Blocks page, and use the configure link next to the block's name.