Theming / Templating Guide?

Is there any guide on how to make a custom template?

Basically, I want to customize and change some of the HTML markup. I can see that there are lots of templates in the /template folder but if I'll change it, maybe it willl be overwritten again during an update?