How do I set the site name and tagline?

To set the site name and tagline, go to Settings > General on your dashboard. Here, you can set/edit the same.

Can I change the site language to anything other than English?

Yes, this is possible. Go to Settings > General and use the highlighted option to choose any language from the dropdown.