How to set the outgoing email settings for the site?

The SMTP settings can be set from under Settings > SMTP.

Can I set the addresses for no-response and admin contact emails?

Yes. You will need to save email addresses for both from the admin panel. Go to Settings > Email and set both.