I've been successful in customizing the template of my main index file, but now I would like to apply that same look to my archives as well as the comments screen.
I just dont know which template corresponds with what section...I know that sounds quite dumb...but the "rss" and other template names that I see on the config. menu are confusing me.
can someone help me out with this??

Have you read this? I find that the manual is always quite enlightening...

RSS has nothing to do with your archive pages or comments. However, the templates named "Date-based archive template", "Category archive template", "Individual archive template", "Comment Listing Template", "Comment Preview Template", "Comment Error Template" may be quite useful to you...