That is because they do not have the necessary permission. So for example they do not have permission to create contents of type (article, blog, basic page and product) in your case. And I want to believe you don't want anonymous users to create products, pages, e.t.c.
To assign anonymous users new permissions, go to admin/people/permissions