google sitemap question

I have added some new pages to my site. Well, more like recycled some
old ones that were redundant. I 301'd the old pages to the new and added
the new to the google sitemap. However, I forgot to remove the old ones
that I 301 redirected from the google sitemap. I think I should probably
remove them, but does it actually matter?

Thanks,

Jez.