Howdy Jason!
Yes, the materials do make a noticeable difference in person to my ear (and most players I talk to). There is also a slight difference in grip and feel. I think a more drastic difference comes from tip shape. Before I bought a bunch of expensive picks to see what I like, I’d first explore the different shapes and textures a bit. I use the Ultex (both primetone and original) and they are inexpensive but sound and feel good enough that I don’t regret playing with them as opposed to my more expensive picks. Start with the inexpensive ones and give it some time before purchasing a bunch of $50 picks. You might find a favorite shape/texture/bevel and then when you do buy a high dollar one, you will know what suits you better.
Welcome back to playing, your guitar missed you!