I'm a graduating senior in physics who switched into it from comp eng, so I can give a bit of a rundown:
The good:
In physics, we have a lot of really top-tier professors who do important research. If you want to do research as an undergrad, you'll have no problem finding a lab to work in, from condensed matter to accelerator physics.
The school is huge, so there are opportunities to take classes and do research outside of "pure physics". I spent a summer doing climate research with the environmental institute (I actually don't recommend it lol).
EE and Physics at PSU have the best undergrad advisors of any major: If you do EE, you'll probably have Professor Salvia as your advisor, who is one of the best human beings alive and an excellent teacher. If you do physics, you'll have Professor Robinett, the most helpful person I've met who is extremely knowledgeable about what you can actually do with your degree.
Overall, the courses are quality and if you put time into it you'll learn a lot.
If you really like EE but want to do physics, we have an electronics option in the physics major where you take some EE courses in place of a few upper-level physics electives.
The bad:
Unless you are a raging fratstar who likes binge drinking every weekend nonstop, the social scene in State College is absolutely horrible. To be fair, I've heard this is true at many universities, but it seems particularly bad here.
Especially in engineering, at least until you get into the upper levels, you are just a number for a while. There are so many hoards of students in engineering that you won't get much individual attention until all the normies have changed their majors after second year. (The physics classes are usually rather small, so you can avoid this).
I could say more but this is getting really long already