Phallus is what the shape is called. It applies to all objects of that shape, it's not another word for penis.
Um...there is a distinction depending upon usage.
A "phallic symbol" is, as you stated, all objects of that shape.
However, strictly speaking, the term "phallus" means exactly what it is supposed to mean -- a penis.