FYI post:
If you have ever hit the „Remove all ports not used“ on PLCnext and are wondering how to get the not used ports back.
Just got to the project tab and hit rebuild. 
There might be another way, it was just not clear when I accidentality selected that button and wasted some time looking how to get them back.