By default they won't. However if you've mucked with the anchor/dock then that impacts rendering. There are also some containers (like FlowLayoutPanel) that impact this.
Given your description it sounds like the impacted controls have their Anchor property set to Bottom. Note that Anchor must be set to something and the default of Top, Left should prevent the controls from moving anywhere as Top, Left of the parent never changes.