A family of Microsoft word processing software products for creating web, email, and print documents.
You can't have the borders drop down stay “open.” It is just a type of menu.
What you can do is display the Borders and Shading dialog box, as Suzanne suggested. On the Home tab, click the arrow on the border button to display the drop down and click Borders and Shading. See screen shot below.