The section is the answer, but what have you put in your section ? Normally, if you create a section and put content in it for exemple a folder, each node which will be published under this folder will be in the section. You can check it in the Setup > Sections panel.
So if you publish a node in the Standard section it will be directly published.
