How to remove cog icon and subsequent sticky layout box in homepage?

This is default demo setting. You can open Appearance -> Theme Options -> Layout -> Uncheck "Show demo setting panel" option.