Hi Mayank,
Are all your add on's forms having the same 'FormType' ?
Form setting controls by the FormType, if you are having different formtype, it should not have hide the column in other addon forms.
I assume the form is not a system form.
Another way is, If you are creating the form using XML, there is a property in the xml column definition 'visible' you can set it to '0'.
Regards
Edy