I found that we can only take filegroup offline through t-sql,but to bring that filegroup online we need to restore the whole database.
There is no T-SQL command to take a filegroup offline, though an individual file can be set offline.
From the documentation, ALTER DATABASE File and Filegroup Options (Transact-SQL):
Use this option only when the file is corrupted and can be restored. A file set to
OFFLINEcan only be set online by restoring the file from backup. For more information about restoring a single file, see
To relocate files, follow the instructions in the documentation, or see the related Q & A: