If you refer to a group of people as a charmed circle , you mean that they seem to have special power or influence, and do not allow anyone else to join their group. ( LITERARY )
...the immense role played by this very small charmed circle of critics.
N-SING