From within Excel you can fetch issues from your filters (in settings you can enable shared filters) , or you can build your own JQL queries.

02. Fetching issues from Jira filter -- Excel Connector for Jira.mp4