Im going to replace the filter, just as a maintenance point.
The only reason I truly don't think it's the filter, when I was cruising around at 55-60mph the bike was absolutely perfect. No hiccups, no slowdowns, not a thing. The issues are really only at idle.