try setting invalidateScrollerOnRefresh to true