I would think ISV is the culprit. Probably stuck shut. Try cleaning and replace. Check for current/voltage to the connector. 2nd choice would be the throttle switch. Although if it fails open the RPM increase from what I remember. When closed tells the ISV to take over idle speed.