Knitting. Always see people do it on the subway or watching tv without paying attention or trying. Spent a few hours trying to learn once and couldn't do it.
Crochet for me. It took me forever to figure out how to do it - to even get one simple stitch done. Somehow I figured it out but it's still really hard