Guys, is he REALLY shy or am I barking up the wrong tree?

The reason he said "I would be up for that..." is because he wasn't going to say something like "no way..."; Thats just rude behavior. You should ask him over to a drink sometime though. It could turn out nicely for you.