Isn't it the same for all sports? You are more involved in the stadium?
The reason is probably booze.
I'm fine watching football, Tennis, Rugby etc at home but I just struggle with cricket when it's on the TV
I'm not saying it makes sense, it's just how it is