Pubs are, disturbingly, where I hatch most of my best idea-sculptures: possibly it's something to do with the disinhibiting effects of alcohol, or maybe it's just having company to yack at.
Many science fiction writers are literary autodidacts who focus on the genre primarily as a literature of ideas rather than as a pure art form or a tool for the introspective examination of the human condition. I'm not entirely at ease with that self-description.
The paucity of near-future U.S. scifi is about the country becoming pessimistic, not being able to see the future clearly. There's a trend in U.S. scifi towards militarism and far-future stuff.
I think that if there's one key insight science can bring to fiction, it's that fiction - the study of the human condition - needs to broaden its definition of the human condition. Because the human condition isn't immutable and doomed to remain uniform forever.
I tend to work on the principle that much humour relies on cognitive dissonance - on the foreground not matching the background, on the protagonist's response to a situation being inappropriate, and so on.
History is another country and might be full of fascinating incidents and places to go visit - but as a destination for emigration, it has some problems!